Rare find

TinyLlama. The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.

github.com/jzhang38/TinyLlama

Problem

Audience

Updates

No founder updates yet. Check back soon.