Rare find

ntransformer. High-efficiency LLM inference engine in C++/CUDA. Run Llama 70B on RTX 3090.

github.com/xaskasdf/ntransformer

Problem

Audience

Updates

No founder updates yet. Check back soon.