Rare find

exllama. A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.

github.com/jllllll/exllama

Problem

Audience

Updates

No founder updates yet. Check back soon.