Rare find

vllm-musa. A high-throughput and memory-efficient inference and serving engine for LLMs

github.com/MooreThreads/vllm-musa
by @MooreThreads

Problem

Audience

Keep exploring

Updates

No founder updates yet. Check back soon.