Rare find

vllm. A high-throughput and memory-efficient inference and serving engine for LLMs

github.com/vllm-project/vllm

Problem

Audience

Updates

No founder updates yet. Check back soon.