vllm. A high-throughput and memory-efficient inference and serving engine for LLMs

github.com/boy-hack/vllm

by

@boy-hack

Problem

Audience

Keep exploring

Updates

No founder updates yet. Check back soon.