inferi. Cross-platform GPU LLM inference in Rust

github.com/dimforge/inferi

Problem

Audience

Updates

No founder updates yet. Check back soon.