Rare find

xinfer. Blazing-fast LLM inference in pure Rust. No PyTorch and Python runtime.

github.com/guoqingbao/xinfer
by @guoqingbao

Problem

Audience

Keep exploring

Updates

No founder updates yet. Check back soon.