shimmy. ⚡Local-first AI inference server with OpenAI API compatibility, auto-discovery, hot model swapping, and tool calling. Single-binary Rust solution for GGUF models with LoRA support. FREE now, FREE forever.

github.com/jwangkun/shimmy

Problem

Audience

Updates

No founder updates yet. Check back soon.