Rare find

SwiftLM. ⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache compression, MACOS + iOS iPhone app.

github.com/SharpAI/SwiftLM
by @SharpAI

Problem

Audience

Keep exploring

Updates

No founder updates yet. Check back soon.