Rare find

omlx. LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

github.com/jundot/omlx

Problem

Audience

Updates

No founder updates yet. Check back soon.