willow-inference-server. Open source, local, and self-hosted highly optimized language inference server supporting ASR/STT, TTS, and LLM across WebRTC, REST, and WS

github.com/aantonop/willow-inference-server

Problem

Audience

Updates

No founder updates yet. Check back soon.