koboldcpp. Local AI inference server for LLMs and other models, forked from:

github.com/FellowTraveler/koboldcpp
by @FellowTraveler

Problem

Audience

Keep exploring

Updates

No founder updates yet. Check back soon.