llama-srb-api. Single Request Batching API server backed by llama.cpp

github.com/the-crypt-keeper/llama-srb-api
by @the-crypt-keeper

Problem

Audience

Keep exploring

Updates

No founder updates yet. Check back soon.