LocalLLMClient-JT. An enhanced version of tattn's LocalLLMClient, with Qwen 3 VL support (both Llama Cpp and MLX), updated Llama Cpp, and Inference Performance tooling.

github.com/theJayTea/LocalLLMClient-JT
by @theJayTea

Problem

Audience

Keep exploring

Updates

No founder updates yet. Check back soon.