cotabbyinference. A C++ inference engine wrapping llama.cpp for on-device LLM inference on macOS, designed for Cotabby.