Working on LLM inference systems, KV cache compression, and kernel-level optimizations (TurboQuant).
turboquant_plus. Python
7kllama-cpp-turboquant. LLM inference in C/C++
2.1kvllm-swift. vLLM Metal plugin powered by mlx-swift — high-performance LLM inference on Apple Silicon
271elm327_obd_for_mac. I'm crazy and trying to make a ForScan OBD reader work on my mac.
11longctx. Open long-context inference stack: retrieval + open weights, no closed parts. pip install longctx.
7momento. Deterministic State Recovery for AI Coding Agents
5mlx. MLX: An array framework for Apple silicon
5BookTies. The new Book Ties!!
4pascal-egpu. Driverless NVIDIA Pascal (GTX 1060) compute from macOS Apple Silicon over Thunderbolt eGPU
4BookTiesOld. Book Ties old source code.
3pastors-pocket-spurgeon. Offline Spurgeon study companion — pastoral counsel, sermon prep, and Sword & Trowel sermon grading. Gemma-4-12B fine-tune served on TurboQuant llama.cpp.
3cs161. StemVille real-time data plotting experiment
2LearnPerl. just perl code
2main_web.
2turboquant-tinygrad-bridge. Compressed KV cache as cross-backend wire format for Metal + CUDA split inference over Thunderbolt 5
1tqkit. Unified toolkit for benchmarking and integrating TurboQuant+ KV-cache compression across llama.cpp, vLLM, MLX, and vllm-swift.
1ds4-turboquant_plus. Private backup of TQ+ Metal port work on antirez/ds4. Branch tom/turbo3-kv-cuda (turbo2/3/4 + Wave M3 inline-dequant + half-tile + CUDA stubs + h8 Flash WIP).
1ffai. FFAI — F*cking Fast AI. Dual-engine inference: Swift (Apple/iPhone, native Metal) + Rust (cross-platform: CUDA/Vulkan/ROCm). Shared kernels via metaltile.
1