Texas

Tom Turney

Advanced
@TheTom

Working on LLM inference systems, KV cache compression, and kernel-level optimizations (TurboQuant).

turboquant_plus. Python

7k

llama-cpp-turboquant. LLM inference in C/C++

2.1k

vllm-swift. vLLM Metal plugin powered by mlx-swift — high-performance LLM inference on Apple Silicon

271

elm327_obd_for_mac. I'm crazy and trying to make a ForScan OBD reader work on my mac.

11

longctx. Open long-context inference stack: retrieval + open weights, no closed parts. pip install longctx.

7

momento. Deterministic State Recovery for AI Coding Agents

5

mlx. MLX: An array framework for Apple silicon

5

BookTies. The new Book Ties!!

4

pascal-egpu. Driverless NVIDIA Pascal (GTX 1060) compute from macOS Apple Silicon over Thunderbolt eGPU

4

BookTiesOld. Book Ties old source code.

3

pastors-pocket-spurgeon. Offline Spurgeon study companion — pastoral counsel, sermon prep, and Sword & Trowel sermon grading. Gemma-4-12B fine-tune served on TurboQuant llama.cpp.

3

cs161. StemVille real-time data plotting experiment

2

LearnPerl. just perl code

2

main_web.

2

turboquant-tinygrad-bridge. Compressed KV cache as cross-backend wire format for Metal + CUDA split inference over Thunderbolt 5

1

tqkit. Unified toolkit for benchmarking and integrating TurboQuant+ KV-cache compression across llama.cpp, vLLM, MLX, and vllm-swift.

1

ds4-turboquant_plus. Private backup of TQ+ Metal port work on antirez/ds4. Branch tom/turbo3-kv-cuda (turbo2/3/4 + Wave M3 inline-dequant + half-tile + CUDA stubs + h8 Flash WIP).

1

ffai. FFAI — F*cking Fast AI. Dual-engine inference: Swift (Apple/iPhone, native Metal) + Rust (cross-platform: CUDA/Vulkan/ROCm). Shared kernels via metaltile.

1
18
Apply