exllama-ish. Apple Silicon port of exllamav3 - Efficient 4-bit quantized LLM inference using Metal and MLX

github.com/Infatoshi/exllama-ish

Problem

Audience

Updates

No founder updates yet. Check back soon.