EasyGPTQ. A simple self-implemented example demonstrating both GPTQ and Quarot, a custom quantization method designed for efficient inference of LLMs.

github.com/script-Yang/EasyGPTQ

Problem

Audience

Updates

No founder updates yet. Check back soon.