AutoGPTQ. An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

github.com/jllllll/AutoGPTQ

Problem

Audience

Updates

No founder updates yet. Check back soon.