AutoGPTQ. An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

github.com/oobabooga/AutoGPTQ

Problem

Audience

Updates

No founder updates yet. Check back soon.