AutoGPTQ_Triton. An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

github.com/lessw2020/AutoGPTQ_Triton

Problem

Audience

Updates

No founder updates yet. Check back soon.