Rare find

QLLM. A general 2-8 bits quantization toolbox with GPTQ/AWQ/HQQ/VPTQ, and export to onnx/onnx-runtime easily.

github.com/wejoncy/QLLM
by @wejoncy

Problem

Audience

Keep exploring

Updates

No founder updates yet. Check back soon.