Rare find

AQLM. Official Pytorch repository for Extreme Compression of Large Language Models via Additive Quantization https://arxiv.org/pdf/2401.06118.pdf and PV-Tuning: Beyond Straight-Through Estimation for Extreme LLM Compression https://arxiv.org/abs/2405.14852

github.com/Vahe1994/AQLM

Problem

Audience

Updates

No founder updates yet. Check back soon.