Rare find

llm-compressor. Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

github.com/vllm-project/llm-compressor
by @vllm-project

Problem

Audience

Keep exploring

Updates

No founder updates yet. Check back soon.