Rare find

Model-Optimizer. A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM, TensorRT, vLLM, etc. to optimize inference speed.

github.com/NVIDIA/Model-Optimizer

Problem

Audience

Updates

No founder updates yet. Check back soon.