@Inferact | @vllm-project
retraining-free-pruning. [NeurIPS 2022] A Fast Post-Training Pruning Framework for Transformers
vllm. A high-throughput and memory-efficient inference and serving engine for LLMs
scripts. Shell
exp. Python
torch-xla. Enabling PyTorch on XLA Devices (e.g. Google TPU)
scatter. Python
