Awesome-LLM-Inference. ๐Ÿ“–A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.

github.com/hijkzzz/Awesome-LLM-Inference

Problem

Audience

Updates

No founder updates yet. Check back soon.