Sign in
Rare find
vLLM-2080Ti-Definitive.
The definitive vLLM runtime for dual RTX 2080 Ti 22GB + NVLink, delivering Qwen 27B local inference with 100+ tok/s single-request decode with support of FP8 weight
github.com/weicj/vLLM-2080Ti-Definitive
by
@weicj
Problem
Audience
Keep exploring
Updates
Founder
0
Product
0
No founder updates yet. Check back soon.
๐งช
staging