Rare find

flex-nano-vllm. FlexAttention based, minimal vllm-style inference engine for fast Gemma 2 inference.

github.com/changjonathanc/flex-nano-vllm
by @changjonathanc

Problem

Audience

Keep exploring

Updates

No founder updates yet. Check back soon.