vllm. This is a fork of vllm for extracting embeddings of generated tokens

github.com/MiZhenxing/vllm

Problem

Audience

Updates

No founder updates yet. Check back soon.