llm-throughput-eval. evaluate llm's generation speed via API

github.com/Orion-zhen/llm-throughput-eval

Problem

Audience

Updates

No founder updates yet. Check back soon.