FlexGen. Running large language models on a single GPU for throughput-oriented scenarios.

github.com/oobabooga/FlexGen
by @oobabooga

Problem

Audience

Keep exploring

Updates

No founder updates yet. Check back soon.