FlexGen. Running large language models like ChatGPT/GPT-3/OPT-175B on a single GPU. Up to 100x faster than other offloading systems.

github.com/conceptofmind/FlexGen

Problem

Audience

Updates

No founder updates yet. Check back soon.