lmdeploy. LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

github.com/sshuair/lmdeploy
by @sshuair

Problem

Audience

Keep exploring

Updates

No founder updates yet. Check back soon.