InferLLM. a lightweight LLM model inference framework

github.com/xingchensong/InferLLM
by @xingchensong

Problem

Audience

Keep exploring

Updates

No founder updates yet. Check back soon.