Rare find

PowerInfer. High-speed Large Language Model Serving for Local Deployment

github.com/Tiiny-AI/PowerInfer

by

@Tiiny-AI

Problem

Audience

Keep exploring

Updates

No founder updates yet. Check back soon.