Rare find

gpu_poor. Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization

github.com/RahulSChand/gpu_poor
by @RahulSChand

Problem

Audience

Keep exploring

Updates

No founder updates yet. Check back soon.