Rare find

prometheus-vision. [ACL 2024 Findings & ICLR 2024 WS] An Evaluator VLM that is open-source, offers reproducible evaluation, and inexpensive to use. Specifically designed for fine-grained evaluation on customized score rubric, Prometheus-Vision is a good alternative for human evaluation and GPT-4V evaluation.

github.com/prometheus-eval/prometheus-vision

Problem

Audience

Updates

No founder updates yet. Check back soon.