Rare find

lmppl. Calculate perplexity on a text with pre-trained language models. Support MLM (eg. DeBERTa), recurrent LM (eg. GPT3), and encoder-decoder LM (eg. Flan-T5).

github.com/asahi417/lmppl

Problem

Audience

Updates

No founder updates yet. Check back soon.