Piotr Nawrot

nanoT5. Fast & Simple repository for pre-training and fine-tuning T5-style models

sparse-frontier. The evaluation framework for training-free sparse attention in LLMs

nano-sparse-attention. The simplest implementation of recent Sparse Attention patterns for efficient LLM inference.

dynamic-pooling. Efficient Transformers with Dynamic Token Pooling