Untie-the-Knots. Untie-the-Knots: An Efficient Data Augmentation Strategy for Long-Context Pre-Training in Language Models

github.com/rgtjf/Untie-the-Knots

Problem

Audience

Updates

No founder updates yet. Check back soon.