FineWeb2: One Pipeline to Scale Them All -- Adapting Pre-Training Data Processing to Every Language Paper • 2506.20920 • Published Jun 26, 2025 • 80
Running 96 Scaling FineWeb to 1000+ languages: Step 1: finding signal in 100s of evaluation tasks 📝 96 Evaluate multilingual models using FineTasks
