DataDecide: How to Predict Best Pretraining Data with Small Experiments Paper • 2504.11393 • Published 9 days ago • 16
ProX Dataset Collection a collection of pre-training corpora refined by ProX • 6 items • Updated Feb 14 • 7
SUPER: Evaluating Agents on Setting Up and Executing Tasks from Research Repositories Paper • 2409.07440 • Published Sep 11, 2024 • 8 • 2
Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Research Paper • 2402.00159 • Published Jan 31, 2024 • 64