OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens Paper • 2504.07096 • Published Apr 9 • 75
Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Multimodal Models Paper • 2409.17146 • Published Sep 25, 2024 • 121
Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Research Paper • 2402.00159 • Published Jan 31, 2024 • 64
OLMo: Accelerating the Science of Language Models Paper • 2402.00838 • Published Feb 1, 2024 • 84
Large Language Model Distillation Doesn't Need a Teacher Paper • 2305.14864 • Published May 24, 2023 • 3
Catwalk: A Unified Language Model Evaluation Framework for Many Datasets Paper • 2312.10253 • Published Dec 15, 2023 • 8
Paloma: A Benchmark for Evaluating Language Model Fit Paper • 2312.10523 • Published Dec 16, 2023 • 13
Documenting Large Webtext Corpora: A Case Study on the Colossal Clean Crawled Corpus Paper • 2104.08758 • Published Apr 18, 2021
From 'F' to 'A' on the N.Y. Regents Science Exams: An Overview of the Aristo Project Paper • 1909.01958 • Published Sep 4, 2019