Steel-LLM:From Scratch to Open Source -- A Personal Journey in Building a Chinese-Centric LLM
Paper
•
2502.06635
•
Published
•
4
LLM
-
-
SmolLM2: When Smol Goes Big -- Data-Centric Training of a Small Language Model
Paper • 2502.02737 • Published • 220 -
REINFORCE++: A Simple and Efficient Approach for Aligning Large Language Models
Paper • 2501.03262 • Published • 99 -
MiniMax-01: Scaling Foundation Models with Lightning Attention
Paper • 2501.08313 • Published • 284 -
Towards Best Practices for Open Datasets for LLM Training
Paper • 2501.08365 • Published • 61 -
Qwen2.5-1M Technical Report
Paper • 2501.15383 • Published • 69 -
LLM Pretraining with Continuous Concepts
Paper • 2502.08524 • Published • 28 -
Predictive Data Selection: The Data That Predicts Is the Data That Teaches
Paper • 2503.00808 • Published • 57 -
Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAs
Paper • 2503.01743 • Published • 83 -
RWKV-7 "Goose" with Expressive Dynamic State Evolution
Paper • 2503.14456 • Published • 135 -
A Comprehensive Survey on Long Context Language Modeling
Paper • 2503.17407 • Published • 49 -
Gemma 3 Technical Report
Paper • 2503.19786 • Published • 43 -
Exploring Data Scaling Trends and Effects in Reinforcement Learning from Human Feedback
Paper • 2503.22230 • Published • 43