ZClip: Adaptive Spike Mitigation for LLM Pre-Training Paper • 2504.02507 • Published 17 days ago • 76 • 2
A Refined Analysis of Massive Activations in LLMs Paper • 2503.22329 • Published 23 days ago • 14 • 3
Variance Control via Weight Rescaling in LLM Pre-training Paper • 2503.17500 • Published 30 days ago • 5 • 2