MiniPLM: Knowledge Distillation for Pre-Training Language Models
Paper
•
2410.17215
•
Published
•
16
Unseen Papers
-
-
LOGO -- Long cOntext aliGnment via efficient preference Optimization
Paper • 2410.18533 • Published • 44 -
Breaking the Memory Barrier: Near Infinite Batch Size Scaling for Contrastive Loss
Paper • 2410.17243 • Published • 95 -
LongReward: Improving Long-context Large Language Models with AI Feedback
Paper • 2410.21252 • Published • 18 -
COAT: Compressing Optimizer states and Activation for Memory-Efficient FP8 Training
Paper • 2410.19313 • Published • 19