SmolTulu: Higher Learning Rate to Batch Size Ratios Can Lead to Better Reasoning in SLMs
Paper
•
2412.08347
•
Published
•
4
AdaML Lab @ KAUST
university
AI & ML interests
None defined yet.
AdaMLLab's activity
SultanR
authored
4
papers
5 months ago
When Benchmarks are Targets: Revealing the Sensitivity of Large Language Model Leaderboards
Paper
•
2402.01781
•
Published
•
3
Fineweb-Edu-Ar: Machine-translated Corpus to Support Arabic Small Language Models
Paper
•
2411.06402
•
Published
•
2
ALLaM: Large Language Models for Arabic and English
Paper
•
2407.15390
•
Published
•
2
oserikov
authored
a
paper
over 1 year ago