Data shuffled only at the document-level
BabyLM Sequence Length
community
AI & ML interests
BabyLM 2025 paper submission
Recent Activity
View all activity
models
50
babylm-seqlen/opt-2048-warmup-v2
0.1B
•
Updated
•
636
babylm-seqlen/mamba-2048-warmup-v2
0.2B
•
Updated
•
493
babylm-seqlen/mamba-64-warmup-v2
0.2B
•
Updated
•
480
babylm-seqlen/mamba-8192-warmup-v2
0.2B
•
Updated
•
436
babylm-seqlen/mamba-4096-warmup-v2
0.2B
•
Updated
•
437
babylm-seqlen/opt-8192-warmup-v2
0.1B
•
Updated
•
420
babylm-seqlen/opt-4096-warmup-v2
0.1B
•
Updated
•
418
babylm-seqlen/mamba-128-warmup-v2
0.2B
•
Updated
•
448
babylm-seqlen/mamba-512-warmup-v2
0.2B
•
Updated
•
452
babylm-seqlen/mamba-1024-warmup-v2
0.2B
•
Updated
•
456
datasets
18
babylm-seqlen/train_100M_64
Viewer
•
Updated
•
2.56M
•
4
babylm-seqlen/train_100M_512_single_shuffle
Viewer
•
Updated
•
319k
•
8
babylm-seqlen/train_100M_8192_single_shuffle
Viewer
•
Updated
•
19.8k
•
5
babylm-seqlen/train_100M_2048_single_shuffle
Viewer
•
Updated
•
79.8k
•
8
babylm-seqlen/train_100M_16384_single_shuffle
Viewer
•
Updated
•
9.86k
•
3
babylm-seqlen/train_100M_4096_single_shuffle
Viewer
•
Updated
•
39.8k
•
9
babylm-seqlen/train_100M_256_single_shuffle
Viewer
•
Updated
•
639k
•
5
babylm-seqlen/train_100M_1024_single_shuffle
Viewer
•
Updated
•
160k
•
3
babylm-seqlen/train_100M_128_single_shuffle
Viewer
•
Updated
•
1.28M
•
7
babylm-seqlen/train_100M_64_single_shuffle
Viewer
•
Updated
•
2.56M
•
6