TokSuite Backup

community

AI & ML interests

None defined yet.

Recent Activity

Malikeh1375 submitted a paper about 6 hours ago

TokSuite: Measuring the Impact of Tokenizer Choice on Language Model Behavior

Malikeh1375 updated a collection 7 days ago

TokSuite Detokenized Training Datasets

Malikeh1375 updated a collection 7 days ago

TokSuite Detokenized Training Datasets

View all activity

Collections 1

models 0

None public yet

datasets 14

toksuitebackup/Qwen-Qwen3-8B-toksuite-detokenized

Viewer • Updated 8 days ago • 12.8M • 273

toksuitebackup/facebook-xglm-564M-toksuite-detokenized

Viewer • Updated Nov 18 • 16.8M • 195

toksuitebackup/mistralai-tekken-toksuite-detokenized

Viewer • Updated Nov 18 • 17.1M • 189

toksuitebackup/gpt-4o-toksuite-detokenized

Viewer • Updated Nov 18 • 17.1M • 192

toksuitebackup/byt5-small-toksuite-detokenized

Viewer • Updated Nov 18 • 1.92M • 110

toksuitebackup/meta-llama-Llama-3.2-1B-toksuite-detokenized

Viewer • Updated Nov 17 • 17M • 395

toksuitebackup/microsoft-Phi-3-mini-4k-instruct-toksuite-detokenized

Viewer • Updated Nov 17 • 14.9M • 175

toksuitebackup/gpt2-toksuite-detokenized

Viewer • Updated Nov 17 • 17M • 214

toksuitebackup/tokenmonster-englishcode-32000-consistent-v1-toksuite-detokenized

Viewer • Updated Nov 17 • 14.9M • 209

toksuitebackup/comma-v0.1-toksuite-detokenized

Viewer • Updated Nov 17 • 13.7M • 238

View 14 datasets