SmolLM CPT - a jekunz Collection

jekunz 's Collections

Base Merges

SmolLM baselines trained from scratch

SmolLM CPT LoRA

SmolLM CPT

updated Apr 22

Continued Pre-Training of SmolLM models on the Fineweb-2 portions of Scandinavian languages.

Upvote

jekunz/smollm-135m-cpt-fineweb-faroese

Text Generation • 0.1B • Updated Jan 31 • 10
jekunz/smollm-135m-cpt-fineweb-icelandic

Text Generation • 0.1B • Updated Jan 31 • 6
jekunz/smollm-135m-cpt-fineweb-swedish

Text Generation • 0.1B • Updated May 16 • 981
jekunz/smollm-135m-cpt-fineweb-faroese-transfer-from-icelandic

Text Generation • 0.1B • Updated Jan 31 • 6
jekunz/smollm-360m-cpt-fineweb-swedish

Text Generation • 0.4B • Updated Jun 8 • 9 • 1
jekunz/smollm-360m-cpt-fineweb-faroese

Text Generation • 0.4B • Updated Feb 18 • 4
jekunz/smollm-360m-cpt-fineweb-icelandic

Text Generation • 0.4B • Updated Feb 24 • 4
jekunz/smollm-135m-cpt-fineweb-norwegian-bokmaal

Text Generation • 0.1B • Updated Apr 8 • 9
jekunz/smollm-135m-cpt-fineweb-danish

Text Generation • 0.1B • Updated Apr 8 • 9
jekunz/smollm-360m-cpt-fineweb-faroese-transfer-from-icelandic

Text Generation • 0.4B • Updated Apr 8 • 988
jekunz/smollm-360m-cpt-fineweb-danish

Text Generation • 0.4B • Updated Apr 8 • 6
jekunz/smollm-360m-cpt-fineweb-norwegian-bokmaal

Text Generation • 0.4B • Updated Apr 15 • 6
jekunz/smollm-360m-cpt-fineweb-faroese-transfer-from-danish

Text Generation • 0.4B • Updated Apr 8 • 4
jekunz/smollm-135m-cpt-fineweb-faroese-transfer-from-danish

Text Generation • 0.1B • Updated Apr 8 • 10
jekunz/smollm-360m-cpt-fineweb-faroese-transfer-from-swedish

Text Generation • 0.4B • Updated Apr 11 • 5
jekunz/smollm-135m-cpt-fineweb-faroese-transfer-from-swedish

Text Generation • 0.1B • Updated Apr 11 • 4
jekunz/smollm-135m-cpt-fineweb-norwegian-nynorsk

Text Generation • 0.1B • Updated Apr 15 • 11
jekunz/smollm-360m-cpt-fineweb-norwegian-nynorsk

Text Generation • 0.4B • Updated Apr 15 • 8
jekunz/smollm-360m-cpt-fineweb-faroese-transfer-from-norwegian-nynorsk

Text Generation • 0.4B • Updated Apr 15 • 4
jekunz/smollm-360m-cpt-fineweb-faroese-transfer-from-equal-scandimerge

Text Generation • 0.4B • Updated Apr 22 • 3
jekunz/smollm-135m-cpt-fineweb-faroese-transfer-from-equal-scandimerge

Text Generation • 0.1B • Updated Apr 22 • 986
jekunz/smollm-135m-cpt-fineweb-faroese-transfer-from-norwegian-bokmaal

Text Generation • 0.1B • Updated Apr 22 • 7
jekunz/smollm-135m-cpt-fineweb-faroese-transfer-from-isplus-scandimerge

Text Generation • 0.1B • Updated Apr 22 • 6
jekunz/smollm-360m-cpt-fineweb-faroese-transfer-from-isplus-scandimerge

Text Generation • 0.4B • Updated Apr 22 • 994
jekunz/smollm-135m-cpt-fineweb-faroese-transfer-from-scandimerge-2

Text Generation • 0.1B • Updated Apr 22 • 3
jekunz/smollm-360m-cpt-fineweb-faroese-transfer-from-scandimerge-2

Text Generation • 0.4B • Updated Apr 22 • 3
jekunz/smollm-360m-lora-fineweb-faroese-transfer-from-danish

Text Generation • Updated Apr 22 • 37
jekunz/smollm-360m-cpt-fineweb-faroese-transfer-from-norwegian-bokmaal

Text Generation • 0.4B • Updated Apr 22 • 6

Upvote