SmolLM CPT - a jekunz Collection

jekunz 's Collections

Adaptation of SmolLM to Faroese

SmolLM baselines trained from scratch

SmolLM CPT LoRA

SmolLM CPT

updated Apr 22

Continued Pre-Training of SmolLM models on the Fineweb-2 portions of Scandinavian languages.

Upvote

jekunz/smollm-135m-cpt-fineweb-faroese

Text Generation • 0.1B • Updated Jan 31 • 4
jekunz/smollm-135m-cpt-fineweb-icelandic

Text Generation • 0.1B • Updated Jan 31
jekunz/smollm-135m-cpt-fineweb-swedish

Text Generation • 0.1B • Updated May 16 • 2
jekunz/smollm-135m-cpt-fineweb-faroese-transfer-from-icelandic

Text Generation • 0.1B • Updated Jan 31
jekunz/smollm-360m-cpt-fineweb-swedish

Text Generation • 0.4B • Updated Jun 8 • 3 • 1
jekunz/smollm-360m-cpt-fineweb-faroese

Text Generation • 0.4B • Updated Feb 18
jekunz/smollm-360m-cpt-fineweb-icelandic

Text Generation • 0.4B • Updated Feb 24
jekunz/smollm-135m-cpt-fineweb-norwegian-bokmaal

Text Generation • 0.1B • Updated Apr 8
jekunz/smollm-135m-cpt-fineweb-danish

Text Generation • 0.1B • Updated Apr 8 • 1
jekunz/smollm-360m-cpt-fineweb-faroese-transfer-from-icelandic

Text Generation • 0.4B • Updated Apr 8 • 6
jekunz/smollm-360m-cpt-fineweb-danish

Text Generation • 0.4B • Updated Apr 8
jekunz/smollm-360m-cpt-fineweb-norwegian-bokmaal

Text Generation • 0.4B • Updated Apr 15
jekunz/smollm-360m-cpt-fineweb-faroese-transfer-from-danish

Text Generation • 0.4B • Updated Apr 8 • 2
jekunz/smollm-135m-cpt-fineweb-faroese-transfer-from-danish

Text Generation • 0.1B • Updated Apr 8
jekunz/smollm-360m-cpt-fineweb-faroese-transfer-from-swedish

Text Generation • 0.4B • Updated Apr 11
jekunz/smollm-135m-cpt-fineweb-faroese-transfer-from-swedish

Text Generation • 0.1B • Updated Apr 11
jekunz/smollm-135m-cpt-fineweb-norwegian-nynorsk

Text Generation • 0.1B • Updated Apr 15
jekunz/smollm-360m-cpt-fineweb-norwegian-nynorsk

Text Generation • 0.4B • Updated Apr 15 • 2
jekunz/smollm-360m-cpt-fineweb-faroese-transfer-from-norwegian-nynorsk

Text Generation • 0.4B • Updated Apr 15
jekunz/smollm-360m-cpt-fineweb-faroese-transfer-from-equal-scandimerge

Text Generation • 0.4B • Updated Apr 22 • 1
jekunz/smollm-135m-cpt-fineweb-faroese-transfer-from-equal-scandimerge

Text Generation • 0.1B • Updated Apr 22 • 1
jekunz/smollm-135m-cpt-fineweb-faroese-transfer-from-norwegian-bokmaal

Text Generation • 0.1B • Updated Apr 22 • 1
jekunz/smollm-135m-cpt-fineweb-faroese-transfer-from-isplus-scandimerge

Text Generation • 0.1B • Updated Apr 22 • 4
jekunz/smollm-360m-cpt-fineweb-faroese-transfer-from-isplus-scandimerge

Text Generation • 0.4B • Updated Apr 22 • 5
jekunz/smollm-135m-cpt-fineweb-faroese-transfer-from-scandimerge-2

Text Generation • 0.1B • Updated Apr 22 • 1
jekunz/smollm-360m-cpt-fineweb-faroese-transfer-from-scandimerge-2

Text Generation • 0.4B • Updated Apr 22
jekunz/smollm-360m-lora-fineweb-faroese-transfer-from-danish

Text Generation • Updated Apr 22
jekunz/smollm-360m-cpt-fineweb-faroese-transfer-from-norwegian-bokmaal

Text Generation • 0.4B • Updated Apr 22 • 1

Upvote