
Foundation Text-Generation Models Below 360M Parameters
Great candidates for fine-tuning targeting Wllama and Transformers.js for mobile devices, ordered by number of parameters.
Text Generation • Updated • 16.1k • • 38Note License: apache-2.0
OuteAI/Lite-Oute-1-300M
Text Generation • Updated • 354 • 7Note License: apache-2.0
keeeeenw/MicroLlama
Text Generation • Updated • 1.33k • 42Note License: apache-2.0
cerebras/Cerebras-GPT-256M
Text Generation • Updated • 2.03k • 25Note License: apache-2.0
upstage/TinySolar-248m-4k
Text Generation • Updated • 797 • 5Note License: apache-2.0
M4-ai/TinyMistral-248M-v3
Text Generation • Updated • 241 • 6Note License: apache-2.0
MiniLLM/MiniPLM-llama3.1-212M
Text Generation • Updated • 847 • 2Note License: apache-2.0
MiniLLM/MiniPLM-Qwen-200M
Text Generation • Updated • 184 • 2Note License: apache-2.0
princeton-nlp/Sheared-Pythia-160m
Text Generation • Updated • 95 • 4Note License: apache-2.0
JackFram/llama-160m
Text Generation • Updated • 262k • 33Note License: apache-2.0
SmallDoge/Doge-160M
Text Generation • Updated • 5.57k • 2Note License: apache-2.0
EleutherAI/pythia-160m
Text Generation • Updated • 164k • • 29Note License: apache-2.0
HuggingFaceTB/SmolLM-135M
Text Generation • Updated • 175k • • 197Note License: apache-2.0
amd/AMD-Llama-135m
Text Generation • Updated • 18.4k • • 111Note License: apache-2.0
MiniLLM/MiniPLM-Mamba-130M
Text Generation • Updated • 23 • 2Note License: apache-2.0
EleutherAI/gpt-neo-125m
Text Generation • Updated • 125k • • 196Note License: mit
cerebras/Cerebras-GPT-111M
Text Generation • Updated • 4.54k • • 76Note License: apache-2.0
BEE-spoke-data/smol_llama-101M-GQA
Text Generation • Updated • 5.05k • • 28Note License: apache-2.0
openai-community/gpt2
Text Generation • Updated • 16.6M • • 2.6kNote License: mit
distilbert/distilgpt2
Text Generation • Updated • 1.81M • • 486Note License: apache-2.0
weiser/82M-0.4
Text Generation • Updated • 62Note License: apache-2.0
BEE-spoke-data/smol_llama-81M-tied
Text Generation • Updated • 2.97k • 6Note License: apache-2.0
EleutherAI/pythia-70m
Updated • 63k • 64Note License: apache-2.0
JackFram/llama-68m
Text Generation • Updated • 531k • 26Note License: apache-2.0
OuteAI/Lite-Oute-1-65M
Text Generation • Updated • 225 • 9Note License: apache-2.0
SmallDoge/Doge-60M
Text Generation • Updated • 39.8k • 4Note License: apache-2.0
Felladrin/Minueza-32M-Base
Text Generation • Updated • 462 • 16Note License: apache-2.0
GerbilLab/Gerbil-A-32m
Text Generation • Updated • 169 • 2Note License: apache-2.0
EleutherAI/pythia-31m
Text Generation • Updated • 11.4k • 5Note License: apache-2.0
SmallDoge/Doge-20M
Text Generation • Updated • 36.3k • 7Note License: apache-2.0
EleutherAI/pythia-14m
Text Generation • Updated • 122k • 20Note License: apache-2.0