MiniLLM

community

https://github.com/microsoft/LMOps/tree/main/minillm

t1101675

AI & ML interests

Training efficient language models (MiniLLM, MiniPLM)

MiniLLM 's models 50

MiniLLM/MiniLLM-gpt2-340M

Text Generation • Updated Apr 11 • 36 • 4

MiniLLM/SFT-gpt2-120M

Text Generation • 0.1B • Updated Mar 25 • 13

MiniLLM/SFT-gpt2-760M

Text Generation • 0.8B • Updated Mar 25 • 20

MiniLLM/MiniPLM-Qwen-500M

Text Generation • 0.5B • Updated Mar 25 • 18 • 6

MiniLLM/MiniPLM-llama3.1-212M

Text Generation • 0.2B • Updated Mar 25 • 27 • 4

MiniLLM/MiniPLM-Mamba-130M

Text Generation • 0.1B • Updated Mar 25 • 13 • 3

MiniLLM/MiniPLM-Qwen-1.2B

Text Generation • 1B • Updated Mar 25 • 14 • 3

MiniLLM/Ref-Pretrain-Qwen-104M

Text Generation • 0.1B • Updated Mar 25 • 13 • 2

MiniLLM/Pretrain-Qwen-1.2B

Text Generation • 1B • Updated Mar 25 • 13

MiniLLM/Pretrain-Qwen-500M

Text Generation • 0.5B • Updated Mar 25 • 9

MiniLLM/Pretrain-Qwen-200M

Text Generation • 0.2B • Updated Mar 25 • 13

MiniLLM/VanillaKD-Pretrain-Qwen-200M

Text Generation • 0.2B • Updated Mar 25 • 7

MiniLLM/VanillaKD-Pretrain-Qwen-500M

Text Generation • 0.5B • Updated Mar 25 • 8

MiniLLM/VanillaKD-Pretrain-Qwen-1.2B

Text Generation • 1B • Updated Mar 25 • 11

MiniLLM/init-gpt2-120M

Text Generation • 0.1B • Updated Nov 13, 2024 • 15 • 1

MiniLLM/teacher-Llama-13B

Text Generation • Updated Oct 30, 2024 • 16

MiniLLM/MiniLLM-Llama-7B

Text Generation • Updated Oct 30, 2024 • 1.74k • 2

MiniLLM/MiniPLM-Qwen-200M

Text Generation • 0.2B • Updated Oct 27, 2024 • 1.73k • 6

MiniLLM/init-Llama-7B

Text Generation • Updated Sep 26, 2024 • 7

MiniLLM/teacher-OPT-13B

Text Generation • Updated Sep 26, 2024 • 25

MiniLLM/SeqKD-Llama-7B

Text Generation • Updated Sep 26, 2024 • 13

MiniLLM/KD-Llama-7B

Text Generation • Updated Sep 26, 2024 • 19

MiniLLM/SFT-Llama-7B

Text Generation • Updated Sep 26, 2024 • 20

MiniLLM/init-OPT-6.7B

Text Generation • Updated Sep 26, 2024 • 9

MiniLLM/init-OPT-2.7B

Text Generation • Updated Sep 26, 2024 • 22

MiniLLM/init-OPT-1.3B

Text Generation • Updated Sep 26, 2024 • 15

MiniLLM/SeqKD-OPT-6.7B

Text Generation • Updated Sep 26, 2024 • 7

MiniLLM/SeqKD-OPT-2.7B

Text Generation • Updated Sep 26, 2024 • 19

MiniLLM/SeqKD-OPT-1.3B

Text Generation • Updated Sep 26, 2024 • 19

MiniLLM/KD-OPT-6.7B

Text Generation • Updated Sep 26, 2024 • 8