MiniLLM
/

KD-gpt2-340M

Text Generation

Model card Files Files and versions Community

t1101675 commited on Sep 26

Commit

a852c5b

•

1 Parent(s): 501a006

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -16,7 +16,7 @@ pipeline_tag: text-generation
 **KD-gpt2-340M** is a gpt2-medium (120M) model distilled from [gpt2-xlarge (1.5B)](https://huggingface.co/MiniLLM/teacher-gpt2-1.5B) on [databricks-dolly-15k](https://huggingface.co/datasets/aisquared/databricks-dolly-15k) with token-level forward KLD.
-It is used as a baseline for [MiniLLM](MiniLLM/MiniLLM-gpt2-340M).
 ## Other Baselines

 **KD-gpt2-340M** is a gpt2-medium (120M) model distilled from [gpt2-xlarge (1.5B)](https://huggingface.co/MiniLLM/teacher-gpt2-1.5B) on [databricks-dolly-15k](https://huggingface.co/datasets/aisquared/databricks-dolly-15k) with token-level forward KLD.
+It is used as a baseline for [MiniLLM](https://huggingface.co/MiniLLM/MiniLLM-gpt2-340M).
 ## Other Baselines