dilip025
/

mini-gpt1

Text Generation

decoder-only-transformer

generative-pretrained-transformer

Model card Files Files and versions

dilip025 commited on Jun 1

Commit

1b84a6a

·

verified ·

1 Parent(s): f782335

Update README.md

Files changed (1) hide show

README.md +2 -3

README.md CHANGED Viewed

@@ -12,9 +12,8 @@ tags:
 - generative-pretrained-transformer
 - decoder-only-transformer
 ---
-# Mini GPT1 Clone
-This is a custom decoder-only transformer model (GPT1-style) trained from scratch on Bookcorpus dataset using PyTorch.
 ## Model Details

 - generative-pretrained-transformer
 - decoder-only-transformer
 ---
+# Introducing Mini GPT-1  ~55M parameters
+This is a custom decoder-only transformer model (GPT1-style) trained from scratch on Bookcorpus dataset using PyTorch by Dilip Pokhrel.
 ## Model Details