FlameF0X commited on
Commit
5d01eec
·
verified ·
1 Parent(s): fa255f2

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -74,7 +74,7 @@ A custom GPT-style transformer language model built from scratch using PyTorch,
74
 
75
  ## Model Overview
76
 
77
- SnowflakeCore-G1-Tiny is a GPT-style autoregressive transformer model with **~40M parameters** designed for text generation tasks.
78
 
79
  ### Key Features
80
  - **2048 token context window** for extended conversations
@@ -88,7 +88,7 @@ SnowflakeCore-G1-Tiny is a GPT-style autoregressive transformer model with **~40
88
  | Component | Value |
89
  |-----------|-------|
90
  | Model Type | Autoregressive Transformer |
91
- | Parameters | ~407M |
92
  | Layers | 24 |
93
  | Hidden Size | 1024 |
94
  | Attention Heads | 16 |
 
74
 
75
  ## Model Overview
76
 
77
+ SnowflakeCore-G1-Tiny is a GPT-style autoregressive transformer model with **~400M parameters** designed for text generation tasks.
78
 
79
  ### Key Features
80
  - **2048 token context window** for extended conversations
 
88
  | Component | Value |
89
  |-----------|-------|
90
  | Model Type | Autoregressive Transformer |
91
+ | Parameters | ~400M |
92
  | Layers | 24 |
93
  | Hidden Size | 1024 |
94
  | Attention Heads | 16 |