Update README.md
Browse files
README.md
CHANGED
@@ -74,7 +74,7 @@ A custom GPT-style transformer language model built from scratch using PyTorch,
|
|
74 |
|
75 |
## Model Overview
|
76 |
|
77 |
-
SnowflakeCore-G1-Tiny is a GPT-style autoregressive transformer model with **~
|
78 |
|
79 |
### Key Features
|
80 |
- **2048 token context window** for extended conversations
|
@@ -88,7 +88,7 @@ SnowflakeCore-G1-Tiny is a GPT-style autoregressive transformer model with **~40
|
|
88 |
| Component | Value |
|
89 |
|-----------|-------|
|
90 |
| Model Type | Autoregressive Transformer |
|
91 |
-
| Parameters | ~
|
92 |
| Layers | 24 |
|
93 |
| Hidden Size | 1024 |
|
94 |
| Attention Heads | 16 |
|
|
|
74 |
|
75 |
## Model Overview
|
76 |
|
77 |
+
SnowflakeCore-G1-Tiny is a GPT-style autoregressive transformer model with **~400M parameters** designed for text generation tasks.
|
78 |
|
79 |
### Key Features
|
80 |
- **2048 token context window** for extended conversations
|
|
|
88 |
| Component | Value |
|
89 |
|-----------|-------|
|
90 |
| Model Type | Autoregressive Transformer |
|
91 |
+
| Parameters | ~400M |
|
92 |
| Layers | 24 |
|
93 |
| Hidden Size | 1024 |
|
94 |
| Attention Heads | 16 |
|