Update README.md
Browse files
README.md
CHANGED
|
@@ -35,6 +35,7 @@ Model Details
|
|
| 35 |
state_size: 16
|
| 36 |
32k context length
|
| 37 |
65k vocab size
|
|
|
|
| 38 |
Continue Pretrained from Falcon-Mamba-7b, with another 1500 Gigatokens of data consisting of web, code, STEM and high quality data.
|
| 39 |
Postrained on 1.2 million samples of STEM, conversations, code, and safety.
|
| 40 |
Developed by Technology Innovation Institute
|
|
|
|
| 35 |
state_size: 16
|
| 36 |
32k context length
|
| 37 |
65k vocab size
|
| 38 |
+
|
| 39 |
Continue Pretrained from Falcon-Mamba-7b, with another 1500 Gigatokens of data consisting of web, code, STEM and high quality data.
|
| 40 |
Postrained on 1.2 million samples of STEM, conversations, code, and safety.
|
| 41 |
Developed by Technology Innovation Institute
|