Update README.md
Browse files
README.md
CHANGED
|
@@ -34,6 +34,11 @@ Let us know what you think of the model! The 8B and 12B versions of RPMax had gr
|
|
| 34 |
|
| 35 |
v1.2 update completely removes non-creative/RP examples in the dataset and is also an incremental improvement of the RPMax dataset which dedups the dataset even more and better filtering to cutout irrelevant description text that came from card sharing sites.
|
| 36 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 37 |
### Training Details
|
| 38 |
|
| 39 |
* **Sequence Length**: 4096
|
|
|
|
| 34 |
|
| 35 |
v1.2 update completely removes non-creative/RP examples in the dataset and is also an incremental improvement of the RPMax dataset which dedups the dataset even more and better filtering to cutout irrelevant description text that came from card sharing sites.
|
| 36 |
|
| 37 |
+
### Specs
|
| 38 |
+
|
| 39 |
+
* **Context Length**: 128K
|
| 40 |
+
* **Parameters**: 70B
|
| 41 |
+
|
| 42 |
### Training Details
|
| 43 |
|
| 44 |
* **Sequence Length**: 4096
|