Commit
·
e4b4ee3
1
Parent(s):
953772f
Update README.md
Browse filesUpdated sampler setting for 4096 context.
README.md
CHANGED
@@ -20,7 +20,7 @@ This model was designed for roleplaying and storytelling and I think it does wel
|
|
20 |
|
21 |
I recommend using the new Min-P sampler method with this model. The creator has a great [guide to it on Reddit](https://www.reddit.com/r/LocalLLaMA/comments/17vonjo/your_settings_are_probably_hurting_your_model_why/).
|
22 |
|
23 |
-
I find this model performs surprisingly well at 8192 context.
|
24 |
|
25 |
Experiment with any and all of the settings below, but trust me on a few points:
|
26 |
* This model works well with Min-P.
|
@@ -79,7 +79,7 @@ If you save the below settings as a .json file, you can import them directly int
|
|
79 |
"n": 1,
|
80 |
"rep_pen_size": 0,
|
81 |
"genamt": 550,
|
82 |
-
"max_length":
|
83 |
}
|
84 |
```
|
85 |
|
|
|
20 |
|
21 |
I recommend using the new Min-P sampler method with this model. The creator has a great [guide to it on Reddit](https://www.reddit.com/r/LocalLLaMA/comments/17vonjo/your_settings_are_probably_hurting_your_model_why/).
|
22 |
|
23 |
+
I find this model performs surprisingly well at 8192 context but you will probably get better results at 4096 context.
|
24 |
|
25 |
Experiment with any and all of the settings below, but trust me on a few points:
|
26 |
* This model works well with Min-P.
|
|
|
79 |
"n": 1,
|
80 |
"rep_pen_size": 0,
|
81 |
"genamt": 550,
|
82 |
+
"max_length": 4096
|
83 |
}
|
84 |
```
|
85 |
|