sophosympatheia commited on
Commit
e4b4ee3
·
1 Parent(s): 953772f

Update README.md

Browse files

Updated sampler setting for 4096 context.

Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -20,7 +20,7 @@ This model was designed for roleplaying and storytelling and I think it does wel
20
 
21
  I recommend using the new Min-P sampler method with this model. The creator has a great [guide to it on Reddit](https://www.reddit.com/r/LocalLLaMA/comments/17vonjo/your_settings_are_probably_hurting_your_model_why/).
22
 
23
- I find this model performs surprisingly well at 8192 context.
24
 
25
  Experiment with any and all of the settings below, but trust me on a few points:
26
  * This model works well with Min-P.
@@ -79,7 +79,7 @@ If you save the below settings as a .json file, you can import them directly int
79
  "n": 1,
80
  "rep_pen_size": 0,
81
  "genamt": 550,
82
- "max_length": 8192
83
  }
84
  ```
85
 
 
20
 
21
  I recommend using the new Min-P sampler method with this model. The creator has a great [guide to it on Reddit](https://www.reddit.com/r/LocalLLaMA/comments/17vonjo/your_settings_are_probably_hurting_your_model_why/).
22
 
23
+ I find this model performs surprisingly well at 8192 context but you will probably get better results at 4096 context.
24
 
25
  Experiment with any and all of the settings below, but trust me on a few points:
26
  * This model works well with Min-P.
 
79
  "n": 1,
80
  "rep_pen_size": 0,
81
  "genamt": 550,
82
+ "max_length": 4096
83
  }
84
  ```
85