brucethemoose commited on
Commit
107ece1
1 Parent(s): 601af45

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -56,7 +56,7 @@ USER: {prompt}
56
  ASSISTANT:
57
 
58
  ```
59
- Being a Yi model, try disabling the BOS token and/or running a lower temperature with MinP if output doesn't seem right.
60
 
61
  Sometimes the model "spells out" the stop token as `</s>` like Capybara, so you may need to add `</s>` as an additional stopping condition. It also might respond to the llama-2 chat format.
62
 
 
56
  ASSISTANT:
57
 
58
  ```
59
+ Being a Yi model, try disabling the BOS token and/or running a lower temperature with MinP (and no other samplers) if output doesn't seem right. Yi tends to run "hot" by default.
60
 
61
  Sometimes the model "spells out" the stop token as `</s>` like Capybara, so you may need to add `</s>` as an additional stopping condition. It also might respond to the llama-2 chat format.
62