Settings / Known issues / Fixes

#2
by DavidAU - opened
Owner
β€’
edited Jul 8

(this is on the model card page; posted here for clarity)

Settings / Known Issue(s) and Fix(es):

This merge runs very hot, so a reduction in "temp" may be in order for some use cases (IE: ".8" down to ".6").

If you getting a repeat word (IE: "hahaha" , "ahhhh", "f-word"), and/or letter (IE "nnnn") change the "rep penalty" to "1.1" to "1.5"

Set "rep pen" higher if you are getting "repeat" letter(s), lower if you are getting a repeat word(s).

Generally "repeat penalty" setting of "1.1" works well.

Role Play / Multi-turn: Rep_pen of 1.15 or higher is recommended.

DavidAU changed discussion title from Known issues / Fixes to Settings / Known issues / Fixes

Sign up or log in to comment