Good text, but problems with thinking
#2
by
gahoo
- opened
This is a good model. In thinking mode, it really picks up the hints of how I try to steer the story, and I don't need to use comments nearly as often as with others. The text style is fresh too.
But I have a problem: only 1 in 3 generations actually succeeds. Other times it either ends thinking with a corrupted tag <|\thinking|>, or a EOS tag instead, or does not end it, keeping thinking in circles. Do you know anything to deal with it? I already disabled the XTC and repetition penalties, all I have is temperature 1.5 and nsigma 1.5.