How do I separate the reasoning from the reply?
#7
by
Lockout
- opened
I downloaded it because the replies were interesting on the API. Unfortunately it often spits out <|think|> or randomly thinks instead of answering. It EOS-es out before it outputs a closing tag and I never get anywhere.
If I re-roll to bypass the thinking, sometimes I get it after or within the context of the reply. I tried biasing against "wait" but it didn't bear fruit.
Yeah really. This model feels like it'd be good if the think tags weren't all messed up.