How to disable the thinking mode?

#26
by fmmarkmq - opened

In some cases, I don't want the model to think because of the time cost. How can I disable the thinking mode?

i have same question

if you want to disable thinking just fine tune the model with a dataset to stop when you say so for example:

User: Stop reasoning
Assistant: Got it! I'll switch to regular chat mode.

User: No more steps please
Assistant: Understood! Back to normal conversation.

or you could just add a prompt:

"CRITICAL: When switching from reasoning to other modes, immediately adapt to the new tone "
"without continuing step-by-step explanations unless explicitly asked. "
"Drop all numbering and bullet points when not in reasoning mode.\n"

I created a tone prompt specifically for reasoning connected to my frontend and I can switch to reasoning or back to my auto tones

Sign up or log in to comment