After setting /nothinking or enable_thinking=False, can the empty <thinking> tag be omitted from the response?
#13
by
pteromyini
- opened
I encountered this minor issue while using ollama. If downstream applications do not handle the tag processing separately, it will greatly affect the appearance (unfortunately, we cannot control all downstream software to adapt to the custom tag removal)
I hardcoded this solution in my app )) Din't figure out how to disable this feature.
I hardcoded this solution in my app )) Din't figure out how to disable this feature.
Currently, my temporary fix also involves hardcode but we can’t realistically ask every downstream application to handle this process individually. The best approach, therefore, is to address this issue at the source of the inference – for example, within vLLM or Ollama.