Model always ends generation with \boxed{}
#16
by
cbunivofutah
- opened
Even using adding " NEVER use \boxed{} in your response." to the system prompt, the model always ends generation with \boxed{}.
I'm guessing this was used for easy extraction of the generated answer during RL, but the behavior seems to really be prevalent in the model regardless of the task I throw at it.
Regardless, thanks for the model !