Question about MCTS in inference process

#18
by JasonCruisePurdue - opened

Very interesting research. I'm new to o1 and confused about whether the user need to apply MCTS in the inference process.
While it’s possible to append "use an MCTS (step) /" to the prompt to generate an MCTS-like response, does this approach fully unleash the model's potential?
One assumption could be that MCTS is primarily utilized during the training process to enhance the model's performance. In that case, adding "use an MCTS (step) /" to the original prompt during inference might suffice. Could you clarify if this is the intended mechanism? Thanks.

deleted
This comment has been hidden

Sign up or log in to comment