Better prompt and stop symbols make this almost usable now
#3
by
jukofyork
- opened
As suggested in a Reddit discussion, this works better if you use this style of CodeLlama prompt:
### System Prompt
You are an intelligent mathematical assistant.
### User Message
{prompt}
### Assistant
I've also found adding "QED" and "▅" as stop symbols gets rid of the weird rambling "message-board hallucinations" after it completes the task.
You can also add "### System Prompt", "### User Message" and "### Assistant" as stop symbols if you don't want it to take both parts (but this can be kinda cool and sometimes the 'Assistant' alter-ego asks things that are quite interesting!).
It's still not perfect and really in need of an introduction-tuned version, but it is at least usable now.