Fail to Force Strict Output Format
#2
by
LudoMediway
- opened
Hi everyone,
I'm currently investigating the quality of the model using a prompt with a very specific format (i.e. I only want the model to summarize the input in two bullet points a) and b). However, the model keeps outputting a short summary sentence despite my insistence not to.
I assume this must be coming from the instruction as the original mistral 3.1. 24B does not behave this way (I checked Mistral's API). Do you know how to solve this problem?
I tried adding an example in the prompt which makes the inference slower and it doesn't seem to change the outcome (i.e. still this introduction sentence). I could also eventually add post-processing steps but this also wouldn't be very clean.
Thanks a lot!