SGLang inference Error
#4
by
laolao77
- opened
When I use SGLang to run inference on the case provided by the author, the returned result is as follows:
"{"answer":\n\n "" }"
It seems that the inference failed — why is that?
Have you turned on forced outputs?
I get this aswell, string outputs can be just ":{" or "\", just characters of that nature