user

#1
by ffghgfh - opened

the model keeps ending it's response with a new line saying "user" when using chatml. sometimes it talks for the user as well, am i using the wrong prompt format?

other than that user thing, this is a really good model

Adding </s>as an additional stopping token fixes that issue.

Sign up or log in to comment