<|im_end|> token

#2
by djuna - opened

It seems that the config is wrong about the eos?

Anthracite org

seems indeed to be the case, thanks for pointing it out! we'll investigate.

Hey, I haven't tested my pull request, but please look into it.

Anthracite org

can you verify it works first? thanks

I'll try it

It seems fix the issue. But I guess it better use proper config from original instruct model.

Anthracite org

"it better use proper config from original instruct model"
can you elaborate?

The json file from qwen1.5 Chat/Instruct model

Anthracite org

done, thanks

lucyknada changed discussion status to closed

Sign up or log in to comment