Fix EOS token in model configs pt2

#4
by Tostino - opened

Update config.json to use the configured eos_token in the tokenizer.

Ready to merge
This branch is ready to get merged automatically.
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment