What is alternate about the tokenizer?
#2
by
bartowski
- opened
Just curious what the changes are and if there's any benefit to using this over the original
Just curious what the changes are and if there's any benefit to using this over the original
Just for training with our newest datasets and chatml