Did you include the EOT token in fine tuning?
#8
by
manzked
- opened
We are testing the sauerkraut version right now and faced a few occasions, where the model didn't stop generating. Llama3 is know for its fine tuning issues, because it doesn't automatically includes the EOT token.
Have you guys made sure it is included pro-actively?