Hello, and thanks for the reply! Will do the fine-tuning with a smaller sample o data. Another question came to my mind, should I train a new tokenizer? How are new words handled when I use the finetune.py on my dataset?
I’m the only one in the system.
Will save the model and optimizer state-dict, this is helpful.
Why run the validation less frequently? Don’t make rushed decisions about the model’s performance?!