Hello all,
I am currently exploring the influence of some architectures and hyperparameters in my specific task. Thus, I created a loop to train several times the same model (with the same set of hyperparameters but reinitialized weights) to see if model performance is statistically significant when compared to others. However, even if I set the parameter force_download = True when downloading the pretrained model (with the method from_pretrained), my experiments seem to be throwing the same results each time after the first iteration (see image below).
image2444×394 44.4 KB
So, do you have any insights of what I am doing wrong? How to create a loop that will train a new model from scratch each time?
Thank you,
J.