A close-up view from the training performance, without the outliers. As you can see, even after the first peak, the values don’t get close to the point where they were at the stop of training, as if something hasn’t loaded properly. However, when printing values and state_dicts while going through the code step-by-step, all seems to be there.
Screenshot 2020-07-29 at 12.18.581229×402 59.1 KB