Yes!
I didn’t realize that the default lr_scheduler_type was linear. I updated–lr_scheduler_type to ‘constant’ and now the models are indeed the same.
Thank you very much for the (quick) response.
I’m still not sure how to get the perplexity of each checkpoint…