I’m not sure how you’ve saved the model, but you’ve hardcoded the checkpoint paths here 5, which are used, even if pretrained=False is passed, so I had to remove them.
After doing so, you’ll see that the outputs are consistent.
I’m also not sure, how you’ve created the output for FIRST and SECOND, but apparently something between these calls was changed.