@ptrblck thank you for the reply. From the link and looking at my model, I realized that at least in the forward pass, just the nn.Upsample() layer seems to be the reason why values would be different across the two versions. I explicitly used mode='trilinear', align_corners=True  while training the model in PyTorch 0.4 . Are there other elements I should keep a check on since the value difference is a bit strange.