It would be very helpful if you could get the cudnn versions to match.
Because the fact that setting torch.backends.cudnn.deterministic = True seems to hint that something changed on the cudnn side.
In particular, for the old version, it was picking a deterministic algorithm by chance which is not the case for the new version?