Yeah, you shouldn’t use older CUDA versions than 10.0 for your RTX2080Ti, but could you rerun the script on your Titan XP using CUDA10.0, cudnn 7.6.2 and PyTorch 1.1?
It would give us an idea, where the difference might come from.