This might be an unrelated regression on the 2080Ti.
Could you post the model and shapes you are using?
Also, did you use torch.backends.cudnn.benchmark = True, which would use the heuristics to select the fastest kernel for your workload?