I don’t know which model you are using, but you could try to either use the nightly binaries with cuDNN8.2.2 or build PyTorch from source with the latest cudnn version to check the latest performance.
Also, torch.backends.cudnn.benchmark = True could help in case you are working with static input shapes (or a low variance in the shape).