I tried to reproduce this issue with CUDA10.2 + cudnn7.6.5.32 with PyTorch build from master as well as the 1.4.0 binaries with CUDA10.1 and CUDA10.0 and all setups run correctly.
How did you install PyTorch? Do you get any error when you disable cudnn via torch.backends.cudnn.enabled = False?