What GPUs is your cluster using?
Note that the binaries ship with pre-built CUDA, cudnn, etc. for GPUs with compute capability >=3.7.
If the GPUs you are using have an older cc, you might need to build PyTorch from source.