Hi,
I have this strange problem where the GPU hangs the minute model.cuda() is called.

GPU: V100 32GB
Nvidia Driver: 418.87.00
CUDA version: 10.1
Pytorch version: tested with 1.3.0 and 1.2.0.

it happens within the training script, but even in a python console, where I only create a torchvision model and try to send it to the GPU, and then the node hangs (the resource manager is Slurm if that’s relevant). I note that I don’t have this problem with other GPUs (notably K80).
Thanks.