Hi @youali,
I would be tempted to thing that it is related to this issue 36, but you say that it also fails with 1.2.0.
Does it happen only with the torchvision model you are trying to send to the GPU or even with a toy network (let’s say, several Conv2d and BNs)?