Thanks for splitting up the code!
We’ll try to reproduce this issue locally.



 kkjh0723:

By the way, if I shouldn’t call  half() , then how can I use some  torch  functions such as  torch.randn()  inside a module? I got an type error without half() in pytorch v1.1.


I assume you are creating these tensors in the forward method? While O1 and native amp should work out of the box, I’m unsure if O2 would work and we would need to see a code snippet for it.
EDIT: I was able to reproduce and narrow down this issue to a faulty kernel in cudnn.
I’ve also tested the next release candidate and the issue is gone, so my only advice for you is not to use this particular convolution in mixed-precision training.