My network does not have any BatchNormalization layers. It consists purely of conv, conv transpose and ReLU. Might this still be a numeric stability problem? I have made sure that both network parameters and input are halftensors.