Hello @eprokopalo, I have encountered same problem https://discuss.pytorch.org/t/batchnorm-and-relu/76563 36. I am using Conv1d --> ReLU --> BatchNorm, which gives me NaN. Have you found any reason or solution for this??