I’m a bit confused about the information that the NaN values are created by the ReLU layer, while the error points to DivBackward0. Could you check where a division is used and make sure it’s creating valid outputs?