Yeah, I think the same. Even if the inputs should be fine, it doesn’t hurt to check them too.
I would suggest to have a look at the BatchNorm layers close to the input. It’s just a feeling, but I guess if something goes wrong it should be somewhere at the beginning of the forward pass.