Great, I fixed that, but I’ve figured out that the problem was that I wasn’t setting the momentum parameter 21 in the BatchNorm layers initializations. Since my input data is highly variable, the default value of momentum (0.1) was not proper for my data distribution.
Thanks!