I won’t say it is bad sign for reproducibility. Arch, normalization method, lr, optimization algorithm, weight init, they all matter. With a different set of normalization constants, you will definitely need to tune other things too to make it work. Unfortunately that is the current state of DL.