Have you found out how to make Batchnorm in PyTorch and MXNet the same? My test shows that the norm of the difference of the outputs from a PyTorch’s Batchnorm layer and a MXNet’s Batchnorm layer is about 0.2. Is that normal? Is it possible to make them the same?