Hi,
The batchnorm in pytorch takes a  momentum parameter as well so you can do the same thing (doc here 42).
For the initialization, you can initialize the .weight and .bias of the batchnorm as you want.