A weight of ~1 and bias of ~0 in nn.BatchNorm will pass the normalized activations to the next layer.
In your example the weight is sampled from a normal distribution with a small stddev which is approx. 1.
It’s a valid strategy to init BatchNorm layers and is also discussed here 178.