BN’s functional form has default training=False. You need training=True to let momentum have an effect.
Also, pay attention to the note under https://pytorch.org/docs/master/nn.html?highlight=batch_norm#torch.nn.BatchNorm2d 195 . A momentum of 0.9 is probably not what you want.