If you set your nn.BatchNorm layers to eval() the running estimates won’t be updated anymore.
Additionally to filtering out the parameters, you could also set the .requires_grad attribute to False, so that the gradients won’t be computed if not necessary.