Hi,
It means that if the nn.BatchNorm layers were created using affine=False, theirs weight and bias ( beta and gamma ) will not update and as not trainable parameters, right? Dose afine=False equal to requires_grad=False or torch.no_grad()?
And mode.eval() is for setting nn.BatchNorm layers do not update the running estimates.
If I am wrong, please correct me.
Thanks in advance.