Is there a way to change the initialization of batchnorm gammas of my model, in a way that works for both the affine=True and affine=False settings? For pytorch version >= 1.2.0 these are set to one, but I would like to change that.
The issue is that when affine=False the batchnorm gammas are set to None and it’s not clear if that’s okay to play with.