Got it! the model that i had was trained with affine=true and thats why it has running_mean and running_var, and apparently requires_grad =False wont work to make it not trainable (or at least it didnot work for me) so I had to make them to be in eval mod