Yeah, I ended up asking a friend. Maybe the documentation needs to be clearer on this. And just to follow up, param.requires_grad=False will make the optimizer throw a fuss unless you explicitly set it to only optimize those parameters that require gradient.

  
      github.com/pytorch/pytorch
  
  
    



Issue: Allow optimizers to skip nn.Parameters that have requires_grad=False 72


	
	opened by alykhantejani
	on 2017-02-02
	
	
	closed by apaszke
	on 2017-02-03
	


I am trying to implement a gaussian blur as a convolution layer in a network, where the weights do not change....