Just to confirm, if they have not been backpropagated to (since the previous optimizer step), then .grad=None, not zero?
Edit: Never mind, it looks like using zero_grad does set the .grad to zero, so something else would need to be done to ignore those variables.