I was just exploring gradients of all variables, and was a little unsure about what’s usual behavior. But you’re right I should be looking at input_variable.grad, I’ll look into that and get back if something looks out of place. Thanks!