That makes sense! Thanks for your reply.
So, is there currently a way to efficiently compute the gradients for some coordinates only ? I was thinking of using Pytorch for coordinate descent algorithms.
On another note, when you said that the full gradient is computed anyways, does that mean that when I apply operations on a Variable (with requires_grad=True) the gradient gets computed as well ? doesn’t it get computed when I call .backwards() ? or when I run torch.autograd.grad on the full input Variable?
Cheers!