Hi,
Assuming no gradients were computed for them before and their .grad field is None to begin with. Then the optimizer will just ignore them because they don’t have any gradient (as the backward won’t populate them).