Greetings,
I apologize for reviving this topic, it’s so close to my needs.
I want to change weights according to meta-information supplied with input images and I need intentionally to track these changes with Autograd.
I wonder if not using  torch.no_grad()  is enough for it, so if I don’t use anything can I be sure that the results will be backpropagated in the usual way, and the manual alteration is compatible with “normal” gradient flow (when weights are within nn module).