I don’t understand the question at all. You want to use subnetworks to get some values without affecting backprop?
Whatever you run helps to build a computational graph which will be further backpropagated.
If you need to use subnetworks to obtain values not involved in backprop you can use the context manager with torch.no_grad()