I see, so if they are not being revealed in net.parameters() for sure, they are not receiving the gradients and won’t be trained? There are no cases where PyTorch might be giving them gradients in any weird way possible?
This would be my last question, sorry if I am being really specific. I do not have the time to check the source code.
Best
AB