Hello,
From what I see from your code, you always pass all networks parameters to the Adam optimizer, regardless requires_grad value of each of them.
I thought I had to pass to the optimiser only the trainable ones. This is incorrect, right?
Thanks for helping