Thanks. yes, it solves the optimizer’s parameters problem.
I still wonder, when I add a new nn.Module in my main network forward function, need I use nn.add_module(new_module) to append the new module to my main module or not?
What does nn.add_module use for?