seems to be exactly what you want
optimizer.add_param_group 131
e.g.
optimizer.add_param_group({'param':new_module.parameters() })




 dragen:

I have a network, which will expand its network structure, (let’s say, deepen its layers when forwarding).


Be careful.