Hi, I have a network, which will expand its network structure, (let’s say, deepen its layers when forwarding).
However, my optimizer is initilialzed by optimizer = nn.SGD(net.parameters(), lr=1e-3) in initialization time, which means the parameters is different from the acutal parameters when the network expand its depth. Therefore, I want to ask, is it possible to update my newly added parameters to optimizer, to make it aware of the  newly added parameters, so that the optimizer can optimize these newly added parameters.
Thanks