thanks for replying, i will take your valuable suggestions.
As model.parameters() will give all the parameters. But along with it I need one more optimizer which will update the these parameters along with the new one.
opt1 = optim.Adam(model.parameters(), lr=1e-4)
opt2= optim.Adam(other_loss, lr=1e-5)