Hello, Am I able to do backpropagation of one single loss with two optimizer at the same time?
E.g.
Loss = Loss 1 * (Adam_w) + Loss 2 * (SGD_w)
Loss.backward()
Adam_optimizer.step()
SGD_optimizer.step()
Is this possible? How to make this work?
Thanks a lot for any answer.