ptrblck:

Otherwise I would try to figure out, why the author


Because I read this paper 5, they mentioned the total loss is combination loss (Eq.6)

Screenshot from 2019-02-21 17-01-46.png953×158 25.1 KB

And I guess it should be combined in one loss_total (loss) and call backward one time. Am I right?