Hi,
My best guess here would be that you compute all the forward and losses first, then you do a serie of backward/step for each loss one after the other?
The problem is that the step function modifies the parameters of your net inplace, but these values are needed to run the backward (by conv for example).
You want to make sure that you don’t do a step operation between the forward and the backward.