Solved by KFrank in post #2 
              
              
                Hi Wei! 

Your list_of_loss keeps growing with every iteration of the loops 
over num_epochs and train_loader. 
Therefore you keep calling list_of_loss[0].backward() on the 
same loss over and over again that was created for the first sample 
in your first epoch. 
Put another way, the newly appended…