Solved by ptrblck in post #4 
              
              
                You are storing the computation graph using this line of code: 
running_loss += loss

Change it to running_loss += loss.item() and try it again.