Thank you for your response! That makes sense to me overall but I am confused about some details.
Also I forgot to mention that my batch size is 1…
Did you mean that I am normalizing it with the Dataset length instead of the batch size? So should I have the following instead?
loss_values.append(running_loss/data.size(0))