Looks like you’ve got it right. I think it is because the loss function I use is a square function so if the beginning batches are hard batches the loss will be extremely high and vice versa for the easy batches. Also, my data is not balanced so maybe it causes the oscillation in the starting loss.