My loss function has weird spikes in it that keep on decreasing. I do not understand what inference should I make from this.
This is the plot (zoomed in on y-axis)
new9000×3500 1.01 MB
and the follwing is the original loss plot
new19000×3500 499 KB
I am using a U-Net architecture to train data of the shape (batch_size, 3, 32, 32, 32).