Hi all,
I am training a network that perform depth estimation. My training loss/epoch curve is decreasing smoothly but my validation loss and error / epoch curves although are decreasing but is like a roller coaster ride. I am just wondering if this phenomenon normal? I can’t really seem to find a good answer elsewhere to decided to ask here.
Thank you.
More info:
Learning rate started with 0.001 and is decayed by 0.0003 after every 10 epochs.
Total epochs: 30
Batch Size: 16