Dear All,
I am training my network, I can figure out that I am not overfitting as the validation loss can still decrease as well as the training loss.
However, I see that after training for a while, the validation loss decreases slightly maybe every 11 -12 epochs, at some point I say that it will become steady, however, I can see that it still decreases but then it need long time ( 12 epoch) to decrease.
I wonder why it does not keep decreasing steadily as in the beginning of the epochs or even start to increase which means I started to overfit because then I can not decide on the number of epochs I should train for. Is that a problem with the optimizer learning rate, as I am not using a decayer for the learning rate and just keeping it fixed?
The plot of the validation loss looks like that

image525×514 23.2 KB