Thank you so much for your valuable feedback.
Would you consider then LRReduceOnPlateau and EarlyStopping as regularization as this blog “Prevent Overfitting of Neural Networks - 1” is doing?
Thank you!