This is more of theoretical question.
Consider the following example:
While training my model reaches the following stats:
40% accuracy on validation set and 60% accuracy on training set.
If i continue training the model, the accuracy on the validation slightly improves to 43% while the accuracy on the training set goes up to around 97%.
Should i stop the training on the first option? in other words, should i take the model that with the higher results although its seems like overfitted.
Thanks a lot.