I am training mulitple pretrained models from torchvision on my own dataset. The performance of two models have caught my attention. The first model has a normally decreasing training loss and a increasing accuracy but its validation loss decreases and then keeps on decreasing but giving a bit better validation accuracy than the second model, which has a decreasing training loss and a increasing accuracy(albeit much lower than first model’s) but has a decreasing validation loss and improving validation accuracy(but still lower than first models).
How do I go over choosing which model to work with further? Do I keep training for more epochs?