Hi everyone, I met this situation and get the confusion. I have some questions to ask for your help?


The validation loss is increasing when validation accuracy is increasing, too. So, the best model should be the lowest loss or highest accuracy?


If we choose the highest accuracy as the best model, then if we look at the losses, easy to see the overfitting scenarios (low training loss and high validation loss).


If we choose the lowest loss as the best model. Why sometimes the loss is high with the accuracy, it seems like have true predict but low confidence (aka. probability, I use cross-entropy loss). Then, is the high confidence is always good?



image.png803×684 46.7 KB