It sounds like you are describing accuracy, whereas confidence is closer to a measure of precision.  You can have class outputs with low confidence (relative to 1) but still have a highly accurate NN - so long as the correct output has a higher confidence relative to the other outputs (even if the difference is 0.0001).  If you&#x27;ve got 4 outputs and you&#x27;re getting results like {0,1,0,0}, then you should really make sure that you aren&#x27;t overfit - because that is the most obvious sign of overfitting.