I have a simple fully connected NN that I tested with:
CIFAR10,
FashionMNIST,
MNIST and
Cat vs. non Cat datasets.
For all the 4 datasets I observe normal behavior in the accuracy, namely, train accuracy is higher than test acc. But, for two cases of MNIST, I get about 1 % higher accuracy for test than for train (90% train acc. and 91%test acc.). This was when running 500 epochs.
I thought to reduce the number of epochs to 300 and see what happened, and the results were then: 90% train acc. and 89% test acc.
How to interpret this?