Well, if your training method required more data than your dataset had and everything else worked, you would see the network reach very good accuracies on the training set and bad on the validation set.