I am not using transfer learning and there is 2k image in training set while there are 20 classes. Can it also result from not enough data ? Maybe if there are more data, model will see more present ones etc…