Solved by ptrblck in post #7 
              
              
                No, if your current model and training routine cannot overfit the small dataset, then there might be some other issues in the code or the model is not suitable for this use case and you would need to modify its architecture.