lucastononrodrigues:

so if I just separate the folders of different classes with different names this should take care of it for me?


Yes, this should be the case.



 lucastononrodrigues:

Do you think that’s normal?


I would recommend to scale down the problem a bit and maybe just use two classes with 5 samples each. Once you’ve created this dummy dataset, try to overfit your model so that you reach ~100% accuracy by changing the learning rate etc.
If that’s not possible, there might be a bug in your code somewhere or the model architecture is “bad”, but I doubt the second point as VGG and ResNet models are heavily used.