Okay. The dataset is well balanced. Like I said, you can check for annotations and input data correctness.
Also, I have not worked on efficient nets before. In general, 224x224 or 512x512 size should be good enough for image classification. You can also experiment with simple resnet50/densenet161 backbones to see if the network is learning or not.