By the way, I tried a different normalization method and seems that the model is nor more predicting one class per batch
However, still no significant improvement in accuracy and it seems the loss stops reducing after it has reached 0.69