can you share the training/validation code?  I think you should compare train_one_epoch vs. evaluate, maybe there is some difference there
so the same size of images both for train and evaluate, right?
are there different transformations you use before training and before evaluation?