That’s strange indeed. Are you using the same sample dimensions (in case you are resizing the inputs) or is there any other difference between the DataLoaders? If not, could you just swap the DataLoaders and see if the evaluation method would still fail while training works?