hi @ptrblck,
Can you please explain a bit more about how the batch norm stats causing data leakage(when we shuffle the data on the validation set)?
My current model’s (validation)results have 20-25% difference if I change this single parameter(ie. shuffle=True to shuffle-False). Ideally, I shouldn’t shuffle the data on validation set but these results are quite deceptive.