Since you have BatchNorm layers in your model, I would think a batch size of one will perform worse than a larget batch size, because the running stats could be quite shaky. Apparently that’s not the case here.
Could you explain your dataset a bit? What kind of data do you have?
You could try to play around with the momentum in the BatchNorm layers a bit and see how your results for the large batch size change.