If you want to simply use the pretrained model on your images (although that would imply having the ImageNet classes as output), then normalize your images with the ImageNet stats.
However, if you want to finetune a pretrained model using your images as training data, then I think it is best to normalize using your stats.
I have had experience with large differences between two datasets, which had enormous impact, but I don’t know about very small differences.