What is finetuning?
You should use the normalization technique that has been used for the training. Since ImageNet pretrained models used the ImageNet stats, you should use that if you plan to use a model that has been trained on ImageNet.
If finetuning means you alter the number of classes for the classification model, or you are using some semantic segmentation on an ImageNet pretrained backbone, then you should still use this ImageNet stats.