These numbers are taken from the ImageNet dataset (info about pretrained models 17).
As these stats were used to pretraind the models, they should also work for finetuning.
However, if your dataset samples come from another domain (e.g. medical images), you would most likely want to use the stats from your training dataset.