I think what you did should be basically fine. When a pretrained model is used as a feature extractor, you should always use the moving mean/var because the model is considered fixed. You should also make sure that your input data is normalized to similar input distribution that the pretrained model is trained with.