Sounds reasonable. Yes the pretrained model has batch norm layer . This raises me a new question . If I want to train a new dataset with these pretrained model weights then do i need to freeze the batch norm layers after loading the pretrained model weights into my model ?