I’m not sure, but wouldn’t expect that replacing batchnorm layers with GroupNorm once would work out of the box (I might be wrong, as I haven’t looked into it deeply). Also, I’m not aware of any (official) pretrained ImageNet models using GroupNorm so you might indeed need to train them from scratch.