I don’t think you have to replace the FrozenBatchNorm2d layers and could try to add the missing eps attribute directly to the already used layers.
If I understand your issue correctly, the error is only raised in the forward pass when the eps attribute is used, not while loading the state_dict. If so, then adding the eps before executing the forward pass might work.