Once training is done and SWA model is computed, how do you update the batchnorm statistics when using DDP ?
Do you still just use, torch.optim.swa_utils.update_bn(train_loader, swa_model) and the parameters are updated across different ranks?