I was hoping to start using the SWA implementation in torchcontrib.  Two questions:

Does it matter if swa.bn_update is before or after opt.swap_swa_sgd?
If we want to save checkpoints, do we need to execute the update functions above?