Thank you for your answer  I did follow the tutorial. I use the torch.distributed.launch 1 utility that takes care of creating one process per GPU. I am using it on one machine with two GPUs.
It is true that I put my two models in the same (default) process group, but I also tried to use different process groups for both models and it did not change anything.