@hkz I tested this locally and the issue does seem to be in 1.8.0, but it seems like it should be resolved in 1.9.0 (by [Resubmit] Fix for incorrect usage of logging in torch/distributed/distributed_c10d.py by szmigacz · Pull Request #52757 · pytorch/pytorch · GitHub 3). I see the double log in 1.8.0, but not in 1.9.0. Can you double check you PyTorch install using `python -c ‘import torch; print(torch.version)’?