Hi,
This is a known limitation of DDP I’m afraid. You can see the issue tracking this here: https://github.com/pytorch/pytorch/issues/24005 98
We are planning on getting to this after the 1.5 release.