Hey @bornabesic,

Can you try if setting broadcast_buffers=False in DistributedDataParallel constructor works for you?
If not, can you try PyTorch v1.4?
If it still does not work, could you please provide code for minimum repro? Thanks!