Are you sure there are no buffers in your module? If that is the case it is surprising that you’re seeing a speedup because this synchronization would be a noop (there are no buffers to synchronize).
Can you confirm this by checking the self.named_buffers() attr of your nn.Module you’re passing into ddp?