@Abhilash_Srivastava @ptrblck
Still facing the same error:
I do not see any online example where we wrap the transformer model with DDP.
Transformer mode:

  
      pytorch.org
  
  
    

Sequence-to-Sequence Modeling with nn.Transformer and TorchText — PyTorch...