Hi,
I have a network  having two components (X, Y) which takes two inputs: A and B.
I wrap the network in data parallel. X returns full batch size output (how?) while Y returns 1/4th batch size output (this is expected).
Should I not nest subclasses of nn.Module while using Data parallel wrapper? Since, data parallel does support multiple inputs so this is unexpected (https://github.com/pytorch/pytorch/pull/794 8).
I even tried separating the X, Y modules and wrapping them in data parallel separately, I still get the same error.
Any hints on what might be wrong?