/home/arul/miniconda3/envs/pth1.7/lib/python3.7/
site-packages/torch/nn/modules/container.py:645: 
UserWarning: nn.ParameterDict is being used with DataParallel but this is not supported. 
This dict will appear empty for the models replicated on each GPU except the original one.

It seems nn.ParameterDict is not supported with DataParallel.