JunjieCheng:

/home/cjunjie/anaconda3/lib/python3.6/site-packages/torch/nn/parallel/_functions.py


One thing you could do in that function, right before the error, add a line to print the inputs (or run the python debugger).