Hi, is there any interactive way to debugin distributed launch?
In pytorch 0.4.1, I use pdb in dataparallel, however, it seems that distributed launch would split the process into multiple copies. When I type sth in pdb, my input would also be split to different copies of processes, that’s not what I expected.
So I’m wondering if there is any method that can help me do interactive debugging in distributed launch?