Data parallel is such a fundamental module. Frankly speaking, I can’t imagine JIT is not compatible with it and no official programmer have tested it. It makes the JIT totally unpractical for training (except toy models)

  
      github.com/pytorch/pytorch
  
  
    



Issue: JIT is not compatible with data parallel 24


	
	opened by daquexian
	on 2018-12-20
	
	
	


🐛 Bug
JIT is not compatible with data parallel. So no one can train any model using more than one GPU.
To Reproduce
Steps...


 	jit