Im also on a Windows system.  I was able to use dataparallel on my model without any apparent errors.  However, the performance was actually worse;  which makes me think that it’s not actually using multiple gpus.  Why am I able to use multiple gpus in tensorflow on a windows system, but not pytorch?  There must be some hack to get be able to do this.