lib/python3.6/site-packages/torch/nn/parallel/_functions.py you are getting assertion error as the values inside inputs tuple i.e. i.is_cuda are not loaded to GPUs.
Solution- inputs=tuple(map(lambda i: i.cuda(), inputs)) will load all the values inside inputs to the default GPU.