This page outlines that the multiprocessing module can be used with CUDA:
http://pytorch.org/docs/master/notes/multiprocessing.html 736
However CUDA generally has issues running multiple processes in paralell on one GPU:

  
      stackoverflow.com
  
  
      
    
  

  Running more than one CUDA applications on one GPU 467



  cuda, gpu, gpgpu, nvidia



  asked by
  
  
    cache
  
  on 12:55AM - 27 Jul 15


  
  
    
    
  
  


Do these limitations apply to the pytorch multiprocessing module?
Thanks in advance