You may want some more infos here:

  
    
    
    Segfault using cuda with openmpi 
  
  
    Hi there ! 
I am following the tutorial for writing distributed applications. 
Here is the basic example code. Everything works well as long as I don’t try using cuda. 
Is there a specific step to enable it that I missed ? I am getting a segfault… 
It might also be linked with some kind of permission issue since the signal code is “Invalid Permissions”. 
Any help would be really appreciated ! 
import os
import torch
import torch.distributed as dist
import platform


def run(rank, size):
    tens…