Created an issue in openmpi repo.

  
      github.com/open-mpi/ompi
  
  
    
  
	  
  

  
    
      synchronize cuda-aware mpi streams 1
    

    
      
        opened 
        
          
        
        May 13, 2020
      
      


      
        
          
          saareliad
        
      
    
  



  Background information

v4.0.3

installed from source (tar)

cuda aware mpi

cuda 10.2

This is not a system problem, but suspected behavior/implementation issue in cuda-aware MPI. it...





  
  
    
    
  
  


@mrshenli As far as I know,  MPI doesn’t support what you suggest so better ask them directly?