i built pytorch as your instruction succesfully, but when i use it. some error happened.
error:
pml_ucx.c:226 Error: UCP worker does not support MPI_THREAD_MULTIPLE
test code:
import torch
import torch.distributed as dist
dist.init_process_group(backend=‘mpi’)
t = torch.zeros(5,5).fill_(dist.get_rank()).cuda()
dist.all_reduce(t)