One solution might be

create a shared memory buffer using MPI
create a numpy ndarray from that shared memory (example 10)
create a PyTorch tensor from that numpy ndarray (example 7)

The numpy ndarray and the tensor should then share the same storage, which is on the shared memory.