But what if I already have a large tensor  data  in hand and would like to split and distribute it and get the same output as the above snippet

It really depends on where this large tensor is stored and how it is loaded. Is this large tensor stored in memory of one of the nodes? It might be helpful if you describe your system a bit more in detail and especially how the large tensor is computed/retrieved.