Machine Learning, Mpi, Pytorch, TensorFlow.
Express your result in a computation graph. Partition it across machines manually. To go further, one might automate this process and break computation across machines automatically. This is an active research area, one example is Mesh Tensorflow. Typically the user partitions computation graph