Machine Learning, Mpi, Pytorch, TensorFlow.
examples: PyTorch, mpi4py, TensorFlow (in progress) Instead of having one machine you now have n identical copies, how do you make use of them? The simplest way is to run identical script on each machine and have some commands that let the process communicate with its clones. In practice this can