Machine Learning, Mpi, Pytorch, TensorFlow.
distributed TensorFlow programs one has to be aware which machines are hosting your clients, master and workers to avoid unexpected delays. Further reading: TensorFlow distributed concepts: client, master, worker Mesh Tensorflow: github Example of TensorFlow client vs master placement causing