Mxnet does. The commenter just left that part out. &quot;The library is portable and lightweight, and is ready scales to multiple GPUs, and multiple machines.&quot;
<a href="https:&#x2F;&#x2F;mxnet.readthedocs.org&#x2F;en&#x2F;latest&#x2F;distributed_training.html" rel="nofollow">https:&#x2F;&#x2F;mxnet.readthedocs.org&#x2F;en&#x2F;latest&#x2F;distributed_training...</a>