They claimed to be &quot;the only public toolkit that can scale beyond single machine&quot;. Well, mxnet (<a href="https:&#x2F;&#x2F;github.com&#x2F;dmlc&#x2F;mxnet" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;dmlc&#x2F;mxnet</a>) can scale across multiple CPUs and GPUs.