IMO no it wasn&#x27;t.  Ring reductions are the sort of things the MPI guys had a decade ago.  This is (once again IMO) the sort of thing that happens when one doesn&#x27;t do lit searches and then Juergen Schmidhuber has a temper tantrum when we all find out one of his students probably has a good claim to have previously invented something supposedly new.<p>My heuristic whenever I think I&#x27;ve invented something is to aggressively exploit Google to prove me wrong.  It usually does so, but sometimes in very unusual ways.  Glad to hear about Torch though.  Do they have automagic model parallelization (not data parallelization) as well?