Just fyi, a library openstack (and myself and others) has created (in python) basically lets u program your workflow (really dataflow) as a DAG, and then the library will run it reliably (and in parallel and so-on). I&#x27;m more than willing to answer questions about how it does that if people are interested...<p><a href="http:&#x2F;&#x2F;docs.openstack.org&#x2F;developer&#x2F;taskflow&#x2F;" rel="nofollow">http:&#x2F;&#x2F;docs.openstack.org&#x2F;developer&#x2F;taskflow&#x2F;</a><p><a href="https:&#x2F;&#x2F;pypi.python.org&#x2F;pypi&#x2F;taskflow" rel="nofollow">https:&#x2F;&#x2F;pypi.python.org&#x2F;pypi&#x2F;taskflow</a><p>And yes u can do things like built equation solvers to:<p><a href="http:&#x2F;&#x2F;docs.openstack.org&#x2F;developer&#x2F;taskflow&#x2F;examples.html#linear-equation-solver-in-parallel" rel="nofollow">http:&#x2F;&#x2F;docs.openstack.org&#x2F;developer&#x2F;taskflow&#x2F;examples.html#l...</a><p>And other neat things:<p><a href="http:&#x2F;&#x2F;docs.openstack.org&#x2F;developer&#x2F;taskflow&#x2F;#examples" rel="nofollow">http:&#x2F;&#x2F;docs.openstack.org&#x2F;developer&#x2F;taskflow&#x2F;#examples</a>