Netflix Conductor: Open-source workflow orchestration engine
For better or worse, we ended up creating our own workflow engine at my company. Unfortunately, everyone who ends up using it hates it. We&#x27;ve also run into the problem where the entire process of producing our end product is encoded in the workflow. Downstream steps depends on earlier steps etc. If any part of the process changes, managing this data becomes tough.<p>Additionally, we have software engineers writing these workflows. Ideally we would have tooling so that those who know the process can write these things. The difficulty we have had though is making it easy to join&#x2F;match up earlier parts of the process with later steps. We do this now by keeping a lot of data in the workflow and by occasionally persisting data in other places. Software engineers, not the process people, are the ones who understand the data model and how to munge everything together.<p>Have others dealt with this issue?