Spotifier here. This is an important point. I have nothing bad to say about Cloudera or HWX (disclaimer: we&#x27;re an HWX customer - we&#x27;ve had a pretty good experience), but I don&#x27;t really see a compelling reason at this stage to manage your own cluster(s) (HIPAA&#x2F;regulatory constraints, maybe?)<p>Getting shared-storage and indepedently operated&#x2F;scaled compute clusters on top of that storage isn&#x27;t easily achievable with the standard Hadoop stack, and building that on top of HDFS is non-trivial.