I like the direction Spark is heading. I am happy to see that they look at Spark in the same way compiler developers look at programming languages. There are huge optimizations to be made in this space. It&#x27;s insane how inefficient our current systems are when it is related to big-data processing.