Google Cloud Platform, Data Engineering, Bigquery, Software Engineering, Data.
the MapReduce shuffle implementation. Due to limitations in the coupling architecture of compute nodes and the intermediate shuffle, they decided to take a different approach. The main idea is quite similar to that of storage: they aim to separate the shuffle layer. I have written a detailed