Dask, Big Data, Data Science, Performance, Python.
P2P shuffling algorithm that was introduced earlier this year and now Dask-expr improves the performance of Dask a lot. These queries only capture a small part of the Dask DataFrame API but are helpful to compare performance. The full implementation of all queries is available here. A single