Dask, Big Data, Data Science, Performance, Python.
100GB of data, e.g. scale 100 for the TPC-H benchmarks. The cluster had 20 workers with 16GB each. Runtime on a per-query basis of Dask DataFrame (baseline) and Dask-expr (sample) We can see that Dask-expr performs better on every single query, up to a 3-times improvement compared to the status