Dask, Big Data, Data Science, Performance, Python.
sufficient to compute the results, which is the same number of workers as we used for the 100GB benchmarks. The original version needed a bigger cluster with 50 workers and with 32GB memory each. Some queries didn’t complete the original version at all, because there were memory spikes on single