Data Science, Python, Pandas.
for example hdf5 or a parquet file: dfd.groupby([‘article’, ‘coming_from’])\ .sum()\ .reset_index()\ .to_parquet(‘./summed_articles.parquet’, engine=’pyarrow’) So far so good. Step two is creating the filter table. That’s where the problems begin: at the time of writing this article, Dask