Data Science, Machine Learning.
with such large datasets, on a single host (my laptop runs that easily, in a few seconds). However, multiplying the matrices is where the real challenge is. Local multiplication doesn’t scale Let’s assume we have 1M (10⁶) names in each list. Each matrix then would be about the order of 10⁶ x 10⁶