A couple of months ago I processed all metadata from the Common Crawl project for all indexed domain names. This was about 10TB of metadata and resulted in 26 million domain names. EC2 costs were only about 10$ to process this. If anyone is interested, let me know.<p>edit: available as torrent here: <a href="https:&#x2F;&#x2F;all-certificates.s3.amazonaws.com&#x2F;domainnames.gz?torrent" rel="nofollow">https:&#x2F;&#x2F;all-certificates.s3.amazonaws.com&#x2F;domainnames.gz?tor...</a>