Off top of my head, here&#x27;s something with potential:<p>1. Filter out anything below 5 upvotes instantly.<p>2. Merge comments of duplicate OP&#x27;s into one super-post.<p>3. Provide Vivisimo-like tech to auto-categorize and search those. Nice picture of what that looked like in document below.<p><a href="https:&#x2F;&#x2F;faculty.ist.psu.edu&#x2F;jjansen&#x2F;academic&#x2F;pubs&#x2F;vivisimo_jansen.pdf" rel="nofollow">https:&#x2F;&#x2F;faculty.ist.psu.edu&#x2F;jjansen&#x2F;academic&#x2F;pubs&#x2F;vivisimo_j...</a><p>I imagine HN comments would have a ton of tags generated by such an approach. So, a straight-forward search engine for them could help too. Not a Big Data guy so I can&#x27;t do recommendations. However, this DARPA-funded, Watson alternative was open-sourced and might do interesting things for HN data:<p><a href="http:&#x2F;&#x2F;deepdive.stanford.edu&#x2F;" rel="nofollow">http:&#x2F;&#x2F;deepdive.stanford.edu&#x2F;</a>