Full Reddit Submission Corpus now available for 2006 thru August 2015
This is not as cool as the comment dataset, but it's still pretty cool. I think in the future AIs will make extensive use of these kinds of datasets. It's amazing how much useful information is in there.<p>Last year I made a simple IRC question answering bot that just searched reddit for your question and returned the top comment of the top result. It worked surprisingly well. It's amazing how many questions someone else has asked on reddit before. And the comment quality is usually pretty good. Sample conversation with it: <a href="https://i.imgur.com/LDD9isL.jpg" rel="nofollow">https://i.imgur.com/LDD9isL.jpg</a><p>I improved on it a lot with a whitelist of subreddits and some machine learning to select the best thread. But I was only touching on what is possible with that data.<p>You can play with it here: <a href="https://kiwiirc.com/client/irc.snoonet.org/mybots" rel="nofollow">https://kiwiirc.com/client/irc.snoonet.org/mybots</a><p>EDIT: It does only work well with certain kinds of questions. Thing's that would have been asked before and without too many unique keywords. I see some people ask it really unique questions, or talk to it like a regular chatbot without even asking questions. And then get frustrated when it returns nonsense. There are a lot of improvements that could be made with this with natural language processing and stuff. But right now it's pretty simple.