I think this is for three main reasons:<p>1. You can do really well with a simple grammar<p>2. You only need short output<p>3. Lack of training data<p>There&#x27;s not an incredibly rich structure to extract, and with short outputs the weirdness doesn&#x27;t compound and cycles aren&#x27;t as likely. A common <i>small</i> dataset for playing with RNNs is all of Shakespeare which is somewhere in the region of 1M words.<p>However, this is still fun and interesting!