Critical Behavior from Deep Dynamics: A Hidden Dimension in Natural Language
This seems like a very important paper, basically showing that Markov models with exponential decay of influence of tokens by distance are often a poor model, where as deep neural networks with LSTM (long short term memory) has power law decay of influence decay, which performs better for a variety of sequential data.<p>BTW, I went to the North American Association of Computational Linguistics conference in April and it seemed like half the papers used LSTM.<p>Edit: the NAACL 2016 papers are here: <a href="http://aclweb.org/anthology/N/N16/" rel="nofollow">http://aclweb.org/anthology/N/N16/</a>