Critical Behavior from Deep Dynamics: A Hidden Dimension in Natural Language
This seems like a very important paper, basically showing that Markov models with exponential decay of influence of tokens by distance are often a poor model, where as deep neural networks with LSTM (long short term memory) has power law decay of influence decay, which performs better for a variety of sequential data.BTW, I went to the North American Association of Computational Linguistics conference in April and it seemed like half the papers used LSTM.Edit: the NAACL 2016 papers are here: http://aclweb.org/anthology/N/N16/