Unsupervised sentiment neuron
I don't know, but this seems a bit hyped in places.<p>They start with:<p>> Our L1-regularized model matches multichannel CNN performance with only 11 labeled examples, and state-of-the-art CT-LSTM Ensembles with 232 examples.<p>Hmm, that sounds pretty impressive. But then later you read:<p>> We first trained a multiplicative LSTM with 4,096 units on a corpus of 82 million Amazon reviews to predict the next character in a chunk of text. Training took one month across four NVIDIA Pascal GPUs<p>Wait, what? How did "232 examples" transform into "82 million"??<p>OK, I get it: they pretrained the network on the 82M reviews, and then trained the last layer to do the sentiment analysis. But you can't honestly claim that you did great with just 232 examples!