Hi @abercher, curiosity got the better of me so I ran the above suggestion on IMDB and got an accuracy of 86.6% on the test set 
You can find the hacky code here 11 and it shouldn’t be too hard to adapt to your MLP classifier.