Deep Learning, Artificial Intelligence, Neural Networks, Word Prediction, Language Model.
errors with respect to CPU time The figure shows that the convergence of both networks is similar. The same holds for validation and test errors. The network trained by sampling converges to an even lower perplexity than the ordinary one (trained with the exact gradient). After 9 epochs (26h), its