Deep Learning, Artificial Intelligence, NLP, Language Model, Nce.
Skip-gram trained on four times as much data using 75 times as many CPU cycles. Results for various models trained for 20 epochs on the 47M-word Gutenberg dataset using NCE5 with AdaGrad ((D) and (I) denote models with and without position-dependent weights respectively) Surprisingly, the results