Deep Learning, Artificial Intelligence, NLP, Language Model, Nce.
paper. By using NCE, the summation originated at the denominator of the Softmax function can be skipped. Because NCE is an unnormalized model. NCE training time linear in the number of noise samples and independent of the vocabulary size. As we increase the number of noise samples k, this estimate