Machine Learning, Naturallanguageprocessing, Artificial Intelligence, NLP, AI.
operation as it involves a summation of scores over all the words in our vocabulary for normalizing. The softmax function. So for each training sample, we are performing an expensive operation to calculate the probability for words whose weight might not even be updated or be updated so marginally