Machine Learning, Naturallanguageprocessing, Artificial Intelligence, NLP, AI.
of co-occurrence. We sample the random words based on their frequency of occurrence. P(w) = U(w) raised to the 3/4 power, where U(w) is a unigram distribution. The 3/4 power makes less frequent words be sampled more often, without it probability of sampling frequent words such as “the”, “is” etc