Machine Learning, Deep Learning, Llm, NLP, Transformers.
extract several outputs from it. The model is able to produce different outputs from a single prompt due to different decoding strategies. Greedy method always outputs the word with the highest probability. Top-k method randomly chooses a word from a pool of k-words with the highest probabilities.