Solved by mbednarski in post #2 
              
              
                I’ll try to help  
I am starting with multinomial (as it is a more straightforward part). 
When you have a trained language model, you need to have a strategy of sampling new sentences. The easiest way is to get a token with maximum likelihood - I assume that you already did it with max(). But this …