Solved by tom in post #3 
              
              
                Yeah. 4. In other words, you take the probability vector for the categories and feed it into a Linear layer that has the embedding as weight.