Solved by ptrblck in post #8 
              
              
                How did you increase the input tensor? 
Could you check its min and max values and compare it to the shape of the embedding matrix?