Solved by ptrblck in post #2 
              
              
                If padding_idx is set, the output tensor will contain all zeros at the position, where the input tensor had the padding_idx. 
You could use it to ignore specific inputs without the need to remove these index from your input tensor.