What are the usage of padding_idx for nn.Embedding? It seems that the vector at padding_idx will be initialized as zeros. Also this vector is not trained. But when is it used for padding?
What happens when we do not set a padding_idx?
What happens when we do not set a padding_idx but still have  at the beginning of the vocab?