No, the weight row will be initialized as all zeros and won’t get any gradients as seen here:
emb = nn.Embedding(10, 5, padding_idx=0)
x = torch.arange(10).view(1, -1)
out = emb(x)
out.mean().backward()
print(emb.weight)
print(emb.weight.grad)