padding_idx is just a specific index in the weight matrix. So there is no mechanism of separation.
After you change the weights, you have to reset the index of padding_idx to zeros, i.e.:
embed.weight.data[4] = 0