Yes, multiplying a one-hot vector with the embedding matrix basically just makes a lookup.
I also assume(!) that nn.Embedding does backpropagation smarter since it knows which rows in the matrix can only be affected. But I don’t really know about the inner workings.