Yes your way should work without issue. nn.Embedding is just a lookup table on keys from a 2d indices tensor  If you really want to, you can think of your seq_len as batch_size and batch_size as #embeddings_to_extract _per_batch