In case you are interested in finding the mean/max/sum embedding of each row of embeddings (that can be of varying lengths) an EmbeddingBag may give you what you want.
https://pytorch.org/docs/stable/generated/torch.nn.EmbeddingBag.html 8