Yes, I understand it now, thank you. “EmbeddingBag” threw me off, but I see it is similar to having an Embedding layer (so it is of vocab size to index into) except that we can perform an aggregation over it.