i want to add or take the mean of the embedded vectors after this
self.embeddings = nn.Embedding(vocab_size, embedding_dim)
OR add a linear transformation to every embedded vector (with shared weights of course).