So I am kinda new to this but to the extend of my knowledge there might be multiple ways to go about it:


Create word embeddings that contain the POS tag. i.e. pass the corpus to a POS tagger and feed a concatenation of the word and the pos tag as input to whatever method you use to produce word embeddings.


Concatenate the word embeddings vector with another vector containing custom added features (such as POS tags)


Create new word embeddings by having a dot product of the vector of the word embeddings and a vector containing other arbitrary features