Yes, instead of one word I want to be able to represent a weighted average of two words in a single “hybrid word” if you will. As I said, I’m looking for a way that does not change any other function that is applied at the lowest level of the model for embedding (the positional encoding, etc.)