Solved by jpeg729 in post #2 
              
              
                The embeddings are trainable, so if two dissimilar words get similar embeddings, then the embedding layer should learn to separate their embeddings.