getting sequence embeddings for pair of sentences
given [cls] word1 word2 word3 [sep] word1 word2 [sep]

If i get sequence embeddings, will word1 of sentence 1 will have context of word1 of sentence2?
Hi, yes.