Machine Learning, Deep Learning, Naturallanguageprocessing.
such as question and answer, translation, paraphrasing, and others. It does this with segment embeddings. Again, see this article on why BERT has three layers WordPiece Embeddings: an unsupervised way of tokenising words that helps balance granularity and knowledge retention with out-of-vocabulary