Transformers, Deep Learning, Machine Learning, Editors Pick, Data Science.
of tokens; a set of integers that represent our input. As transformers were first applied in the NLP domain, let’s consider this scenario first. The simplest way to convert a sentence into a series of tokens is to define a vocabulary which acts as a lookup table, mapping words to integers; we can