NLP, Interpretability, Machine Learning, Pytorch, Captum.
'!', '!', '[SEP]'] And then to: [1, 76, 8459, 7923, 8332, 30, 30, 2] Then, those indexes are mapped to vectors in the embedding layer, the positional embeddings are added on top of that. This sequence of vectors is then fed to the transformer encoder. There is a really good tutorial about the