  translation).
NLP: natural language processing, a generic way to say "deal with texts".
NLU: natural language understanding, all tasks related to understanding what is in a text (for instance classifying
  the whole text, individual words).
pretrained model: a model that has been pretrained on some data (for instance all of Wikipedia). Pretraining methods
  involve a self-supervised objective, which can be reading the text and trying to predict the next word (see CLM) or
  masking some words and trying to predict them (see MLM).
RNN: recurrent neural network, a type of model that uses a loop over a layer to process texts.
self-attention: each element of the input finds out which other elements of the input they should attend to.
seq2seq or sequence-to-sequence: models that generate a new sequence from an input, like translation models, or
