embeddings (preserved during fine-tuning) and bigger output embeddings (discarded at fine-tuning). The tokenizer is
also similar to the Albert one rather than the BERT one.
RemBertConfig
[[autodoc]] RemBertConfig
RemBertTokenizer
[[autodoc]] RemBertTokenizer
    - build_inputs_with_special_tokens
    - get_special_tokens_mask
    - create_token_type_ids_from_sequences
    - save_vocabulary
RemBertTokenizerFast
[[autodoc]] RemBertTokenizerFast
    - build_inputs_with_special_tokens
    - get_special_tokens_mask
    - create_token_type_ids_from_sequences
    - save_vocabulary
RemBertModel
[[autodoc]] RemBertModel
    - forward
RemBertForCausalLM
[[autodoc]] RemBertForCausalLM
    - forward
RemBertForMaskedLM
[[autodoc]] RemBertForMaskedLM
    - forward
RemBertForSequenceClassification
[[autodoc]] RemBertForSequenceClassification
