study.
Tips:
DistilBERT doesn't have token_type_ids, you don't need to indicate which token belongs to which segment. Just
  separate your segments with the separation token tokenizer.sep_token (or [SEP]).
DistilBERT doesn't have options to select the input positions (position_ids input). This could be added if
  necessary though, just let us know if you need this option.
This model was contributed by victorsanh. This model jax version was
contributed by kamalkraj. The original code can be found here.
DistilBertConfig
[[autodoc]] DistilBertConfig
DistilBertTokenizer
[[autodoc]] DistilBertTokenizer
DistilBertTokenizerFast
[[autodoc]] DistilBertTokenizerFast
DistilBertModel
[[autodoc]] DistilBertModel
    - forward
DistilBertForMaskedLM
[[autodoc]] DistilBertForMaskedLM
    - forward
DistilBertForSequenceClassification
