  1024 tokens.
LED pads the input_ids to be a multiple of config.attention_window if required. Therefore a small speed-up is
  gained, when [LEDTokenizer] is used with the pad_to_multiple_of argument.
LED makes use of global attention by means of the global_attention_mask (see
  [LongformerModel]). For summarization, it is advised to put global attention only on the first
  <s> token. For question answering, it is advised to put global attention on all tokens of the question.
To fine-tune LED on all 16384, it is necessary to enable gradient checkpointing by executing
  model.gradient_checkpointing_enable().
A notebook showing how to evaluate LED, can be accessed here.
A notebook showing how to fine-tune LED, can be accessed here.
This model was contributed by patrickvonplaten.
LEDConfig
[[autodoc]] LEDConfig
