  relative position bias among the several self-attention layers. During fine-tuning, each layer's relative position
  bias is initialized with the shared relative position bias obtained after pre-training. Note that, if one wants to
  pre-train a model from scratch, one needs to either set the use_relative_position_bias or the
  use_relative_position_bias attribute of [BeitConfig] to True in order to add
  position embeddings.
This model was contributed by nielsr. The JAX/FLAX version of this model was
contributed by kamalkraj. The original code can be found here.
BEiT specific outputs
[[autodoc]] models.beit.modeling_beit.BeitModelOutputWithPooling
[[autodoc]] models.beit.modeling_flax_beit.FlaxBeitModelOutputWithPooling
BeitConfig
[[autodoc]] BeitConfig
BeitFeatureExtractor
[[autodoc]] BeitFeatureExtractor
