readme: ---
  language:
  - en
  - hi
  - bn
  - ta
  - as
  - gu
  - kn
  - ks
  - ml
  - mr
  - ne
  - or
  - pa
  - sa
  - sd
  - te
  - ur
  license: apache-2.0
  ---
  
  ## MuRIL - Unofficial
  
  Multilingual Representations for Indian Languages : Google open sourced
  this BERT model pre-trained on 17 Indian languages, and their transliterated
  counterparts.
  
  The model was trained using a self-supervised masked language modeling task. We do whole word masking with a maximum of 80 predictions. The model was trained for 1000K steps, with a batch size of 4096, and a max sequence length of 512.
  
  Original model on TFHub: https://tfhub.dev/google/MuRIL/1
  
  *Official release now on HuggingFace (March 2021)* https://huggingface.co/google/muril-base-cased
  
  License: Apache 2.0
  
  ### About this upload
  
  I ported the TFHub .pb model to .h5 and then pytorch_model.bin for
  compatibility with Transformers.
  