readme: ---
  language:
  - en
  - hi
  - multilingual
  tags:
  - generated_from_trainer
  licence: cc-by-sa-4.0
  ---
  
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
  should probably proofread and complete it, then remove this comment. -->
  
  
  # muril-en-hi-codemixed
  
   muril-en-hi-codemixed is a masked language model, based on the [MuRIL](https://huggingface.co/google/muril-base-cased) multilingual model.
  
  muril-en-hi-codemixed replaces the tokenizer, vocabulary and the embeddings layer of the MuRIL model. 
  The tokenizer and vocabulary used are the same as in the [roberta-en-hi-codemixed](https://huggingface.co/cjvt/roberta-en-hi-codemixed) model.
  The new embedding weights were initialized from the MuRIL embeddings.
  
  The new muril-en-hi-codemixed model was further pre-trained for two epochs on the same codemixed English and Hindi corpora
   as the [roberta-en-hi-codemixed](https://huggingface.co/cjvt/roberta-en-hi-codemixed) model.
  