readme: ---
  language:
  - ne
  - en
  - multilingual
  license: mit
  tags:
  - codeswitching
  - nepali-english
  - language-identification
  datasets:
  - lince
  ---
  
  # codeswitch-nepeng-lid-lince
  This is a pretrained model for **language identification** of `nepali-english` code-mixed data used from [LinCE](https://ritual.uh.edu/lince/home).
  
  This model is trained for this below repository. 
  
  [https://github.com/sagorbrur/codeswitch](https://github.com/sagorbrur/codeswitch)
  
  To install codeswitch:
  
  ```
  pip install codeswitch
  ```
  
  ## Identify Language
  
  * **Method-1**
  
  ```py
  
  from transformers import AutoTokenizer, AutoModelForTokenClassification, pipeline
  
  tokenizer = AutoTokenizer.from_pretrained("sagorsarker/codeswitch-nepeng-lid-lince")
  
  model = AutoModelForTokenClassification.from_pretrained("sagorsarker/codeswitch-nepeng-lid-lince")
  lid_model = pipeline('ner', model=model, tokenizer=tokenizer)
  
  lid_model("put any nepali english code-mixed sentence")
  
  ```
  
  * **Method-2**
  
  ```py
  from codeswitch.codeswitch import LanguageIdentification
  lid = LanguageIdentification('nep-eng') 
  text = "" # your code-mixed sentence 
  result = lid.identify(text)
  print(result)
  
  ```
  
  