readme: ---
  license: apache-2.0
  tags:
  - generated_from_keras_callback
  model-index:
  - name: bert-cola
    results: []
  datasets:
  - loulely/glue_cola_processed
  language:
  - en
  library_name: transformers
  pipeline_tag: text-classification
  ---
  
  <!-- This model card has been generated automatically according to the information Keras had access to. You should
  probably proofread and complete it, then remove this comment. -->
  
  # BERT-COLA
  
  It achieves the following results on the evaluation set:
  - Train Loss: 0.0140
  - Validation Loss: 1.0911
  - Epoch: 19
  - LABEL 1: Acceptable English
  - LABEL 0: Unacceptable English
  
  ## Model description
  
  This model uses BERT Architecture for __Text-Classfication__ & is trained on __COLA__ dataset 
  
  ### Inference
  ```python
  from transformers import AutoTokenizer, AutoModelForMaskedLM, pipeline
  
  tokenizer = AutoTokenizer.from_pretrained("SRDdev/BERT-COLA")
  
  model = AutoModelForMaskedLM.from_pretrained("SRDdev/BERT-COLA")
  
  classifier = pipeline('text-classification', model=model, tokenizer=tokenizer)
  ```
  
  ```python
  classifier("Go to your room")
  ```
  
  ### Framework versions
  
  - Transformers 4.25.1
  - TensorFlow 2.9.2
  - Datasets 2.8.0
  - Tokenizers 0.13.2
  
  ### Citation
  ```
  Name : Shreyas Dixit
  framework : Pytorch
  Year: Jan 2023
  Pipeline : fill-mask
  Github : https://github.com/SRDdev
  LinkedIn : https://www.linkedin.com/in/srddev/ 
  ```