readme: ---
  tags:
  - generated_from_trainer
  widget:
  - text: "Tachycardia is an increased heart rate for any reason. It can be a usual rise in heart rate caused by exercise or a stress response. Sinus tachycardia is considered a symptom, not a disease."
    example_title: "Tachycardia"
  - text: "Tuberculosis is a potentially serious infectious disease that mainly affects the lungs. Signs and symptoms of active TB include: Fatigue, Fever, Night sweats, Chills, Loss of appetite. Blood tests can confirm or rule out latent or active tuberculosis. The most common medications used to treat tuberculosis include: Isoniazid, Rifampin (Rifadin, Rimactane), Ethambutol (Myambutol), Pyrazinamide."
    example_title: "Tuberculosis"
  - text: "Cholera is a bacterial disease usually spread through contaminated water. A bacterium called Vibrio cholerae causes cholera infection. Symptoms of cholera infection can include: Diarrhea, Nausea, vomiting, Dehydration. Risk factors for cholera include: Poor sanitary conditions, Household exposure, Type O blood, Raw or undercooked shellfish."
    example_title: "Cholera"
  metrics:
  - precision
  - recall
  - f1
  - accuracy
  model-index:
  - name: xlm-roberta-base
    results: []
  language:
  - en
  ---
  
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
  should probably proofread and complete it, then remove this comment. -->
  
  # xlm-roberta-base
  
  This model is a fine-tuned version of [xlm-roberta-base](https://huggingface.co/xlm-roberta-base) on the Custom Disease dataset (CoNLL2003 format).
  It achieves the following results on the evaluation set:
  - Loss: 0.6290
  - Precision: 0.5096
  - Recall: 0.6524
  - F1: 0.5722
  - Accuracy: 0.8215
  
  ## Model description
  
  More information needed
  
  ## Intended uses & limitations
  
  More information needed
  
  ## Training and evaluation data
  
  More information needed
  
  ## Training procedure
  
  ### Training hyperparameters
  
  The following hyperparameters were used during training:
  - learning_rate: 1e-05
  - train_batch_size: 8
  - eval_batch_size: 8
  - seed: 42
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  - lr_scheduler_type: linear
  - num_epochs: 15
  
  ### Training results
  
  | Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1     | Accuracy |
  |:-------------:|:-----:|:----:|:---------------:|:---------:|:------:|:------:|:--------:|
  | No log        | 1.0   | 180  | 0.6487          | 0.5010    | 0.6461 | 0.5644 | 0.8203   |
  | No log        | 2.0   | 360  | 0.6290          | 0.5096    | 0.6524 | 0.5722 | 0.8215   |
  | 0.2306        | 3.0   | 540  | 0.6687          | 0.4801    | 0.6673 | 0.5584 | 0.8136   |
  | 0.2306        | 4.0   | 720  | 0.6750          | 0.4965    | 0.6579 | 0.5659 | 0.8144   |
  | 0.2306        | 5.0   | 900  | 0.6768          | 0.5148    | 0.6534 | 0.5759 | 0.8189   |
  | 0.1853        | 6.0   | 1080 | 0.7240          | 0.4958    | 0.6647 | 0.5680 | 0.8123   |
  | 0.1853        | 7.0   | 1260 | 0.7443          | 0.4811    | 0.6589 | 0.5562 | 0.8120   |
  | 0.1853        | 8.0   | 1440 | 0.7572          | 0.4772    | 0.6559 | 0.5525 | 0.8120   |
  | 0.1485        | 9.0   | 1620 | 0.7771          | 0.4906    | 0.6607 | 0.5631 | 0.8106   |
  | 0.1485        | 10.0  | 1800 | 0.7696          | 0.4901    | 0.6612 | 0.5629 | 0.8158   |
  | 0.1485        | 11.0  | 1980 | 0.7867          | 0.4876    | 0.6660 | 0.5630 | 0.8130   |
  | 0.1267        | 12.0  | 2160 | 0.8068          | 0.4788    | 0.6678 | 0.5577 | 0.8111   |
  | 0.1267        | 13.0  | 2340 | 0.8059          | 0.4896    | 0.6645 | 0.5638 | 0.8144   |
  | 0.1098        | 14.0  | 2520 | 0.8151          | 0.4904    | 0.6625 | 0.5636 | 0.8127   |
  | 0.1098        | 15.0  | 2700 | 0.8202          | 0.4820    | 0.6660 | 0.5592 | 0.8115   |
  
  
  ### Framework versions
  
  - Transformers 4.25.1
  - Pytorch 1.13.1+cu116
  - Datasets 2.8.0
  - Tokenizers 0.13.2