readme: ---
  tags:
  - generated_from_trainer
  widget:
  - text: "Tachycardia is an increased heart rate for any reason. It can be a usual rise in heart rate caused by exercise or a stress response. Sinus tachycardia is considered a symptom, not a disease."
    example_title: "Tachycardia"
  - text: "Tuberculosis is a potentially serious infectious disease that mainly affects the lungs. Signs and symptoms of active TB include: Fatigue, Fever, Night sweats, Chills, Loss of appetite. Blood tests can confirm or rule out latent or active tuberculosis. The most common medications used to treat tuberculosis include: Isoniazid, Rifampin (Rifadin, Rimactane), Ethambutol (Myambutol), Pyrazinamide."
    example_title: "Tuberculosis"
  - text: "Cholera is a bacterial disease usually spread through contaminated water. A bacterium called Vibrio cholerae causes cholera infection. Symptoms of cholera infection can include: Diarrhea, Nausea, vomiting, Dehydration. Risk factors for cholera include: Poor sanitary conditions, Household exposure, Type O blood, Raw or undercooked shellfish."
    example_title: "Cholera"
  metrics:
  - precision
  - recall
  - f1
  - accuracy
  model-index:
  - name: biobert-v1.1-new
    results: []
  ---
  
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
  should probably proofread and complete it, then remove this comment. -->
  
  # biobert-v1.1-new
  
  This model is a fine-tuned version of [dmis-lab/biobert-v1.1](https://huggingface.co/dmis-lab/biobert-v1.1) on the None dataset.
  It achieves the following results on the evaluation set:
  - Loss: 0.5302
  - Precision: 0.5276
  - Recall: 0.6387
  - F1: 0.5779
  - Accuracy: 0.8270
  
  ## Model description
  
  More information needed
  
  ## Intended uses & limitations
  
  More information needed
  
  ## Training and evaluation data
  
  More information needed
  
  ## Training procedure
  
  ### Training hyperparameters
  
  The following hyperparameters were used during training:
  - learning_rate: 1e-05
  - train_batch_size: 8
  - eval_batch_size: 8
  - seed: 42
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  - lr_scheduler_type: linear
  - num_epochs: 30
  
  ### Training results
  
  | Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1     | Accuracy |
  |:-------------:|:-----:|:----:|:---------------:|:---------:|:------:|:------:|:--------:|
  | No log        | 1.0   | 180  | 0.8254          | 0.3995    | 0.5211 | 0.4522 | 0.7603   |
  | No log        | 2.0   | 360  | 0.5942          | 0.4660    | 0.5673 | 0.5117 | 0.8082   |
  | 0.9423        | 3.0   | 540  | 0.5532          | 0.4843    | 0.6095 | 0.5398 | 0.8197   |
  | 0.9423        | 4.0   | 720  | 0.5514          | 0.4879    | 0.6407 | 0.5539 | 0.8170   |
  | 0.9423        | 5.0   | 900  | 0.5302          | 0.5276    | 0.6387 | 0.5779 | 0.8270   |
  | 0.4449        | 6.0   | 1080 | 0.5634          | 0.5038    | 0.6462 | 0.5662 | 0.8215   |
  | 0.4449        | 7.0   | 1260 | 0.5878          | 0.4943    | 0.6588 | 0.5648 | 0.8148   |
  | 0.4449        | 8.0   | 1440 | 0.5927          | 0.4932    | 0.6641 | 0.5660 | 0.8152   |
  | 0.3234        | 9.0   | 1620 | 0.6031          | 0.4886    | 0.6606 | 0.5617 | 0.8132   |
  | 0.3234        | 10.0  | 1800 | 0.6269          | 0.4936    | 0.6508 | 0.5614 | 0.8086   |
  | 0.3234        | 11.0  | 1980 | 0.6274          | 0.5147    | 0.6570 | 0.5772 | 0.8173   |
  | 0.2486        | 12.0  | 2160 | 0.6725          | 0.5058    | 0.6568 | 0.5715 | 0.8100   |
  | 0.2486        | 13.0  | 2340 | 0.6837          | 0.5118    | 0.6550 | 0.5746 | 0.8150   |
  | 0.1963        | 14.0  | 2520 | 0.7036          | 0.5034    | 0.6631 | 0.5723 | 0.8114   |
  | 0.1963        | 15.0  | 2700 | 0.7071          | 0.5208    | 0.6626 | 0.5832 | 0.8157   |
  | 0.1963        | 16.0  | 2880 | 0.7320          | 0.5159    | 0.6643 | 0.5808 | 0.8131   |
  | 0.1587        | 17.0  | 3060 | 0.7712          | 0.4789    | 0.6754 | 0.5604 | 0.8035   |
  | 0.1587        | 18.0  | 3240 | 0.7749          | 0.5041    | 0.6693 | 0.5751 | 0.8057   |
  | 0.1587        | 19.0  | 3420 | 0.7745          | 0.5057    | 0.6744 | 0.5780 | 0.8081   |
  | 0.1386        | 20.0  | 3600 | 0.7799          | 0.5011    | 0.6621 | 0.5705 | 0.8121   |
  | 0.1386        | 21.0  | 3780 | 0.7959          | 0.5009    | 0.6729 | 0.5743 | 0.8080   |
  | 0.1386        | 22.0  | 3960 | 0.8079          | 0.5141    | 0.6651 | 0.5799 | 0.8118   |
  | 0.118         | 23.0  | 4140 | 0.8132          | 0.5066    | 0.6593 | 0.5729 | 0.8093   |
  | 0.118         | 24.0  | 4320 | 0.8196          | 0.5129    | 0.6626 | 0.5782 | 0.8100   |
  | 0.1074        | 25.0  | 4500 | 0.8290          | 0.5086    | 0.6648 | 0.5763 | 0.8079   |
  | 0.1074        | 26.0  | 4680 | 0.8339          | 0.5071    | 0.6628 | 0.5746 | 0.8094   |
  | 0.1074        | 27.0  | 4860 | 0.8492          | 0.5029    | 0.6648 | 0.5726 | 0.8066   |
  | 0.099         | 28.0  | 5040 | 0.8400          | 0.5077    | 0.6631 | 0.5751 | 0.8089   |
  | 0.099         | 29.0  | 5220 | 0.8441          | 0.5069    | 0.6595 | 0.5732 | 0.8091  