readme: ---
  license: cc-by-4.0
  tags:
  - generated_from_trainer
  metrics:
  - precision
  - recall
  - f1
  - accuracy
  model-index:
  - name: finetuned-ner
    results: []
  ---
  
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
  should probably proofread and complete it, then remove this comment. -->
  
  # finetuned-ner
  
  This model is a fine-tuned version of [deepset/deberta-v3-base-squad2](https://huggingface.co/deepset/deberta-v3-base-squad2) on an unknown dataset.
  It achieves the following results on the evaluation set:
  - Loss: 0.4783
  - Precision: 0.3264
  - Recall: 0.3591
  - F1: 0.3420
  - Accuracy: 0.8925
  
  ## Model description
  
  More information needed
  
  ## Intended uses & limitations
  
  More information needed
  
  ## Training and evaluation data
  
  More information needed
  
  ## Training procedure
  
  ### Training hyperparameters
  
  The following hyperparameters were used during training:
  - learning_rate: 2e-05
  - train_batch_size: 4
  - eval_batch_size: 8
  - seed: 42
  - gradient_accumulation_steps: 4
  - total_train_batch_size: 16
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  - lr_scheduler_type: linear
  - lr_scheduler_warmup_ratio: 0.1
  - num_epochs: 30
  - mixed_precision_training: Native AMP
  - label_smoothing_factor: 0.05
  
  ### Training results
  
  | Training Loss | Epoch | Step  | Validation Loss | Precision | Recall | F1     | Accuracy |
  |:-------------:|:-----:|:-----:|:---------------:|:---------:|:------:|:------:|:--------:|
  | 39.8167       | 1.0   | 760   | 0.3957          | 0.1844    | 0.2909 | 0.2257 | 0.8499   |
  | 21.7333       | 2.0   | 1520  | 0.3853          | 0.2118    | 0.3273 | 0.2571 | 0.8546   |
  | 13.8859       | 3.0   | 2280  | 0.3631          | 0.2443    | 0.2909 | 0.2656 | 0.8789   |
  | 20.6586       | 4.0   | 3040  | 0.3961          | 0.2946    | 0.3455 | 0.3180 | 0.8753   |
  | 13.8654       | 5.0   | 3800  | 0.3821          | 0.2791    | 0.3273 | 0.3013 | 0.8877   |
  | 12.6942       | 6.0   | 4560  | 0.4393          | 0.3122    | 0.3364 | 0.3239 | 0.8909   |
  | 25.0549       | 7.0   | 5320  | 0.4542          | 0.3106    | 0.3727 | 0.3388 | 0.8824   |
  | 5.6816        | 8.0   | 6080  | 0.4432          | 0.2820    | 0.3409 | 0.3086 | 0.8774   |
  | 13.1296       | 9.0   | 6840  | 0.4509          | 0.2884    | 0.35   | 0.3162 | 0.8824   |
  | 7.7173        | 10.0  | 7600  | 0.4265          | 0.3170    | 0.3818 | 0.3464 | 0.8919   |
  | 6.7922        | 11.0  | 8360  | 0.4749          | 0.3320    | 0.3818 | 0.3552 | 0.8892   |
  | 5.4287        | 12.0  | 9120  | 0.4564          | 0.2917    | 0.3818 | 0.3307 | 0.8805   |
  | 7.4153        | 13.0  | 9880  | 0.4735          | 0.2963    | 0.3273 | 0.3110 | 0.8871   |
  | 9.1154        | 14.0  | 10640 | 0.4553          | 0.3416    | 0.3773 | 0.3585 | 0.8894   |
  | 5.999         | 15.0  | 11400 | 0.4489          | 0.3203    | 0.4091 | 0.3593 | 0.8880   |
  | 9.5128        | 16.0  | 12160 | 0.4947          | 0.3164    | 0.3682 | 0.3403 | 0.8883   |
  | 5.6713        | 17.0  | 12920 | 0.4705          | 0.3527    | 0.3864 | 0.3688 | 0.8919   |
  | 12.2119       | 18.0  | 13680 | 0.4617          | 0.3123    | 0.3591 | 0.3340 | 0.8857   |
  | 8.5658        | 19.0  | 14440 | 0.4764          | 0.3092    | 0.35   | 0.3284 | 0.8944   |
  | 11.0664       | 20.0  | 15200 | 0.4557          | 0.3187    | 0.3636 | 0.3397 | 0.8905   |
  | 6.7161        | 21.0  | 15960 | 0.4468          | 0.3210    | 0.3955 | 0.3544 | 0.8956   |
  | 9.0448        | 22.0  | 16720 | 0.5120          | 0.2872    | 0.3682 | 0.3227 | 0.8792   |
  | 6.573         | 23.0  | 17480 | 0.4990          | 0.3307    | 0.3773 | 0.3524 | 0.8869   |
  | 5.0543        | 24.0  | 18240 | 0.4763          | 0.3028    | 0.3455 | 0.3227 | 0.8899   |
  | 6.8797        | 25.0  | 19000 | 0.4814          | 0.2780    | 0.3273 | 0.3006 | 0.8913   |
  | 7.7544        | 26.0  | 19760 | 0.4695          | 0.3024    | 0.3409 | 0.3205 | 0.8946   |
  | 4.8346        | 27.0  | 20520 | 0.4849          | 0.3154    | 0.3455 | 0.3297 | 0.8931   |
  | 4.4766        | 28.0  | 21280 | 0.4809          | 0.2925    | 0.3364 | 0.3129 | 0.8913   |
  | 7.9149        | 29.0  | 22040 | 0.4756          | 0.3238    | 0.3591 | 0.3405 | 0.8930   |
  | 7.3033        | 30.0  | 22800 | 0.4783          | 0.3264    | 0.3591 | 0.3420 | 0.8925   |
  
  
  ### Framework versions
  
  - Transformers 4.25.1
  - Pytorch 1.7.1
  - Datasets 2.8.0
  - Tokenizers 0.13.2
  