readme: ---
  license: apache-2.0
  tags:
  - generated_from_trainer
  model-index:
  - name: distil-tis
    results: []
  ---
  
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
  should probably proofread and complete it, then remove this comment. -->
  
  # distil-tis
  
  This model is a fine-tuned version of [distilroberta-base](https://huggingface.co/distilroberta-base) on the None dataset.
  It achieves the following results on the evaluation set:
  - Loss: 0.6061
  - Rmse: 0.7785
  - Mse: 0.6061
  - Mae: 0.6003
  
  ## Model description
  
  More information needed
  
  ## Intended uses & limitations
  
  More information needed
  
  ## Training and evaluation data
  
  More information needed
  
  ## Training procedure
  
  ### Training hyperparameters
  
  The following hyperparameters were used during training:
  - learning_rate: 5e-05
  - train_batch_size: 32
  - eval_batch_size: 32
  - seed: 42
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  - lr_scheduler_type: linear
  - num_epochs: 10
  
  ### Training results
  
  | Training Loss | Epoch | Step | Validation Loss | Rmse   | Mse    | Mae    |
  |:-------------:|:-----:|:----:|:---------------:|:------:|:------:|:------:|
  | 0.7173        | 1.0   | 492  | 0.7060          | 0.8403 | 0.7060 | 0.5962 |
  | 0.5955        | 2.0   | 984  | 0.6585          | 0.8115 | 0.6585 | 0.5864 |
  | 0.5876        | 3.0   | 1476 | 0.6090          | 0.7804 | 0.6090 | 0.6040 |
  | 0.5871        | 4.0   | 1968 | 0.6247          | 0.7904 | 0.6247 | 0.5877 |
  | 0.5871        | 5.0   | 2460 | 0.6061          | 0.7785 | 0.6061 | 0.6003 |
  
  
  ### Framework versions
  
  - Transformers 4.19.0.dev0
  - Pytorch 1.9.0+cu111
  - Datasets 2.4.0
  - Tokenizers 0.12.1
  