readme: ---
  license: mit
  datasets:
  - taskydata/tasky_or_not
  language:
  - en
  metrics:
  - f1
  - accuracy
  - recall
  - precision
  pipeline_tag: text-classification
  ---
  
  **Hyperparameters:** 
  
   - learning rate: 2e-5
   - weight decay: 0.01
   - per_device_train_batch_size: 8
   - per_device_eval_batch_size: 8
   - gradient_accumulation_steps:1
   - eval steps: 50000
   - max_length: 512
   - num_epochs: 1
   - hidden_dropout_prob: 0.3
   - attention_probs_dropout_prob: 0.25
     
  **Dataset version:** 
   - tasky_or_not/10xp3nirstbbflanseuni_10xc4
  
  **Checkpoint:** 
  
   - 300000 steps.
  
  **Results on Validation set:**
  
  | **Step** | **Training Loss** | **Validation Loss** | **Accuracy** | **Precision** | **Recall** |  **F1**  |
  |:--------:|:-----------------:|:-------------------:|:------------:|:-------------:|:----------:|:--------:|
  |   50000  |      0.020800     |       0.192550      |   0.970363   |    0.990686   |  0.949654  | 0.969736 |
  |  100000  |      0.015200     |       0.264168      |   0.969427   |    0.994374   |  0.944196  | 0.968636 |
  |  150000  |      0.012900     |       0.146541      |   0.981440   |    0.994599   |  0.968138  | 0.981190 |
  |  200000  |      0.011100     |       0.319310      |   0.970516   |    0.998871   |  0.942097  | 0.969654 |
  |  250000  |      0.008000     |       0.204103      |   0.976309   |    0.996226   |  0.956241  | 0.975824 |
  |  300000  |      0.006100     |       0.096262      |   0.988053   |    0.994676   |  0.981358  | 0.987972 |
  |  350000  |      0.005800     |       0.162989      |   0.983663   |    0.994730   |  0.972478  | 0.983478 |
  
  **Wandb logs:**
   - https://wandb.ai/manandey/taskydata/runs/y3j3fbkh?workspace=user-manandey