readme: ---
  license: mit
  datasets:
  - taskydata/tasky_or_not
  language:
  - en
  metrics:
  - accuracy
  - f1
  - recall
  - precision
  pipeline_tag: text-classification
  ---
  
  **Hyperparameters:** 
  
   - learning rate: 2e-5
   - weight decay: 0.01
   - per_device_train_batch_size: 8
   - per_device_eval_batch_size: 8
   - gradient_accumulation_steps:1
   - eval steps: 24000
   - max_length: 512
   - num_epochs: 2
   - hidden_dropout_prob: 0.3
   - attention_probs_dropout_prob: 0.25
     
  **Dataset version:** 
   - taskydata/10xp3nirstbbflanse_5xc4
  
  **Checkpoint:** 
  
   - 48000 steps
  
  **Results on Validation set:**
  
  | **Step** | **Training Loss** | **Validation Loss** | **Accuracy** | **Precision** | **Recall** |  **F1**  |
  |:--------:|:-----------------:|:-------------------:|:------------:|:-------------:|:----------:|:--------:|
  |   24000  |      0.052000     |       0.071572      |   0.988261   |    0.999752   |  0.987852  | 0.993767 |
  |   48000  |      0.015100     |       0.026952      |   0.995925   |    0.999564   |  0.996132  | 0.997846 |
  
  **Wandb logs:**
   - https://wandb.ai/manandey/huggingface/runs/2vh7iwi6?workspace=user-manandey