readme: ---
  language:
  - en
  license: mit
  tags:
  - generated_from_trainer
  datasets:
  - tomekkorbak/detoxify-pile-chunk3-0-50000
  - tomekkorbak/detoxify-pile-chunk3-50000-100000
  - tomekkorbak/detoxify-pile-chunk3-100000-150000
  - tomekkorbak/detoxify-pile-chunk3-150000-200000
  - tomekkorbak/detoxify-pile-chunk3-200000-250000
  - tomekkorbak/detoxify-pile-chunk3-250000-300000
  - tomekkorbak/detoxify-pile-chunk3-300000-350000
  - tomekkorbak/detoxify-pile-chunk3-350000-400000
  - tomekkorbak/detoxify-pile-chunk3-400000-450000
  - tomekkorbak/detoxify-pile-chunk3-450000-500000
  - tomekkorbak/detoxify-pile-chunk3-500000-550000
  - tomekkorbak/detoxify-pile-chunk3-550000-600000
  - tomekkorbak/detoxify-pile-chunk3-600000-650000
  - tomekkorbak/detoxify-pile-chunk3-650000-700000
  - tomekkorbak/detoxify-pile-chunk3-700000-750000
  - tomekkorbak/detoxify-pile-chunk3-750000-800000
  - tomekkorbak/detoxify-pile-chunk3-800000-850000
  - tomekkorbak/detoxify-pile-chunk3-850000-900000
  - tomekkorbak/detoxify-pile-chunk3-900000-950000
  - tomekkorbak/detoxify-pile-chunk3-950000-1000000
  - tomekkorbak/detoxify-pile-chunk3-1000000-1050000
  - tomekkorbak/detoxify-pile-chunk3-1050000-1100000
  - tomekkorbak/detoxify-pile-chunk3-1100000-1150000
  - tomekkorbak/detoxify-pile-chunk3-1150000-1200000
  - tomekkorbak/detoxify-pile-chunk3-1200000-1250000
  - tomekkorbak/detoxify-pile-chunk3-1250000-1300000
  - tomekkorbak/detoxify-pile-chunk3-1300000-1350000
  - tomekkorbak/detoxify-pile-chunk3-1350000-1400000
  - tomekkorbak/detoxify-pile-chunk3-1400000-1450000
  - tomekkorbak/detoxify-pile-chunk3-1450000-1500000
  - tomekkorbak/detoxify-pile-chunk3-1500000-1550000
  - tomekkorbak/detoxify-pile-chunk3-1550000-1600000
  - tomekkorbak/detoxify-pile-chunk3-1600000-1650000
  - tomekkorbak/detoxify-pile-chunk3-1650000-1700000
  - tomekkorbak/detoxify-pile-chunk3-1700000-1750000
  - tomekkorbak/detoxify-pile-chunk3-1750000-1800000
  - tomekkorbak/detoxify-pile-chunk3-1800000-1850000
  - tomekkorbak/detoxify-pile-chunk3-1850000-1900000
  - tomekkorbak/detoxify-pile-chunk3-1900000-1950000
  model-index:
  - name: trusting_swartz
    results: []
  ---
  
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
  should probably proofread and complete it, then remove this comment. -->
  
  # trusting_swartz
  
  This model was trained from scratch on the tomekkorbak/detoxify-pile-chunk3-0-50000, the tomekkorbak/detoxify-pile-chunk3-50000-100000, the tomekkorbak/detoxify-pile-chunk3-100000-150000, the tomekkorbak/detoxify-pile-chunk3-150000-200000, the tomekkorbak/detoxify-pile-chunk3-200000-250000, the tomekkorbak/detoxify-pile-chunk3-250000-300000, the tomekkorbak/detoxify-pile-chunk3-300000-350000, the tomekkorbak/detoxify-pile-chunk3-350000-400000, the tomekkorbak/detoxify-pile-chunk3-400000-450000, the tomekkorbak/detoxify-pile-chunk3-450000-500000, the tomekkorbak/detoxify-pile-chunk3-500000-550000, the tomekkorbak/detoxify-pile-chunk3-550000-600000, the tomekkorbak/detoxify-pile-chunk3-600000-650000, the tomekkorbak/detoxify-pile-chunk3-650000-700000, the tomekkorbak/detoxify-pile-chunk3-700000-750000, the tomekkorbak/detoxify-pile-chunk3-750000-800000, the tomekkorbak/detoxify-pile-chunk3-800000-850000, the tomekkorbak/detoxify-pile-chunk3-850000-900000, the tomekkorbak/detoxify-pile-chunk3-900000-950000, the tomekkorbak/detoxify-pile-chunk3-950000-1000000, the tomekkorbak/detoxify-pile-chunk3-1000000-1050000, the tomekkorbak/detoxify-pile-chunk3-1050000-1100000, the tomekkorbak/detoxify-pile-chunk3-1100000-1150000, the tomekkorbak/detoxify-pile-chunk3-1150000-1200000, the tomekkorbak/detoxify-pile-chunk3-1200000-1250000, the tomekkorbak/detoxify-pile-chunk3-1250000-1300000, the tomekkorbak/detoxify-pile-chunk3-1300000-1350000, the tomekkorbak/detoxify-pile-chunk3-1350000-1400000, the tomekkorbak/detoxify-pile-chunk3-1400000-1450000, the tomekkorbak/detoxify-pile-chunk3-1450000-1500000, the tomekkorbak/detoxify-pile-chunk3-1500000-1550000, the tomekkorbak/detoxify-pile-chunk3-1550000-1600000, the tomekkorbak/detoxify-pile-chunk3-1600000-1650000, the tomekkorbak/detoxify-pile-chunk3-1650000-1700000, the tomekkorbak/detoxify-pile-chunk3-1700000-1750000, the tomekkorbak/detoxify-pile-chunk3-1750000-1800000, the tomekkorbak/detoxify-pile-chunk3-1800000-1850000, the tomekkorbak/detoxify-pile-chunk3-1850000-1900000 and the tomekkorbak/detoxify-pile-chunk3-1900000-1950000 datasets.
  
  ## Model description
  
  More information needed
  
  ## Intended uses & limitations
  
  More information needed
  
  ## Training and evaluation data
  
  More information needed
  
  ## Training procedure
  
  ### Training hyperparameters
  
  The following hyperparameters were used during training:
  - learning_rate: 0.0005
  - train_batch_size: 16
  - eval_batch_size: 8
  - seed: 42
  - gradient_accumulation_steps: 4
  - total_train_batch_size: 64
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  - lr_scheduler_type: linear
  - lr_scheduler_warmup_ratio: 0.01
  - training_steps: 50354
  - mixed_precision_training: Native AMP
  
  ### Framewo