readme: ---
  license: apache-2.0
  tags:
  - generated_from_trainer
  metrics:
  - rouge
  model-index:
  - name: long-t5-local-base-finetuned
    results: []
  ---
  
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
  should probably proofread and complete it, then remove this comment. -->
  
  # long-t5-local-base-finetuned
  
  This model is a fine-tuned version of [google/long-t5-local-base](https://huggingface.co/google/long-t5-local-base) on an unknown dataset.
  It achieves the following results on the evaluation set:
  - Loss: 9.2722
  - Rouge1: 3.8848
  - Rouge2: 0.5914
  - Rougel: 3.5038
  - Rougelsum: 3.7022
  - Gen Len: 19.0
  
  ## Model description
  
  More information needed
  
  ## Intended uses & limitations
  
  More information needed
  
  ## Training and evaluation data
  
  More information needed
  
  ## Training procedure
  
  ### Training hyperparameters
  
  The following hyperparameters were used during training:
  - learning_rate: 1e-06
  - train_batch_size: 3
  - eval_batch_size: 3
  - seed: 42
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  - lr_scheduler_type: linear
  - num_epochs: 50000
  
  ### Training results
  
  | Training Loss | Epoch | Step  | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | Gen Len |
  |:-------------:|:-----:|:-----:|:---------------:|:------:|:------:|:------:|:---------:|:-------:|
  | No log        | 0.16  | 100   | 342.4395        | 0.0    | 0.0    | 0.0    | 0.0       | 19.0    |
  | No log        | 0.31  | 200   | 323.6985        | 0.0    | 0.0    | 0.0    | 0.0       | 19.0    |
  | No log        | 0.47  | 300   | 303.8767        | 0.0    | 0.0    | 0.0    | 0.0       | 19.0    |
  | No log        | 0.62  | 400   | 284.7559        | 0.0    | 0.0    | 0.0    | 0.0       | 19.0    |
  | 295.8376      | 0.78  | 500   | 263.0420        | 0.0    | 0.0    | 0.0    | 0.0       | 19.0    |
  | 295.8376      | 0.93  | 600   | 243.2220        | 0.0242 | 0.0    | 0.0223 | 0.0242    | 19.0    |
  | 295.8376      | 1.09  | 700   | 224.4514        | 0.0493 | 0.0    | 0.0507 | 0.0513    | 19.0    |
  | 295.8376      | 1.24  | 800   | 203.9065        | 0.0656 | 0.0    | 0.0634 | 0.0658    | 19.0    |
  | 295.8376      | 1.4   | 900   | 184.8686        | 0.0609 | 0.0    | 0.058  | 0.0616    | 19.0    |
  | 199.938       | 1.55  | 1000  | 167.5315        | 0.0638 | 0.0    | 0.0626 | 0.063     | 19.0    |
  | 199.938       | 1.71  | 1100  | 151.2369        | 0.0421 | 0.0    | 0.0411 | 0.0413    | 19.0    |
  | 199.938       | 1.86  | 1200  | 137.2366        | 0.0358 | 0.0    | 0.0346 | 0.0342    | 19.0    |
  | 199.938       | 2.02  | 1300  | 125.3076        | 0.0173 | 0.0    | 0.0157 | 0.0157    | 19.0    |
  | 199.938       | 2.17  | 1400  | 114.5600        | 0.0173 | 0.0    | 0.0157 | 0.0157    | 19.0    |
  | 136.1309      | 2.33  | 1500  | 105.9237        | 0.0361 | 0.0    | 0.0344 | 0.0363    | 19.0    |
  | 136.1309      | 2.48  | 1600  | 97.4123         | 0.0526 | 0.0    | 0.051  | 0.054     | 19.0    |
  | 136.1309      | 2.64  | 1700  | 89.0873         | 0.0427 | 0.0    | 0.0407 | 0.0418    | 19.0    |
  | 136.1309      | 2.79  | 1800  | 82.0562         | 0.0496 | 0.0    | 0.0462 | 0.0462    | 19.0    |
  | 136.1309      | 2.95  | 1900  | 76.2360         | 0.0361 | 0.0    | 0.0345 | 0.0363    | 19.0    |
  | 99.2229       | 3.1   | 2000  | 70.0604         | 0.0438 | 0.0    | 0.0425 | 0.0439    | 19.0    |
  | 99.2229       | 3.26  | 2100  | 65.1038         | 0.0454 | 0.0    | 0.0441 | 0.0447    | 19.0    |
  | 99.2229       | 3.41  | 2200  | 59.1831         | 0.0344 | 0.0    | 0.0318 | 0.0318    | 19.0    |
  | 99.2229       | 3.57  | 2300  | 53.0313         | 0.0471 | 0.0    | 0.0448 | 0.0454    | 19.0    |
  | 99.2229       | 3.72  | 2400  | 48.2110         | 0.0369 | 0.0    | 0.0369 | 0.0369    | 19.0    |
  | 73.4208       | 3.88  | 2500  | 44.2004         | 0.0425 | 0.0    | 0.0427 | 0.044     | 19.0    |
  | 73.4208       | 4.03  | 2600  | 40.1925         | 0.0632 | 0.0    | 0.0619 | 0.0612    | 19.0    |
  | 73.4208       | 4.19  | 2700  | 36.3698         | 0.0887 | 0.0    | 0.0873 | 0.086     | 19.0    |
  | 73.4208       | 4.34  | 2800  | 33.2154         | 0.164  | 0.0    | 0.1652 | 0.1705    | 19.0    |
  | 73.4208       | 4.5   | 2900  | 30.9366         | 0.1106 | 0.0    | 0.1138 | 0.1144    | 19.0    |
  | 55.6661       | 4.65  | 3000  | 28.5672         | 0.1289 | 0.0    | 0.1295 | 0.131     | 19.0    |
  | 55.6661       | 4.81  | 3100  | 27.0910         | 0.2501 | 0.0    | 0.2514 | 0.2527    | 19.0    |
  | 55.6661       | 4.96  | 3200  | 25.6666         | 0.318  | 0.0    | 0.3322 | 0.3203    | 19.0    |
  | 55.6661       | 5.12  | 3300  | 24.6176         | 0.6319 | 0.0    | 0.6419 | 0.6299    | 19.0    |
  | 55.6661       | 5.27  | 3400  | 23.6474         | 1.6632 | 0.0033 | 1.665  | 1.6244    | 19.0    |
  | 45.1105       | 5.43  | 3500  | 22.7063         | 3.1374 | 0.0    | 3.1331 | 3.1333    | 19.0    |
  | 45.1105       | 5.58  | 3600  | 21.9191         | 5.0757 | 0.0    | 5.0694 | 5.0456    | 19.0    |
  | 45.1105       | 5.74 