bart-reviews / README.md
autoevaluator's picture
Add evaluation results on the default config and test split of OxAISH-AL-LLM/wiki_toxic
f1e5323
|
raw
history blame
2.55 kB
metadata
language:
  - en
datasets:
  - amazon_reviews_multi
metrics:
  - rouge
pipeline_tag: summarization
model-index:
  - name: MurkatG/bart-reviews
    results:
      - task:
          type: summarization
          name: Summarization
        dataset:
          name: OxAISH-AL-LLM/wiki_toxic
          type: OxAISH-AL-LLM/wiki_toxic
          config: default
          split: test
        metrics:
          - type: rouge
            value: 0.0127
            name: ROUGE-1
            verified: true
            verifyToken: >-
              eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiYTQ0ZDIxNTUxMWExM2I1ZjBkNGZiZDYxZGFiOGY5OTdiYzk1MTdiNTgyOWY4ZDdhMTVlMjg3YWFhNjJlOWQ0ZCIsInZlcnNpb24iOjF9.f68dZG-u7HpFuhg-XO5sS8i8BdmRPwfqB9Wp_x2NHDEp_2Y60Y6HwChJdzqmiW-lezll_rsvmTXCchIh0IVtAQ
          - type: rouge
            value: 0
            name: ROUGE-2
            verified: true
            verifyToken: >-
              eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNzBiOTVjOGUwODRlOGZjNDg3NTUyYzA3MWU1YzVhODk2ZWQ0ZTQ4M2UwY2E4OTU1MTk0ZWYwYmJlNjlhYmEyMSIsInZlcnNpb24iOjF9.F4Nu-RwmrxPuTZIjGunLQHGeDYZtJcYVUHMxfrJU3azYEGYO2f5_DPKhsv_eUwap6SOgErED57Mt_vw15QLWCg
          - type: rouge
            value: 0.0127
            name: ROUGE-L
            verified: true
            verifyToken: >-
              eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMWUwNTJkOGEzOGE1OWJmOWNhZjk1ZTE1OTA4ZWEzZGZjMzBlYWE1NjkyYTNmMDJhYjdhYjRkMmNhZTIyNzE2MiIsInZlcnNpb24iOjF9.uPfjczwvVaVAv7onyo572kSzVt2mKxn9fUp6yKQrVH56c82copGoNbtsDEgJb2ZQqa542a0H5Lfi3C6R9BCgCw
          - type: rouge
            value: 0.0128
            name: ROUGE-LSUM
            verified: true
            verifyToken: >-
              eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiOTM2YzcwNjhmZDI5ZTJjZmI0MmFjY2EwNDhjMmM5YTY3MTQ2MzA0ZDlmOWZkNzA4NmQwYTUwZmYyODYwNTg2MiIsInZlcnNpb24iOjF9.jT_-QP08ersvCvNp5JNWXR47cGz5czKmoHfz8UZXaS9JCM_mtnVMCnr1vYOh8clGpGSpcAYBuw3iMw1DJN_BBw
          - type: loss
            value: 4.47774076461792
            name: loss
            verified: true
            verifyToken: >-
              eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiOTZiNTA4NDBlZTg1MzBmZmUzMDJkOTliODUwNDJiNTRhN2NiMWNkNjgzNjI5ZmFjOWI1OTA3ZmU0ZDAzNDQ4ZiIsInZlcnNpb24iOjF9.REsbFg7l4LKNYpJ0sl_GaWuabQwV0BvbpUhopSXD1-im9kpYDCHrGdmBRzMVIPVZuMhTG6CBesKyeifsbTggAQ
          - type: gen_len
            value: 8.7861
            name: gen_len
            verified: true
            verifyToken: >-
              eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZmU4M2Q0YTAwOTc2ZmE0NTRjODViOGZmZTcyZWRmNzhjYzlkZmJmMTc4MWJlYzRkNGZmNDI0MjE5ODNkNWQ1OSIsInZlcnNpb24iOjF9.Vc6jPyqHBsyvNsBhPqp1ckOjFo7xwP3pVyiKVukeTn41ULG7h8TBXw5J8Gtfa-ztKxDCamrRC_1lEvKBssivBA

Model Card for Model ID

Model that trained to summarize product reviews.

{'rouge1': 18.1988, 'rouge2': 9.8264, 'rougeL': 17.9054, 'rougeLsum': 17.8739}