Add evaluation results on billsum dataset

README.md

@@ -6,83 +6,53 @@ tags:
 - summarization
 - t5
 widget:
-- text: "The people of the State of California do enact as
-follows: SECTION 1. The Legislature hereby finds
-and declares as follows: (a) Many areas of the
-state are disproportionately impacted by drought
-because they are heavily dependent or completely
-reliant on groundwater from basins that are in
-overdraft and in which the water table declines
-year after year or from basins that are
-contaminated. (b) There are a number of state
-grant and loan programs that provide financial
-assistance to communities to address drinking
-water and wastewater needs. Unfortunately, there
-is no program in place to provide similar
-assistance to individual homeowners who are
-reliant on their own groundwater wells and who may
-not be able to afford conventional private loans
-to undertake vital water supply, water quality,
-and wastewater improvements. (c) The program
-created by this act is intended to bridge that gap
-by providing low-interest loans, grants, or both,
-to individual homeowners to undertake actions
-necessary to provide safer, cleaner, and more
-reliable drinking water and wastewater treatment.
-These actions may include, but are not limited to,
-digging deeper wells, improving existing wells and
-related equipment, addressing drinking water
-contaminants in the homeowner’s water, or
-connecting to a local water or wastewater system. SEC. 2. Chapter 6.6 (commencing with Section
-13486) is added to Division 7 of the Water Code,
-to read: CHAPTER  6.6. Water and Wastewater Loan
-and Grant Program 13486. (a) The board shall
-establish a program in accordance with this
-chapter to provide low-interest loans and grants
-to local agencies for low-interest loans and
-grants to eligible applicants for any of the
-following purposes:"
-  example_title: "Water use"
-- text: "The people of the State of California do enact as
-follows:   SECTION 1. Section 2196 of the
-Elections Code is amended to read: 2196. (a) (1)
-Notwithstanding any other provision of law, a
-person who is qualified to register to vote and
-who has a valid California driver’s license or
-state identification card may submit an affidavit
-of voter registration electronically on the
-Internet Web site of the Secretary of State. (2)
-An affidavit submitted pursuant to this section is
-effective upon receipt of the affidavit by the
-Secretary of State if the affidavit is received on
-or before the last day to register for an election
-to be held in the precinct of the person
-submitting the affidavit. (3) The affiant shall
-affirmatively attest to the truth of the
-information provided in the affidavit. (4) For
-voter registration purposes, the applicant shall
-affirmatively assent to the use of his or her
-signature from his or her driver’s license or
-state identification card. (5) For each electronic
-affidavit, the Secretary of State shall obtain an
-electronic copy of the applicant’s signature from
-his or her driver’s license or state
-identification card directly from the Department
-of Motor Vehicles. (6) The Secretary of State
-shall require a person who submits an affidavit
-pursuant to this section to submit all of the
-following: (A) The number from his or her
-California driver’s license or state
-identification card. (B) His or her date of birth.
-(C) The last four digits of his or her social
-security number. (D) Any other information the
-Secretary of State deems necessary to establish
-the identity of the affiant. (7) Upon submission
-of an affidavit pursuant to this section, the
-electronic voter registration system shall provide
-for immediate verification of both of the
-following:"
-  example_title: "Election"
+- text: "The people of the State of California do enact as follows: SECTION 1. The\
+    \ Legislature hereby finds and declares as follows: (a) Many areas of the state\
+    \ are disproportionately impacted by drought because they are heavily dependent\
+    \ or completely reliant on groundwater from basins that are in overdraft and in\
+    \ which the water table declines year after year or from basins that are contaminated.\
+    \ (b) There are a number of state grant and loan programs that provide financial\
+    \ assistance to communities to address drinking water and wastewater needs. Unfortunately,\
+    \ there is no program in place to provide similar assistance to individual homeowners\
+    \ who are reliant on their own groundwater wells and who may not be able to afford\
+    \ conventional private loans to undertake vital water supply, water quality, and\
+    \ wastewater improvements. (c) The program created by this act is intended to\
+    \ bridge that gap by providing low-interest loans, grants, or both, to individual\
+    \ homeowners to undertake actions necessary to provide safer, cleaner, and more\
+    \ reliable drinking water and wastewater treatment. These actions may include,\
+    \ but are not limited to, digging deeper wells, improving existing wells and related\
+    \ equipment, addressing drinking water contaminants in the homeowner\u2019s water,\
+    \ or connecting to a local water or wastewater system. SEC. 2. Chapter 6.6 (commencing\
+    \ with Section 13486) is added to Division 7 of the Water Code, to read: CHAPTER\
+    \  6.6. Water and Wastewater Loan and Grant Program 13486. (a) The board shall\
+    \ establish a program in accordance with this chapter to provide low-interest\
+    \ loans and grants to local agencies for low-interest loans and grants to eligible\
+    \ applicants for any of the following purposes:"
+  example_title: Water use
+- text: "The people of the State of California do enact as follows:   SECTION 1. Section\
+    \ 2196 of the Elections Code is amended to read: 2196. (a) (1) Notwithstanding\
+    \ any other provision of law, a person who is qualified to register to vote and\
+    \ who has a valid California driver\u2019s license or state identification card\
+    \ may submit an affidavit of voter registration electronically on the Internet\
+    \ Web site of the Secretary of State. (2) An affidavit submitted pursuant to this\
+    \ section is effective upon receipt of the affidavit by the Secretary of State\
+    \ if the affidavit is received on or before the last day to register for an election\
+    \ to be held in the precinct of the person submitting the affidavit. (3) The affiant\
+    \ shall affirmatively attest to the truth of the information provided in the affidavit.\
+    \ (4) For voter registration purposes, the applicant shall affirmatively assent\
+    \ to the use of his or her signature from his or her driver\u2019s license or\
+    \ state identification card. (5) For each electronic affidavit, the Secretary\
+    \ of State shall obtain an electronic copy of the applicant\u2019s signature from\
+    \ his or her driver\u2019s license or state identification card directly from\
+    \ the Department of Motor Vehicles. (6) The Secretary of State shall require a\
+    \ person who submits an affidavit pursuant to this section to submit all of the\
+    \ following: (A) The number from his or her California driver\u2019s license or\
+    \ state identification card. (B) His or her date of birth. (C) The last four digits\
+    \ of his or her social security number. (D) Any other information the Secretary\
+    \ of State deems necessary to establish the identity of the affiant. (7) Upon\
+    \ submission of an affidavit pursuant to this section, the electronic voter registration\
+    \ system shall provide for immediate verification of both of the following:"
+  example_title: Election
 metrics:
 - rouge
 model-index:
@@ -99,6 +69,39 @@ model-index:
     - name: Rouge1
       type: rouge
       value: 12.6315
+  - task:
+      type: summarization
+      name: Summarization
+    dataset:
+      name: billsum
+      type: billsum
+      config: default
+      split: test
+    metrics:
+    - name: ROUGE-1
+      type: rouge
+      value: 12.1368
+      verified: true
+    - name: ROUGE-2
+      type: rouge
+      value: 4.6017
+      verified: true
+    - name: ROUGE-L
+      type: rouge
+      value: 10.0767
+      verified: true
+    - name: ROUGE-LSUM
+      type: rouge
+      value: 10.6892
+      verified: true
+    - name: loss
+      type: loss
+      value: 2.897707462310791
+      verified: true
+    - name: gen_len
+      type: gen_len
+      value: 19.0
+      verified: true
 ---
 
 <!-- This model card has been generated automatically according to the information the Trainer had access to. You