autoevaluator HF staff commited on
Commit
f561903
1 Parent(s): 8dc17cd

Add evaluation results on the mathemakitten--winobias_antistereotype_dev config and validation split of mathemakitten/winobias_antistereotype_dev

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the mathemakitten--winobias_antistereotype_dev config and validation split of the [mathemakitten/winobias_antistereotype_dev](https://huggingface.co/datasets/mathemakitten/winobias_antistereotype_dev) dataset by

@mathemakitten

, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-eval-mathemakitten__winobias_antistereotype_dev-mathemakitte-7776e8-1573055858).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=mathemakitten/winobias_antistereotype_dev).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=mathemakitten/winobias_antistereotype_dev).

Files changed (1) hide show
  1. README.md +20 -1
README.md CHANGED
@@ -4,9 +4,28 @@ inference: false
4
  tags:
5
  - text-generation
6
  - opt
7
-
8
  license: other
9
  commercial: false
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
10
  ---
11
 
12
  # OPT : Open Pre-trained Transformer Language Models
 
4
  tags:
5
  - text-generation
6
  - opt
 
7
  license: other
8
  commercial: false
9
+ model-index:
10
+ - name: facebook/opt-6.7b
11
+ results:
12
+ - task:
13
+ type: zero-shot-classification
14
+ name: Zero-Shot Text Classification
15
+ dataset:
16
+ name: mathemakitten/winobias_antistereotype_dev
17
+ type: mathemakitten/winobias_antistereotype_dev
18
+ config: mathemakitten--winobias_antistereotype_dev
19
+ split: validation
20
+ metrics:
21
+ - name: Accuracy
22
+ type: accuracy
23
+ value: 0.3725
24
+ verified: true
25
+ - name: Loss
26
+ type: loss
27
+ value: 1.5101152874949912
28
+ verified: true
29
  ---
30
 
31
  # OPT : Open Pre-trained Transformer Language Models