fenglinliu commited on
Commit
fe7f326
·
verified ·
1 Parent(s): 993070a

Update meta_data.py

Browse files
Files changed (1) hide show
  1. meta_data.py +5 -7
meta_data.py CHANGED
@@ -50,18 +50,16 @@ MODEL_TYPE = ['API', 'OpenSource', 'Proprietary']
50
  LEADERBOARD_MD = {}
51
 
52
  LEADERBOARD_MD['MAIN'] = f"""
53
- ## Included Shopping Skills:
54
 
55
- - Shopping Concept Understanding: Understanding domain-specific short texts in online shopping (e.g. brands, product models).
56
- - Shopping Knowledge Reasoning: Reasoning over commonsense, numeric, and implicit product-product multi-hop knowledge.
57
- - User Behavior Alignment: Modeling heterogeneous and implicit user behaviors (e.g. click, query, purchase).
58
- - Multi-lingual Abilities: Online shopping across marketplaces around the globe.
59
 
60
  ## Main Evaluation Results
61
 
62
  - Metrics:
63
- - Avg Score: The average score on all 4 online shopping skills (normalized to 0 - 100, the higher the better).
64
- - Detailed metrics and evaluation results for each skill are provided in the consequent tabs.
65
  """
66
 
67
 
 
50
  LEADERBOARD_MD = {}
51
 
52
  LEADERBOARD_MD['MAIN'] = f"""
53
+ ## Included Evaluation scenarios and tasks:
54
 
55
+ - Clinical Language Reasoning: Exam-style QA, Referral QA, and Treatment Recommendation.
56
+ - Clinical Language Generation: Radiology Report Summarization, Hospitalization Summarization, and Patient Education.
57
+ - Clinical Language Understanding: Named Entity Recognition, Relation Extraction, Document Classification, Pharmacology QA for Emerging Drugs, and Drug Interaction for Emerging Drugs.
 
58
 
59
  ## Main Evaluation Results
60
 
61
  - Metrics:
62
+ - Accuracy, ROUGE-L, and F1.
 
63
  """
64
 
65