readme: ---
  language: 
    - en
  tags:
  - question-answering
  - qa
  license: "apache-2.0"
  datasets:
  - squad
  metrics:
  - squad
  ---
  # Description
  Trained on the SQuAD v1.1 dataset from the MRQA Shared Task. The public dev set was divided into two: one for dev and one for test.
  
  # Dev results:
  "eval_exact_match": 88.15914715400723,
  "eval_f1": 93.91715796563734,
  "eval_samples": 5291
  
  # Test results:
  "test_exact_match": 86.52455272173582,
  "test_f1": 92.92134442432088
  "predict_samples": 5294
  
  More info in the paper: 
  **MetaQA: Combining Expert Agents for Multi-Skill Question Answering**
  https://arxiv.org/abs/2112.01922