transformers pytorch safetensors t5 text2text-generation text-generation en dataset:kilt_tasks arxiv:2007.01282 license:cc-by-sa-3.0 model-index autotrain_compatible text-generation-inference endpoints_compatible region:us
---
datasets:
- kilt_tasks
language:
- en
license: cc-by-sa-3.0
metrics:
- exact_match
pipeline_tag: text-generation
model-index:
- name: results
  results:
  - task:
      type: text-generation
      name: Question Answering
    dataset:
      name: NQ KILT
      type: kilt_tasks
      args: nq
    metrics:
    - type: exact_match
      value: 59.01
      name: Exact Macth
---

# Fusion-In-Decoder Base on Natural Questions

This trained model is based on the [Fusion-In-Decoder](https://arxiv.org/abs/2007.01282) model, and trained on the [Natural Questions](https://huggingface.co/datasets/natural_questions) dataset.

# Model Details

Model is based on Fusion-In-Decoder, which in turn is based on the `t5-large` checkpoint as the base model. For training, we utilized text retrieval for each query, which provides a collection of relevant passages for it.

We note that the passages were retrieved using a corpus based on [Wikipedia](https://huggingface.co/datasets/wiki_dpr).

# Evaluation

See model performance on Evaluation Results tab on the right side.