Reimagining Retrieval Augmented Language Models for Answering Queries
We present a reality check on large language models and inspect the promise
of retrieval augmented language models in comparison. Such language models are
semi-parametric, where models integrate model parameters and knowledge from
external data sources to make their predictions, as opposed to the parametric
nature of vanilla large language models. We give initial experimental findings
that semi-parametric architectures can be enhanced with views, a query
analyzer/planner, and provenance to make a significantly more powerful system
for question answering in terms of accuracy and efficiency, and potentially for
other NLP tasks
647d502d83cdb93baf775fb6
Wang-Chiew Tan
claimed_verified
2023-06-06T08:40:22.924Z
6372b3eb759c1ca82043f340
/avatars/13d66c9f373a144222923002750dc614.svg
Wang-Chiew Tan
user
wangchiew
647d502d83cdb93baf775fb7
Yuliang Li
admin_assigned
2023-06-07T10:31:47.629Z
631d408a55e6a9f989fa7cc2
/avatars/6a1c9f39b64081ea5455daa26c51aef4.svg
Yuliang Li
user
oi02lyl
647d502d83cdb93baf775fb8
Pedro Rodriguez
admin_assigned
2023-06-07T10:32:38.139Z
62d5b63605461e9459cefa66
/avatars/9cbe5d3a5a8f9023e1bbf97fe47d6af3.svg
Pedro Rodriguez
user
EntilZha
647d502d83cdb93baf775fb9
Richard James
647d502d83cdb93baf775fba
Xi Victoria Lin
647d502d83cdb93baf775fbb
Alon Halevy
admin_assigned
2023-06-07T10:33:32.525Z
636069a08fb9c2420ffe60de
/avatars/a9f7414d23af040891ac75bff3462814.svg
Alon Halevy
user
alonhalevy
647d502d83cdb93baf775fbc
Scott Yih
Reimagining Retrieval Augmented Language Models for Answering Queries
We present a reality check on large language models and inspect the promise
of retrieval augmented language models in comparison. Such language models are
semi-parametric, where models integrate model parameters and knowledge from
external data sources to make their predictions, as opposed to the parametric
nature of vanilla large language models. We give initial experimental findings
that semi-parametric architectures can be enhanced with views, a query
analyzer/planner, and provenance to make a significantly more powerful system
for question answering in terms of accuracy and efficiency, and potentially for
other NLP tasks
Semi-parametric language models augmented with retrieval components, views, query analyzers, and provenance outperform traditional large language models in question answering and other NLP tasks.
semi-parametric retrieval augmented model parameters external data sources parametric vanilla large language models views query analyzer query planner provenance question answering NLP tasks