both automated and human evaluations. This second
set of evaluations relies on queries curated by humans
and aims at measuring the quality of model responses.
While this is a more realistic testbed for chatbot model
performance and is growing in popularity, there is no
commonly accepted protocol in the literature. We de-
scribe below our proposed setup, using nucleus sampling with p = 0.9 and temperature 0.7 in all
cases.
QLORA