So that’s a really interesting question: the model tends to rely on documents for some questions and hallucinate more on other - if you play around, you can see that it sometimes gets a good answer using supporting documents even for examples that aren’t in the training set, but it also needs to rely on its own knowledge from time to time which can lead to mistakes.
Definitely an open area of investigation!