Hi Cahya, on inference/generate, RAG will make an average over the 5 extended-inputs.
RAG proposes two methods to average the result (each is an approximation of Bayesian marginalization) called ‘token’ and ‘sequence’ methods , respectively.
That’s why we have two Huggingface RagGeneration models  (the average is already built-in so we don’t have to do anything)