Data Science, Machine Learning, Artificial Intelligence, Rag, Generative Ai.
Thus, we end up with N x K chunks. In our particular case, N = 5 & K = 3. Thus, we end up with 15 chunks. Post-retrieval optimization: rerank The problem The retrieved context may contain irrelevant chunks that only: add noise: the retrieved context might be irrelevant make the prompt bigger: