Data Science, Machine Learning, Artificial Intelligence, Rag, Generative Ai.
first one will be the most relevant and the last chunk the least. Ultimately, we will pick the TOP K most relevant chunks. Rerank works really well when combined with query expansion. A natural flow when using rerank is as follows: Search for >K chunks >>> Reorder using rerank >>> Take top K Thus,