RAG at scale: Synchronizing and ingesting billions of text embeddings
It seems to me that RAG is really search, and search is generally a hard problem without an easy one size fits all solution. E.g., as people push retrieval further and further in the context of LLM generation, they're going to go further down the rabbit hole of how to build a good search system.Is everyone currently reinventing search from first principles?