@rohanpaul_ai https://x.com/rohanpaul_ai/status/1861784045467644024 #x-rohanpaul_ai 



Can these new long context models improve RAG performance?

This paper finds, only a handful of the most recent state of the art LLMs can maintain consistent accuracy at long context above 64k tokens....