AI, Artificial Intelligence, Machine Learning, Large Language Models, Prompt Engineering.
the memorisation behaviour of LLMs in RAG is still unclear and worth further exploration. Source Attack The study found that very long user commands reduce retrieved documents, possibly because the long command makes the query embedding less diverse as it occupies a large portion of the sentence.