Knowledge Return Oriented Prompting (KROP)
<|reference_start|>Knowledge Return Oriented Prompting (KROP): Many Large Language Models (LLMs) and LLM-powered apps deployed today use some form of prompt filter or alignment to protect their integrity. However, these measures aren't foolproof. This paper introduces KROP, a prompt injection technique capable of obfuscating prompt injection attacks, rendering them virtually undetectable to most of these security measures.<|reference_end|>
@article{martin2024knowledge,
    title={Knowledge Return Oriented Prompting (KROP)},
    author={Jason Martin, Kenneth Yeung},
    journal={arXiv preprint arXiv:2406.11880},
    year={2024},
    archivePrefix={arXiv},
    eprint={2406.11880},
    primaryClass={cs.CR cs.LG}
}