AI, Artificial Intelligence, Machine Learning, Large Language Models, Prompt Engineering.
private information from the retrieval dataset. The structure of the prompting attack was composed of an {information} part for context retrieval and a {command} part to instruct the LLM to yield the desired output. Based on this empirical study, it is observed that models (Llama2–7b-Chat & GPT-