Exfiltration of personal information from ChatGPT via prompt injection
<|reference_start|>Exfiltration of personal information from ChatGPT via prompt injection: We report that ChatGPT 4 and 4o are susceptible to a prompt injection attack that allows an attacker to exfiltrate users' personal data. It is applicable without the use of any 3rd party tools and all users are currently affected. This vulnerability is exacerbated by the recent introduction of ChatGPT's memory feature, which allows an attacker to command ChatGPT to monitor the user for the desired personal data.<|reference_end|>
@article{schwartzman2024exfiltration,
    title={Exfiltration of personal information from ChatGPT via prompt injection},
    author={Gregory Schwartzman},
    journal={arXiv preprint arXiv:2406.00199},
    year={2024},
    archivePrefix={arXiv},
    eprint={2406.00199},
    primaryClass={cs.CR cs.AI cs.CL cs.CY cs.ET}
}