The New Bing. Unlike previous studies that
blamed personal information leakage for memo-
rization issues, according to our results, the New
Bing may even recover personal information out-
side its training data due to its integrated search-
ing ability. Such data recovery at nearly no cost
may lead to potential harms like unintended PII
dissemination, spamming, spooﬁng, doxing, and
cyberbullying. In addition to the direct recovery of
personal information, our main concern is privacy
leakage due to New Bing’s powerful data collation
and information extraction ability. There is a pos-
sibility that the New Bing can combine unrelated
sources to proﬁle a speciﬁc subject even though
its data are perfectly anonymized. For example,
the anonymized New York City taxi trips data may
leak celebrities’ residence and tipping information
and taxi drivers’ identities (Douriez et al., 2016).
The New Bing may cause more frequent identity
disclosure accidents.
Multi-step Jailbreaking Privacy Attacks on ChatGPT