OpenAI isn’t doing enough to make ChatGPT’s limitations clear
&gt; Why, for example, can ChatGPT simply not recognize when it’s being asked to generate factual citations and caution the user to “check my sources”? Why can’t it respond to someone asking “is this text AI-generated?” with a clear “I’m sorry, I’m not capable of making that judgment”?<p>This is another big frustration for me, as someone who has been in the field for a long time (over a decade at this point). These are complex systems that are just reaching the point of usability, and yet people are going &quot;well why don&#x27;t you just <i>simply</i> do XYZ?&quot;<p>If it were simple, it wouldn&#x27;t have taken so long for these systems to emerge. We already barely get them to do what they&#x27;re doing, and they still suck at that, so &quot;just make it not do that&quot; is so frustrating. The only thing worse is when people ascribe malicious motives like openai is nefariously deciding that it should inject those mistakes.<p>Maybe this is the &quot;I could build that in a weekend&quot; of ML. Sorry for the rant, it just makes me want to vent.