Simply explained: How does GPT work?
&gt; It is able to link ideas logically, defend them, adapt to the context, roleplay, and (especially the latest GPT-4) avoid contradicting itself.<p>Isn&#x27;t this just responding to the context provided?<p>Like if I say &quot;Write a Limerick about cats eating rats&quot; isn&#x27;t it just generating words that will come after that context, and correctly guessing that they&#x27;ll rhyme in a certain way?<p>It&#x27;s really cool that it can generate coherent responses, but it feels icky when people start interrogating it about things it got wrong. Aren&#x27;t you just providing more context tokens for it?<p>Certainly that model seems to fit both the things it gets right, and the things it gets wrong. It&#x27;s effectively &quot;hallucinating&quot; everything but sometimes that hallucination corresponds with what we consider appropriate and sometimes it doesn&#x27;t.