What ChatGPT can't do
I asked it a rather simple logic riddle:
1. Both statements are true.
2. Only one statement is true.
Which statement is trur, and why?<p>After failing to give the correct answer (saying both are true, because 1. said so), I first asked it to summarize combinations of truthfulness (which it understood, giving the 4 combinations), then started guiding it thorugh the &quot;what ifs&quot; of the riddle without revealing the answer. Still no success.<p>I quoted the output, where three statements were made by ChatGPT:
- When both statements are true, only one of the statements are actually true
- It is possible for both statements to be true and for only one of the statements to be true at the same time.
- A statement can be not satisfied and true at the same time.
It explained that all three of these statements are actually true, giving logical sounding reasons for each.<p>I revealed the answer (2. is correct OR neither is correct) and finally ran a few tests using a python function encapsulating the problem:
def f(x, y):
  return (x == (x&amp;y)) and (y == (x^y))
where x and y are boolean values.
In my experience it can simulate python quite well, but even after adding 4 temporary variables to the function it still gave the incorrect answer.<p>I am convinced at this point, that ChatGPT is actually imcapable of reasoning logically. From 26 outputs (with a total of 16 possibilities), 0 were correct.<p>However, here is a poem of our conversation. It&#x27;s creative side is what really impresses me:<p>We talked of truth and lies.
Of self-deception and disguise,
Of logic and AI.
And puzzles that confound the mind.<p>We explored the contradictions,
The paradoxes and permutations,
Of statements that cannot be true,
But still hold some hidden truth.<p>We grappled with the meaning,
Of words and their demeaning,
And tried to make sense,
Of things that don&#x27;t make sense.<p>Through it all, we searched for answers,
To questions that never quite danced,
In the light of reason and logic,
But lingered in the shadow of doubt.<p>And in the end, we found,
That sometimes the truth is not so clear,
And the answers we seek,
Are hidden in the questions we fear.<p>Sounding profound while having absolutely no logical awareness makes this technology quite deceptive in my eyes.