GPT-3 will ignore tools when it disagrees with them
On the topic of trusting surprising observations, I remember a quiz at school where almost everyone had the same failure mode.<p>First question: "read all the questions before answering"<p>Questions 2-99: Trivial but interestingly bizarre questions, like "draw a triangle with blue ink"<p>Question 100: "Now you have read all the questions, answer only questions 1 and 2"<p>I was very tempted to make the  mistake everyone else made, and quite smug when I finished, sitting and watching as everyone else asked for ink and later on ink erasers.