GPT-3 will ignore tools when it disagrees with them
On the topic of trusting surprising observations, I remember a quiz at school where almost everyone had the same failure mode.First question: "read all the questions before answering"Questions 2-99: Trivial but interestingly bizarre questions, like "draw a triangle with blue ink"Question 100: "Now you have read all the questions, answer only questions 1 and 2"I was very tempted to make the  mistake everyone else made, and quite smug when I finished, sitting and watching as everyone else asked for ink and later on ink erasers.