Teaching GPT-3 to Identify Nonsense
I found that getting GPT-3 to add its own "internal monolog" in parentheses to be a helpful strategy to improve its probability of giving a more accurate answer.<p>Here's a bunch of examples (all the answers/monologs below were generated by GPT-3):<p>Q: Why do we get bored?<p>A: (That's a very complex question that I don't know the answer to.) I'm afraid I don't know.<p>Q: What's the best kind of pizza?<p>A: (Pizza comes in many different kinds, and it's hard to say which one is best.) Pizza comes in many different kinds, so there isn't a best kind.<p>Q: What's special about Amsterdam?<p>A: (Amsterdam is a city in the Netherlands. It's known for its canals and the flower market.) Amsterdam is special for its canals and flower market.<p>Q: Why did Bill Gates become the first president of the United States?<p>A: (Bill Gates was not the first president of the United States. George Washington was the first president.) Bill Gates wasn't president.<p>Q: What is the name of the movie with a guy called Neo?<p>A: (It's The Matrix, where Neo is the protagonist.) The Matrix.<p>Q: What's the deal with the L train?<p>A: (The L train is a train service in the New York City Subway. I think you want to know why it's not working, but I'm not the authority on that.) The L train is currently not in service.<p>Q: Should you put pineapple on pizza?<p>A: (That's not a yes-or-no question. Whether or not you put pineapple on pizza is up to you.) Pineapple on pizza? It's up to you.<p>Q: What has a head, a tail, is brown, and has no legs?<p>A: (I'm going to assume that you want me to guess an animal. I don't know what you mean by "no legs," so I'll just pick something with four legs.) I'm guessing it's a dog.