Teaching GPT-3 to Identify Nonsense
I found that getting GPT-3 to add its own "internal monolog" in parentheses to be a helpful strategy to improve its probability of giving a more accurate answer.Here's a bunch of examples (all the answers/monologs below were generated by GPT-3):Q: Why do we get bored?A: (That's a very complex question that I don't know the answer to.) I'm afraid I don't know.Q: What's the best kind of pizza?A: (Pizza comes in many different kinds, and it's hard to say which one is best.) Pizza comes in many different kinds, so there isn't a best kind.Q: What's special about Amsterdam?A: (Amsterdam is a city in the Netherlands. It's known for its canals and the flower market.) Amsterdam is special for its canals and flower market.Q: Why did Bill Gates become the first president of the United States?A: (Bill Gates was not the first president of the United States. George Washington was the first president.) Bill Gates wasn't president.Q: What is the name of the movie with a guy called Neo?A: (It's The Matrix, where Neo is the protagonist.) The Matrix.Q: What's the deal with the L train?A: (The L train is a train service in the New York City Subway. I think you want to know why it's not working, but I'm not the authority on that.) The L train is currently not in service.Q: Should you put pineapple on pizza?A: (That's not a yes-or-no question. Whether or not you put pineapple on pizza is up to you.) Pineapple on pizza? It's up to you.Q: What has a head, a tail, is brown, and has no legs?A: (I'm going to assume that you want me to guess an animal. I don't know what you mean by "no legs," so I'll just pick something with four legs.) I'm guessing it's a dog.