@joeddav
Stunningly, regarding the Octopus paper (Bender & Koller 2020) which contains a challenge on “advice on Bear chasing”, Gwern has tested  this example with GPT-3, and found that GPT-3 can make many valid suggestions to deal with a bear

  
      
      gwern.net
  
  
    

GPT-3 Creative Fiction 3

Creative writing by OpenAI's GPT-3 model, demonstrating poetry, dialogue, puns, literary parodies, and storytelling. Plus advice on effective GPT-3 prompt programming & avoiding common errors.