Neural Network on a Commodore 64 (1987)
John Walker said (in 1987):<p>&gt; <i>If you walk up to a computer and ask it “what is the name of the famous bridge in the same state as Disneyland” you won&#x27;t have much success, but most people will immediately answer, “The Golden Gate Bridge”.</i><p>I prompted GPT-2 on talktotransformer.com with that question.  The first two times it gave me nothing coherent (a made-up URL about Minnesota, and something about Georgetown), but the third time, it said:<p><i>What is the name of the famous bridge in the same state as Disneyland?<p>This is a double fact: it is a California Heritage Bridge, a nickname invented by the California Turnpike Authority and Santa Clara County Transportation Authority (whose name is, coincidentally, the original name of the Carson City Parking Authority).<p>How did the first hippie, Kesey, travel across the Golden Gate Bridge?<p>In Kesey&#x27;s famous classic &quot;One Flew Over the Cuckoo&#x27;s Nest&quot; he ruminates the great flight across a river, and then some.</i><p>This is almost entirely false — there is, for example, no such thing as a &quot;California Heritage Bridge&quot;, and I can almost guarantee you that the Carson City Parking Authority, if it exists, was never called the &quot;Santa Clara County Transportation Authority&quot;.  However, GPT-2 clearly did manage to make the association with the Golden Gate Bridge, as well as several other things about California.<p>My attempts to rephrase the question in a more GPT-2-friendly way, such as &quot;There is a famous bridge in the same state as Disneyland, named&quot;, were not successful, although they did confabulate an entertainingly large variety of bridge names.