LLM Powered Autonomous Agents
Do I understand it correctly, that an LLMs are neural networks which only ever output a single "token", which is a short string of a few chars? And then the whole input plus that output  is fed back into the NN to produce the next token?<p>So if you ask ChatGPT "Describe Berlin", what happens is that the NN is called 6 times with these inputs:<p><pre><code>    Input: Describe Berlin.
    Outpu: Berlin
    Input: Describe Berlin. Berlin
    Outpu: is
    Input: Describe Berlin. Berlin is
    Outpu: a
    Input: Describe Berlin. Berlin is a
    Outpu: nice
    Input: Describe Berlin. Berlin is a nice
    Outpu: city
    Input: Describe Berlin. Berlin is a nice city
    Outpu: .
</code></pre>
ChatGPT's answer:<p><pre><code>    Berlin is a nice city.
</code></pre>
Is that how LLMs work?