Inference, Simulation, Transformer Model, Attention Mechanism, Cognitive Science.
akin to the operations of a typical computer program. The ability to update an internal state like a counter and proceed with iterative processing implies the capability for simulation. On the other hand, in the second simple example, where the intermediate vector was transformed to match the input