Attention Mechanism, Neural Networks, Artificial Intelligence, Machine Learning, Deep Learning.
enables the disentanglement of temporal and input behaviour from other network dynamics. The team then demonstrates how each of the three architectures learns to solve tasks, and the role of their input and temporal components. They apply this decomposition to the hidden states and plot the