Machine Learning, Graph, TensorFlow, Algorithms, Data Science.
shows where the read, write and output attention heads are focussed: The attention is used in mostly obvious ways: Every step reads from the first mentioned station’s node state Every step writes from the second mentioned station’s node state The output cell mostly uses the read value from the