Attention Mechanism in Deep Learning
>When we think about the English word “Attention”, we know that it means directing your focus at something and taking greater notice. The Attention mechanism in Deep Learning is based off this concept of directing your focus, and it pays greater attention to certain factors when processing the data.<p>I actually think they should rename it to 'Focus Mechanism'