Deep Learning, Machine Learning, Artificial Intelligence, Data Science, AI.
attention mechanism is based on correlation with other elements (e.g., a pixel in the image or the next word in a sentence). In essence, human visual attention stands as a source of inspiration for this technique. The system can “focus” on a particular element to make its following recommendation.