Transformer, Machine Translation, NLP, Attention Mechanism.
concentrate on self attention. Consider a example: The animal didn’t cross the street because it was too tired In the sentence what does word ‘it’ mean? Is it fox or rabbit. The self attention is used for solving this problem. Self-attention is the method the Transformer uses to bake the