I am using the example I mentioned and I made 2 models one with attention and the other without.
The problem is the loss. The loss is higher when I use Attention.
Without Attention:

Thank you very much in advance!
/Angelos