I am trying to implement attention mechanism. Unfortunately, my current implementation has high loss than the model without attention.

attention.png412×571 15.7 KB

Any ideas on how to improve the model or whether it even makes sense at the moment…