I’m not sure if you should manipulate the weights directly using the attention weights.
In the Seq2Seq tutorial 126 the attention weights are multiplied with the encoder outputs to calculate new activations.
Would that work for you, too?