I understand. I’m not sure if I could say what operations are right and wrong. In general,  I have seen papers doing addition as well as dot product based attention mechanism. You can only evaluate it empirically I guess.