Hello @Narine_Kokhlikyan thank you very much for your reply. I am particularly not looking for attribution score but this is really interesting. I am just looking to understand the how the attention mechanism is playing the role here. Which specific variable (attention weight, activation, gradient or something else) will provide intuition about which node embedding vector contributed to the final graph embedding.