Yes, you are right of course. I am wondering what the intuition behind that is in this case. I only know residual connections from ResNet and friends, so I am not sure how to interpret their importance in the Transformer case (typical for text).