The original attention paper uses residual connections, without much explanations. I’d say it is the same motivation anywhere, combating vanishing gradients and hopefully easier training as less shifting is needed.