Yes, you are right. It will only influence that layer’s weights.
Sorry, you can see equation of loss in equation no. (2) & (3) and on page no. 13 the gradient computation.
https://arxiv.org/pdf/2004.11362.pdf 2