Yes.
Accumulated gradients will be the same if you divide them by the number of iterations. I referred below.




PyTorch Gradients


Not that loss functions average over the batch size, so if you do multiple backprops you might need to average over the number of the for loop iterations.