To work with larger batch size in the limited GPU resource, we often use accumulate gradient strategy as follows:
optimizer.zero_grad()
loss_sum = 0
for  i in range(iter_size):
    loss = criterion(output, target_var) / iter_size
    loss.backward()
    loss_sum += loss
optimizer.step()

The stratgy often used in SGD. Does strategy will work if I use Adam optimizer?