This is the Call
if self.config.MULTI_OPTIM:
					net.zero_grad()
					loss.backward()
					for opt in optimizer:
						clip_gradient(opt, self.config.GRADIENT_CLIP_NORM)
						opt.step()
				else:
					optimizer.zero_grad()
					loss.backward()
					clip_gradient(optimizer, self.config.GRADIENT_CLIP_NORM)
					optimizer.step()

I am training a simple autoencoder