So, if I was able to backpropagate through the gradient step in the second loop, I would have a dependence on weights as the gradient step I took between the two loops has some dependence on the weights on the original loss function.