Thanks for your response!
So for example, if you use Adam or AdaGrad or any of the algorithms that construct a buffer in __init__, what can go wrong in the optimization? Will the optimizer not keep track of this buffer appropriately?