Hi, I have a small question
For example with SGD momentum, the momentum will be stacked by this formula (follow Pytorch source code):
v{t+1} & = momentum * vt + g{t+1}  

Does Pytorch keep the momentum from optimizer in pth file? Or we have to reset the momentum every time we train again?