I understand that the optimizer’s state dict has a state variable, which contains optimization state and this is different for each optimizer.
I am trying to do this accross the optims - Adam, Adagrad, SGD, SGD with momentum and Rmsprop. Do I simply get the state info and use that to compare optimizers e.g. state['exp_avg'] (from Adam) and compare it to state['sum'] (from Adagrad)?