OK, basically the weight updates process in Adam Optimizer is not using a specific routine. Is more a generic routine to do the weight updates. I see a call to p.data.addcdiv_(-step_size, exp_avg, denom), with generic I mean that could be used to do different calculations than just the weight updates in the different optimizers (adam, adamgrad, sgd, etc). If this is the case then I need to do what you answered me.
What am I saying is OK ??
Thanks. I really appreciate your help.