How to update betas each time step with optimizer adam? When implementing the adam optimizer algorithm each time step the betas must be updated.
A static decay schedule can be used, although the paper recommend the following:
beta1(t) = beta1^t
beta2(t) = beta2^t

I am not sure what t would represent. Is it a constant like 0.99?

$t$ is most possibly the time step, which would mean a decreasing $\beta_i$ as time goes.
