I want to change the update of the running averages according to a * b**(x/c), where a, b, c are choosen and x is the learning epoch. So at the end of every epoch I want to set the running averages.
Here is the a quote from the paper that I try to implement:
“If Batch Normalization is used, the parameter for moving average will be a * b**(x/c)”