@crcrpar
hi,why calculate running_mean as:
running_mean = alpha * mean + (1 - alpha) * running_mean

not just use:
running_mean = sum(mean of every batch)/batch counts

what is the difference or what is the benifit of  running_mean = alpha * mean + (1 - alpha) * running_mean