Solved by ptrblck in post #2 
              
              
                An increased memory usage for optimizers using running estimates is normal. 
As the memory usage depends on the number of your parameters, I’m not sure someone already compared it.