title: Is Adam optimizer really RMSprop plus momentum? If yes, why it doesn't have a momentum parameter?
body: <p>Here is a <a href="https://www.tensorflow.org/api_docs/python/tf/keras/optimizers" rel="nofollow noreferrer">link</a> to tensorflow optimizers. And there you can see, that RMSprop takes momentum as argument while Adam does not do this. So I am confuzed. Adam optimization pretends to be a RMSprop optimization with momentum, like this:  </p>
  
  <p><em>Adam = RMSprop + Momentum</em>  </p>
  
  <p>But why then RMSprop does have the momentum parameter and Adam does not?</p>