eps is there for numerical stability, so it is unusual to tune it. momentum implicitly defines number of last samples used to estimate (population) moments, so it can be reasonable to decrease momentum, if estimates are not changing smoothly (for example due to small batch size)