KFrank:

be addressed to some degree by using
variants of plain-vanilla gradient descent, such as adding momentum,
using an optimizer such as Adam , and/or using a learning-rate
scheduler.)
Of course, the realistic case


That is a very outstanding answer!