Hi there
As we know, there are two types of complexity (timing and memory requirements)
In this algorithm, I managed to achieve both qualities: less memory needed compared to adam and Adagrad RMSProp and high accuracy in finite time, even though I trained my algorithm with some time-consuming epochs on a personal computer.
I also reduced the hyperparameter used in many algorithms.
do you suggest any further research in this field?
cheers