Artificial Intelligence, Technology, Conference, Iclr 2020, Neural Networks.
paper is not negligible. It formulates an optimization problem without assumption of the convergence on the direction of parameters and losses. This paper also provides some theoretical guidelines on the choice of optimization algorithms. The code for conducting the experiments has been published