I am looking forward to implement  ‘Quasi Newton algorithm 28’  in pytorch.
Looking for suggestions of other optimization algorithms that you think are useful?  I will go through and implement bunch of it.