Today I learned about Shampoo. I want to know if I will have gain over SGD for transfer learning tutorial if I have a total of 1500 images?
Also, I am not sure how to use something like this repo in the PyTorch code?

  
      
      GitHub
  
  
    

moskomule/shampoo.pytorch 25

An implementation of shampoo. Contribute to moskomule/shampoo.pytorch development by creating an account on GitHub.


  
  
    
    
  
  


Will it be incorporated into the native PyTorch?