Solved by albanD in post #2 
              
              
                I guess that you use it as any other Optimizer from pytorch. 
I don’t think there is any plan to incorporate it in the main repo.