Hello!
I work on the PowerAI (now renamed Watson Machine Learning Community Edition (phew!)) development team. Sorry for not noticing this question sooner!
At the time you asked the LMS code wasn’t public, but we’re now prepared to offer it to the community.
It’s currently sitting in a team-member’s repo on github. The LMS implementation based on PyTorch 1.1.0 stable can be found at:

  
      
      GitHub
  
  
    

mtbrandy/pytorch 34

Tensors and Dynamic neural networks in Python  with strong GPU acceleration - mtbrandy/pytorch


  
  
    
    
  
  


Usage and implementation notes are available in a wiki at:

  
      
      GitHub
  
  
    

mtbrandy/pytorch 5

Tensors and Dynamic neural networks in Python  with strong GPU acceleration - mtbrandy/pytorch