You might be interested in the following blog post which walks through a usecase for PyTorch LMS and some performance considerations:

  
      
      Power developer portal – 10 Dec 19
  
  
    

DeepLabv3+ image segmentation model with PyTorch LMS - Power developer portal 35

Large Model Support (LMS) technology enables training of large deep neural networks that would exhaust GPU memory while training. PyTorch is a relatively new and popular Python-based open source deep learning framework built by Facebook for faster...