Tensorflow has Tensorpack which really streamlines data loading, checkpointing, model training, saving, multi-gpu training.

  
      
      GitHub
  
  
    

ppwwyyxx/tensorpack 44

tensorpack - A Neural Net Training Interface on TensorFlow


  
  
    
    
  
  


Author for library above works in Facebook Research. Does @smth know him?
Anyone started something similar with Pytorch?