Do you want an udpate  on

  

      github.com/tensorflow/tensorflow
  

  
    
  
	  
  

  
    
      Support model parallelism in tf.distribute.Strategy 4
    

    
      
        opened 
        
          
        
        Apr 11, 2019
      
      


      
        
          
          guptapriya
        
      
    

    
        type:feature
        comp:dist-strat
    
  


  
    Current tf.distribute.Strategy only supports data parallelism. We would like to …support the following form of model parallelism: user specifies a number of "logical devices" per replica upfront, and then explicitly places ops on a specific logical device.