Are you looking for creating your own custom distributed strategy?
Cause I don’t think that we officially support this:

  

      github.com/tensorflow/tensorflow
  

  
    
  
	  
  

  
    
      Custom Distributed Strategy 1
    

    
      
        opened 
        
          
        
        Sep 9, 2019
      
      

        
          closed 
        
          
        
        Jun 25, 2020
      
        

      
        
          
          jpadrao
        
      
    

    
        TF 1.14
        comp:dist-strat
        type:feature
    
  


  
    <em>Please make sure that this is a feature request. As per our [GitHub Policy](…https://github.com/tensorflow/tensorflow/blob/master/ISSUES.md), we only address code/doc bugs, performance issues, feature requests and build/installation issues on GitHub. tag:feature_template</em>


**System information**
- TensorFlow version (you are using): 1.14.0
- Are you willing to contribute it (Yes/No): Yes



**Describe the feature and the current behavior/state.**

As Tensorflow stands, there is no easy and intuitive way to implement a new distribution strategy. The ones available, (MirroredStrategy, MultiWorkerMirroredStrategy, ...), work fine but the code seems very complex, and there isn't a tutorial/guide on how to develop a new one

**Will this change the current api? How?**

The api cloud be restructured to ease the support of new distributed strategy. A tutorial/guide on how to develop one would also be appreciated 

**Who will benefit with this feature?**

Researchers who want to reduce the time spent training distributed tensorflow models

**Any Other info.**