Solved by ptrblck in post #2 
              
              
                For a general introduction to writing custom PyTorch models, have a look at this tutorial. 
To convert the TF model to PyTorch you should initialize all modules in the __init__ method of your custom model and use these modules in the forward method. 
The layers are almost equivalently named, i.e. la…