Solved by nitaifingerhut in post #4 
              
              
                You can create two different nn.modules 
One for encoder and second for decoder 
After that you can iterate over the layers (for later in module.children) and for each layer you can override its weights (an attribute of the layer)