Solved by ptrblck in post #2 
              
              
                If you define an nn.Module, you are usually storing some submodules, parameters, buffers or other arguments in its __init__ method and write the actual forward logic in its forward method. 
This is a convenient method as nn.Module.__call__ will register hooks etc. and call finally into the forward m…