Solved by driazati in post #3 
              
              
                @acobobby You are correct but we have some special infrastructure to support torch.nn Modules without needing to trace them (see builtin functions in the master docs for details), so just assigning them as submodules without tracing them is fine (e.g. 
self.conv1 = nn.Conv2d(1, 20, 5)). 
I don’t rem…