Solved by ptrblck in post #4 
              
              
                Thanks for the update. 
The issue is raised, because self.convs is using and OrderedDict instead of an nn.ModuleDict, which will not properly register these modules. 
Change it to the latter and adapt the indexing, as nn.ModuleDict expects strings (e.g. to "upconv{}{}".format(i, 0)). 
Also, note tha…