Solved by ptrblck in post #2 
              
              
                Would it work to pass the OrderedDict directly to nn.Sequential as described in the docs? 
# Example of using Sequential with OrderedDict
model = nn.Sequential(OrderedDict([
          ('conv1', nn.Conv2d(1,20,5)),
          ('relu1', nn.ReLU()),
          ('conv2', nn.Conv2d(20,64,5)),
          ('r…