In that case, looking at /torch/nn/modules/container.html 8, would we not be better off using an OrderedDict with nn.Sequential, ?, they gave an example like this :
    To make it easier to understand, here is a small example::

        # Example of using Sequential
        model = nn.Sequential(
                  nn.Conv2d(1,20,5),
                  nn.ReLU(),
                  nn.Conv2d(20,64,5),
                  nn.ReLU()
                )

        # Example of using Sequential with OrderedDict
        model = nn.Sequential(OrderedDict([
                  ('conv1', nn.Conv2d(1,20,5)),
                  ('relu1', nn.ReLU()),
                  ('conv2', nn.Conv2d(20,64,5)),
                  ('relu2', nn.ReLU())
                ]))
    """

by the way I noticed we can also do :
model = nn.Sequential()
model.add("conv1", nn.Conv2d(1,20,5))
model.add("relu1", nn.ReLU())
model.add('conv2', nn.Conv2d(20,64,5))
model.add('relu2', nn.ReLU())