No, this will print the parameters in the order as they were registered:
class MyModel(nn.Module):
    def __init__(self):
        super(MyModel, self).__init__()
        self.fc3 = nn.Linear(1, 1)
        self.fc2 = nn.Linear(1, 1)
        self.fc1 = nn.Linear(1, 1)
        
    def forward(self, x):
        x = F.relu(self.fc1(x))
        x = F.relu(self.fc2(x))
        x = self.fc3(x)
        return x

for name, param in model.named_parameters():
    print(name)

> fc3.weight
fc3.bias
fc2.weight
fc2.bias
fc1.weight
fc1.bias

You could try to register the layers in the same order as their execution order in the forward method would be (if that’s possible for your model).