I understand what you are describing. I have to declare separated leaf-node parameters and concat them together and them put them into a module. Thus, we ll have leaf-node separated parameters.
So it is not possible to modify nn.module leaf-node parameters?
Things like nn.Llinear, nn.Conv2D once created cannot be separated and trained later?