Look like nn.Linear is initialized by U[-k, k], so its output is always forced to U[-k, k]. I don’t know it is good or not.
However seem as it’s how initialize weights good for model. I only ask about your experiences about how to initialize weights for linear layers.