Solved by ptrblck in post #2 
              
              
                If you don’t apply any constraints on the parameters, they are not necessarily in the range [-1, 1]. 
E.g. nn.Linear layers are randomly initialized using this method and thus the initial range might be smaller.