Solved by Nikronic in post #3 
              
              
                Hi, 
I think the motivation has been explained in the link @harsha_g has referenced. But for more clarification, I have also explained how to get the values especially sqrt(5) in this post: Clarity on default initialization in pytorch 
But if I want to summarize, both do the same thing but older ver…