Solved by ptrblck in post #20 
              
              
                Yes, weight initialization is one crucial step in training a network from scratch. 
PyTorch has a lot of different init functions. 
E.g. one popular method for conv layers is xavier_uniform. Depending on your architecture, different weight inits might speed up training of even make it possible. 
Hav…