Yes, weight initialization is one crucial step in training a network from scratch.
PyTorch has a lot of different init functions 16.
E.g. one popular method for conv layers is xavier_uniform. Depending on your architecture, different weight inits might speed up training of even make it possible.
Have a look at the weight init section in CS231n 12.