That’s also a good idea. You can save the state_dict and reload it after your experiment. Have a look at the Serialization Semantics 102.
You use the weights_init function just by calling model.apply(weights_init). This will use every submodule to call the function.