We recently merged https://github.com/pytorch/pytorch/pull/29832 2 which adds reset_parameters() method to nn::Linear module, and it will be available in the nightly build tomorrow or in the upcoming 1.4 release.