Maybe I didn’t make my question clear. I have understood the operation of Kaiming initialization. What I don’t understand is why when i use ReLu as the activation function , the full connection layer uses the default scheme: init.kaiming_uniform_(self.weight, a=math.sqrt(5))to initialize its weights, which is different from its docs and l have check its resnet.py(vision/resnet.py at 146dd8556c4f3b2ad21fad9312f4602cd049d6da · pytorch/vision · GitHub), in which ReLu is used as activation function, but FC is initialied by deauflt, too.
I think the initialization parameter a should be set to 0 when ReLu is used as activation function, but now it is sqrt(5),which shoulid be used in LeakyReLU.