I’m wondering why all Keras layers use Glorot initialization as default. Since Relu is the most popular activation function, shouldn’t He be the default initialization?
The prebuilt application models such as ResNet50, also use Glorot initialization as default and there is no parameter to pass and modify it.