Machine Learning, Artificial Intelligence, Neural Networks, Data Science, Towards Data Science.
Alternatively, the popular Xavier initialization uses the following parameters for its uniform distribution. Xavier initialization is derived considering that the network consists of matrix multiplications with no nonlinearites, and seems to perform well in practice. For a full list of weight