For what I see pytorch initializes every weight in the sequence layers with a normal distribution, I dont know how biases are initialized.
Can someone tell me how to proper initialize one of this layers, such as GRU? I am looking for the same initialization that keras uses: zeros for the biases, xavier_uniform for the input weights, orthogonal for the recurrent weights.
Thanks in advance!