If in Keras it was specified kernels initialization with He normal, in PyTorch I initialized the corresponding kernels with kaiming normal. Otherwise I used Xavier initialization in PyTorch in order to emulate default Keras initialization.
I also initialized all the biases to zero because, if I’m not wrong, it is Keras default initialization.