Following up on this question, I see that the model I am migrating from TensorFlow uses get_variable to intiazliae network biases
hidden_bias = tf.get_variable("hidden_bias_{}".format(i), [hidden_size])
So I assumed I can use torch.nn.init.xavier_uniform_ to init network bias in Torch too
torch.nn.init.xavier_uniform_(self.input.bias) but I got that error
Fan in and fan out can not be computed for tensor with less than 2 dimensions
Any idea how to mimic the same init as TensorFlow for biases