You could create a function for initializing the weights of your model and apply it.
This might be a good starter:
def weights_init(m):
    if isinstance(m, nn.Linear):
    xavier(m.weight.data)
    xavier(m.bias.data)

model.apply(weight_init)

Note that cuDNN is not deterministic, so maybe you would like to deactivate it.