You could use a method from torch.nn.init 4 and apply it on the parameters as e.g. seen here 9 and used here 4.
Alternatively, you could directly copy the desired initial values into the parameter by using:
with torch.no_grad():
    model.layer.weight.copy_(your_values)