Thank you,
As you said, the following way of expanding the weights works:
with torch.no_grad():
    l1.weight = nn.Parameter(
        torch.cat(
            [
                l1.weight.data,
                torch.randn((1, 1))
            ],
            dim=1
        )
    )