Please note I cannot update paramerters like this as I said, I compute this parameter based on 1 shared parameter and that shared param is the only param
model.weight = nn.Parameter(torch.cat((model.weight, torch.randn(10, 1)), 1))