I don’t know how the architecture of the linear regression model looks like, but in case it’s using non-linear activation functions you wouldn’t be able to squeeze this model into a single linear layer.
Otherwise I would assume that training a single linear layer would also work for your use case.