<p>Yes, it is because they are estimated jointly and the point estimates are conditional on other point estimates and also because of omitted variable bias. To be more specific, contrast an example of  univariate OLS with bivariate OLS, both of which are estimated by minimizing the sum of squared residuals, but resulting formulas for estimated coefficients are different.</p>
<p>In univariate OLS by minimizing squared residuals we get</p>
<p><span class="math-container">$$\min_{b_0,b_1}\sum e^2 = \sum (y_i-b_0-b_1x_{1i})^2 \implies \hat{b_1} = \frac{\sum (x_{1i}-\bar{x_1})(y_i-\bar{y})}{\sum (x_{1i}-\bar{x_1})^2}$$</span></p>
<p>In a bivariate regression the result will be different</p>
<p><span class="math-container">$$\min_{b_0,b_1, b_2}\sum e^2 = \sum (y_i-b_0-b_1x_{1i}-b_2x_{2i})^2 \implies \hat{b_1} = \frac{\sum (x_{2i}-\bar{x_2})^2\sum (x_{1i}-\bar{x_1})(y_i-\bar{y})- \sum  (x_{1i}-\bar{x_1})(x_{2i}-\bar{x_2})\sum  (x_{2i}-\bar{x_2})(y_i-\bar{y})}{\sum (x_{1i}-\bar{x_1})^2 \sum (x_{2i}-\bar{x_2})^2- \sum  (x_{1i}-\bar{x_1})(x_{2i}-\bar{x_2})}$$</span></p>
<p>Hence we can see that the difference is that in the second expression the calculation of <span class="math-container">$b_1$</span> critically depends on what the covariance of <span class="math-container">$x_1$</span> and <span class="math-container">$x_2$</span> is (i.e. <span class="math-container">$\sum  (x_{1i}-\bar{x_1})(x_{2i}-\bar{x_2})$</span>), what variance of <span class="math-container">$x_2$</span> is (i.e. <span class="math-container">$\sum (x_{2i}-\bar{x_2})^2$</span> and also what covariance of <span class="math-container">$x_2$</span> and <span class="math-container">$y$</span> is (i.e. <span class="math-container">$\sum  (x_{2i}-\bar{x_2})(y_i-\bar{y})$</span>) and hence <span class="math-container">$\hat{b_1}$</span>, hence including additional variable will change the <span class="math-container">$b_1$</span> (and also other coefficient) formula. This will extend to multiple variables as well with formula getting progressively more complex.</p>
<p>Moreover, the coefficients will change substantially especially if there is some omitted variable bias present. If we assume that the true model is given by:</p>
<p><span class="math-container">$$y= \beta_0 + \beta_1 x_1 +\beta_2 x_2 + u$$</span></p>
<p>but you will try to fit univariate model regardless of the above.</p>
<p><span class="math-container">$$\hat{y} = \hat{\beta_0} + \hat{\beta_1} x_1$$</span></p>
<p>In such conditions it can be shown that even though we fit univariate regression the <em>expected</em> estimated beta will be (see Wooldridge Introduction to Econometrics):</p>
<p><span class="math-container">$$E[\hat{\beta_1}]= \beta_1 + \beta_2 \frac{\sum  (x_{1i}-\bar{x_1})(x_{2i}-\bar{x_2})}{\sum (x_{1i}-\bar{x_1})^2}$$</span></p>
<p>Where the second term is the omitted variable bias. The intuition here is that if there is any covariance between <span class="math-container">$x_1$</span> and <span class="math-container">$x_2$</span> and if <span class="math-container">$y$</span>  actually depends also on  <span class="math-container">$x_2$</span> (i.e. <span class="math-container">$\beta_2 \neq 0$</span>) then if you apply univariate regression on bivariate relationship the estimate of <span class="math-container">$\beta_1$</span> will be biased as it partially captures the relationship of <span class="math-container">$y$</span> and <span class="math-container">$x_2$</span>. For example,  if <span class="math-container">$\beta_1=0.1$</span>, <span class="math-container">$\beta_2= -2$</span> and <span class="math-container">$cov(x_1,x_2)=0.5$</span> and <span class="math-container">$var(x_1)=2$</span> then if you estimate univariate regression the estimated <span class="math-container">$\hat{beta_1} = -0.4$</span> whereas in bivariate regression it would be <span class="math-container">$\hat{\beta_1}=0.1$</span> and <span class="math-container">$\hat{\beta_2}=-2$</span></p>
<p>Hence to sum up, the coefficients are different because they are in multivariate regression calculated conditional on other coefficients and also if you are omitting an relevant independent variable its effect will be 'hidden' in the estimates of non-omitted variable (if they are correlated).</p>

CC BY-SA 4.0
2020-08-10T06:19:30.533Z
Thank you so much for your response! It was very clear.
If I could also ask a follow-up question based on your response, that would be extremely helpful. 
In the second column of my regression results, the first new variable added is a 'female dummy variable'. The other variable from the first column increased in value though. I would have expected a parameter estimate of a given variable to decrease if a dummy variable was added. Am I misunderstanding something?
Esther Blaese
CC BY-SA 4.0
2020-08-10T11:06:39.753Z
@EstherBlaese you are welcome. Yes this can happen for example the hidden effect of omitted variable can be negative but if also the covariace between first and second variable is negative the two minuses cancel each other out. For example, if true b_1=2 true b_2 =-1, cov(x1,x2)=-1, and var(x1)=1 the estimated b_1 with omitting second variable would become 3. This is why omitted variable bias is so nasty - it messes with your estimates in unexpected and unintuitive ways
1muflon1
CC BY-SA 4.0
2020-08-13T09:44:15.827Z
@EstherBlaese yes you can say that
1muflon1
CC BY-SA 4.0
2020-08-07T10:59:23.627Z
2020-08-07T14:16:40.570Z
2020-08-07T14:16:40.570Z
1muflon1
<p>I have a set of results from a multiple regression table with four columns. In each column, a new variable is added. Why, however, is the initial variable coefficient different in each column? Is it due to the coefficients being jointly estimated?</p>

<econometrics>
Why does the same parameter estimate change in multiple regressions?
Esther Blaese
# Why does the same parameter estimate change in multiple regressions?

(Asked by: username_0 on 2020-08-07)

I have a set of results from a multiple regression table with four columns. In each column, a new variable is added. Why, however, is the initial variable coefficient different in each column? Is it due to the coefficients being jointly estimated?

**Tags:** econometrics


---

## 1 answers

### Answer by username_1 on 2020-08-07. Score: 2 | Accepted answer

Yes, it is because they are estimated jointly and the point estimates are conditional on other point estimates and also because of omitted variable bias. To be more specific, contrast an example of univariate OLS with bivariate OLS, both of which are estimated by minimizing the sum of squared residuals, but resulting formulas for estimated coefficients are different.

In univariate OLS by minimizing squared residuals we get

$$\min\_{b\_0,b\_1}\sum e^2 = \sum (y\_i-b\_0-b\_1x\_{1i})^2 \implies \hat{b\_1} = \frac{\sum (x\_{1i}-\bar{x\_1})(y\_i-\bar{y})}{\sum (x\_{1i}-\bar{x\_1})^2}$$

In a bivariate regression the result will be different

$$\min\_{b\_0,b\_1, b\_2}\sum e^2 = \sum (y\_i-b\_0-b\_1x\_{1i}-b\_2x\_{2i})^2 \implies \hat{b\_1} = \frac{\sum (x\_{2i}-\bar{x\_2})^2\sum (x\_{1i}-\bar{x\_1})(y\_i-\bar{y})- \sum (x\_{1i}-\bar{x\_1})(x\_{2i}-\bar{x\_2})\sum (x\_{2i}-\bar{x\_2})(y\_i-\bar{y})}{\sum (x\_{1i}-\bar{x\_1})^2 \sum (x\_{2i}-\bar{x\_2})^2- \sum (x\_{1i}-\bar{x\_1})(x\_{2i}-\bar{x\_2})}$$

Hence we can see that the difference is that in the second expression the calculation of $b\_1$ critically depends on what the covariance of $x\_1$ and $x\_2$ is (i.e. $\sum (x\_{1i}-\bar{x\_1})(x\_{2i}-\bar{x\_2})$), what variance of $x\_2$ is (i.e. $\sum (x\_{2i}-\bar{x\_2})^2$ and also what covariance of $x\_2$ and $y$ is (i.e. $\sum (x\_{2i}-\bar{x\_2})(y\_i-\bar{y})$) and hence $\hat{b\_1}$, hence including additional variable will change the $b\_1$ (and also other coefficient) formula. This will extend to multiple variables as well with formula getting progressively more complex.

Moreover, the coefficients will change substantially especially if there is some omitted variable bias present. If we assume that the true model is given by:

$$y= \beta\_0 + \beta\_1 x\_1 +\beta\_2 x\_2 + u$$

but you will try to fit univariate model regardless of the above.

$$\hat{y} = \hat{\beta\_0} + \hat{\beta\_1} x\_1$$

In such conditions it can be shown that even though we fit univariate regression the *expected* estimated beta will be (see Wooldridge Introduction to Econometrics):

$$E[\hat{\beta\_1}]= \beta\_1 + \beta\_2 \frac{\sum (x\_{1i}-\bar{x\_1})(x\_{2i}-\bar{x\_2})}{\sum (x\_{1i}-\bar{x\_1})^2}$$

Where the second term is the omitted variable bias. The intuition here is that if there is any covariance between $x\_1$ and $x\_2$ and if $y$ actually depends also on $x\_2$ (i.e. $\beta\_2 \neq 0$) then if you apply univariate regression on bivariate relationship the estimate of $\beta\_1$ will be biased as it partially captures the relationship of $y$ and $x\_2$. For example, if $\beta\_1=0.1$, $\beta\_2= -2$ and $cov(x\_1,x\_2)=0.5$ and $var(x\_1)=2$ then if you estimate univariate regression the estimated $\hat{beta\_1} = -0.4$ whereas in bivariate regression it would be $\hat{\beta\_1}=0.1$ and $\hat{\beta\_2}=-2$

Hence to sum up, the coefficients are different because they are in multivariate regression calculated conditional on other coefficients and also if you are omitting an relevant independent variable its effect will be 'hidden' in the estimates of non-omitted variable (if they are correlated).

> **Comments:**
> **username_0**: Thank you so much for your response! It was very clear. If I could also ask a follow-up question based on your response, that would be extremely helpful.  In the second column of my regression results, the first new variable added is a 'female dummy variable'. The other variable from the first column increased in value though. I would have expected a parameter estimate of a given variable to decrease if a dummy variable was added. Am I misunderstanding something?  
> **username_1**: @username_0 you are welcome. Yes this can happen for example the hidden effect of omitted variable can be negative but if also the covariace between first and second variable is negative the two minuses cancel each other out. For example, if true b_1=2 true b_2 =-1, cov(x1,x2)=-1, and var(x1)=1 the estimated b_1 with omitting second variable would become 3. This is why omitted variable bias is so nasty - it messes with your estimates in unexpected and unintuitive ways  
> **username_1**: @username_0 yes you can say that  

---

