<p>Think about a regression where you have two factors. Normally when you have a constant in the regression you would put one level of each factor to 0 as a reference level. Leaving out the constant you have two factors and put one reference level to 0 for one of these.</p>
<p>The situation is similar here in the sense that you have firm and individual level fixed effects, each being factors with usually many levels and what is needed is a reference level within each connected firm-employee group. What is new is the connectedness.</p>
<p>In practice lets assume that you are studying employment for a given country made up geographically of two Islands. All workers on one Island only ever works for firms on that Island, but changing between these firms. Workers on the other Island only work for firms on that Island, again changing between these firms. Each Island defines a group of workers and firms with no worker in one group ever working for any firm in the other group.</p>
<p>Within each group you can compare the difference between working for one firm versus another as well as the efefct of one individual relative to another. But because no worker ever change from a firm on one Island to another you cannot compare the fixed effects across groups.</p>
<p><strong>Definition (Connected)</strong> A firm-employee group is  connected,  when the  group  contains  all  the  workers  who  ever  worked  for  any  of  the  firms  in  the group and all the firms at which any of the workers were ever employed.</p>
<p>The text you link to have the algorithm needed to find these groups in a given employer/employee matched data set.</p>
<p>In practice you have to find these groups and set one  firm or employee fixed effect equal to 0 within each group. Doing that insures identification of firm and worker fixed effects as well as standard beta/parameters, by insuring full rank of the matrix defining normal equation is of full rank and the solution for the parameter vector is unique.</p>
<p>However, in R using lfe package there is an automatic check for this and it will define reference levels for you. I do not know about stata but I guess it is the same.</p>

CC BY-SA 4.0
2021-01-26T09:32:15.417Z
Thanks. This is useful but what I'm looking for is a formal, analytical proof that can complete mine. The narrative you provide is important but insufficient to complete my proof.
Star
CC BY-SA 4.0
2021-01-26T11:56:24.287Z
Fair enough. However, if that is the case it may be a good idea to say what about the proof - starting on page 10 of the note you link to - you need help in understanding.
Jesper Hybel
CC BY-SA 4.0
2021-01-26T12:25:12.023Z
Thanks. I have added details. Could you advise?
Star
CC BY-SA 4.0
2021-01-25T22:52:07.733Z
2021-01-25T22:52:07.733Z
Jesper Hybel
<p>Consider <a href="https://onlinelibrary.wiley.com/doi/10.1111/1468-0262.00020" rel="nofollow noreferrer">the traditional AKM model</a>
where
<span class="math-container">$$
Y_{it}=X_{it}\beta+\psi_{j(i,t)}+\epsilon_{it}
$$</span>
for <span class="math-container">$i=1,...,N$</span> (individual index), <span class="math-container">$t=1,...,T$</span> (time index), <span class="math-container">$j=1,...,J$</span> (firm index), and <span class="math-container">$j(i,t)$</span> is the firm employing worker <span class="math-container">$i$</span> at time <span class="math-container">$t$</span>. For simplicity, I have ignored workers'  fixed effects. <span class="math-container">$\psi_{j(i,t)}$</span> is called firm <span class="math-container">$j(i,t)$</span>'s fixed effect.</p>
<p>By stacking observations over time, the equation above can be rewritten as
<span class="math-container">$$
\underbrace{Y_i}_{T\times 1}=\underbrace{X_i}_{T\times K} \underbrace{\beta}_{K\times 1}+\underbrace{F_i}_{T\times J} \underbrace{\psi}_{J\times 1}+\underbrace{\epsilon_i}_{T\times 1}
$$</span>
where the <span class="math-container">$F(t,j)$</span> is <span class="math-container">$1$</span> if worker <span class="math-container">$i$</span> was employed at firm <span class="math-container">$j$</span> in period <span class="math-container">$t$</span>.</p>
<p>Assume that:</p>
<p><strong>[A1]</strong> We have a sample of observations <span class="math-container">$\{Y_i, X_i, F_i\}_{i=1}^N$</span> i.i.d., for <span class="math-container">$N$</span> large and <span class="math-container">$T$</span> small.</p>
<p><strong>[A2]</strong> <span class="math-container">$E(\epsilon_i| X_i, F_i)=0$</span> for each <span class="math-container">$i=1,...,N$</span>.</p>
<p>I would like to show how <span class="math-container">$\beta$</span> and <span class="math-container">$\psi$</span> are identified. I could not find any &quot;understandable and organic&quot; identification proof. Could you suggest one? I report here what I understood from reading/combining different sources.</p>
<hr />
<p><strong>My identification attempt (incomplete)</strong></p>
<p><strong>Step 1:</strong> By <strong>[A2]</strong>, we have that</p>
<p><span class="math-container">$$
\begin{pmatrix}
E(X_i' Y_i)\\
E(F_i' Y_i)\\
\end{pmatrix}=\begin{pmatrix}
E(X_i' X_i) &amp; E(X_i' F_i)\\
E(F_i' X_i) &amp; E(F_i' F_i)\\
\end{pmatrix} \begin{pmatrix}
\beta\\
\psi
\end{pmatrix}
$$</span></p>
<p><strong>Step 2:</strong> By <strong>[A1]</strong>, the matrices <span class="math-container">$\begin{pmatrix}
E(X_i' Y_i)\\
E(F_i' Y_i)\\
\end{pmatrix}$</span> and <span class="math-container">$\begin{pmatrix}
E(X_i' X_i) &amp; E(X_i' F_i)\\
E(F_i' X_i) &amp; E(F_i' F_i)\\
\end{pmatrix} $</span> are consistently estimable from sample analogues. Hence, they can be treated as known in the identification exercise.</p>
<p><strong>Step 3:</strong> By combining steps 2-3, it follows that if  <span class="math-container">$A_{pop}\equiv \begin{pmatrix}
E(X_i' X_i) &amp; E(X_i' F_i)\\
E(F_i' X_i) &amp; E(F_i' F_i)\\
\end{pmatrix} $</span> is invertible, then <span class="math-container">$\beta$</span> and <span class="math-container">$\psi$</span> are identified.</p>
<p><strong>Step 4:</strong> Under which conditions is <span class="math-container">$A_{pop}$</span> invertible?</p>
<p>My understanding is that, instead of answering this question, Abowd, Kramarz, and Margolis provide <strong>necessary and sufficient conditions</strong> under which <strong>the sample analogue</strong> of the equation in Step 1 has a unique solution with respect to <span class="math-container">$(\beta,\psi)$</span>. That is, they provide conditions under which
<span class="math-container">$$
\begin{pmatrix}
X'Y\\
F' Y\\
\end{pmatrix}=\begin{pmatrix}
X'X &amp; X'F\\
F' X &amp; F'F\\
\end{pmatrix}\begin{pmatrix}
\beta\\
\psi
\end{pmatrix}
$$</span> has a unique solution with respect to <span class="math-container">$(\beta,\psi)$</span> where <span class="math-container">$Y$</span>, <span class="math-container">$X$</span>, and <span class="math-container">$F$</span> stack <span class="math-container">$Y_i$</span>, <span class="math-container">$X_i$</span> and <span class="math-container">$F_i$</span> over individuals. I suppose that, by law of large numbers, if the sample analogue has a unique solution, then also the population equation will have a unique solution.</p>
<p><strong>Step 5:</strong> Consider separating the sample in <span class="math-container">$G$</span> groups satisfying the connectivity requirement discussed <a href="https://www2.census.gov/ces/tp/tp-2002-06.pdf" rel="nofollow noreferrer">here</a>.</p>
<p>Suppose, for simplicity, that <span class="math-container">$J=5$</span>, <span class="math-container">$T=2$</span>, <span class="math-container">$N=5$</span>. Also suppose that worker 1 is employed at firm 1 in period 1 and at firm 2 in period 2; worker 2 is always employed at firm 1; worker 3 is employed at firm 3 in period 1 and at firm 2 in period 2;  worker 4 is always employed at firm 3; worker 5 is employed at firm 5 in period 1 and at firm 4 in period 2.
Hence, <span class="math-container">$G=2$</span>. In group 1, there are firms 1,2,3. In group 2, there are firms 4,5. This is the example discussed in Figure 1 <a href="https://www2.census.gov/ces/tp/tp-2002-06.pdf" rel="nofollow noreferrer">here</a>.</p>
<p>In turn, the sample analogue of the equation in Step 1 when rearranging as discussed at p.5 of <a href="https://www2.census.gov/ces/tp/tp-2002-06.pdf" rel="nofollow noreferrer">here</a> is
<span class="math-container">$$
\text{[Equation $(*)$]} \hspace{1cm}\begin{pmatrix}
X'Y\\
F_1' Y\\
F_2' Y
\end{pmatrix}=\underbrace{\begin{pmatrix}
X'X &amp; X'F_1 &amp; X' F_2\\
F_1' X &amp; F_1'F_1 &amp; 0_{3\times 2}\\
F_2' X &amp; 0_{2\times 3} &amp; F_2' F_2
\end{pmatrix}}_{A_{sample}}\begin{pmatrix}
\beta\\
\psi\\
\end{pmatrix}
$$</span>
where
<span class="math-container">$$
F_1'F_1\equiv \begin{pmatrix}
3&amp;0 &amp; 0\\
0 &amp; 2 &amp; 0\\
0 &amp; 0 &amp; 3
\end{pmatrix}, F_2' F_2\equiv \begin{pmatrix}
1 &amp; 0\\
0 &amp; 1
\end{pmatrix}$$</span></p>
<p>From this point I'm lost. In particular,</p>
<p>(1) The authors tell us that Equation <span class="math-container">$(*)$</span> has a unique solution with respect to <span class="math-container">$(\beta,\psi)$</span> <strong>if and only if</strong> one among <span class="math-container">$\{\psi_1,\psi_2,\psi_3\}$</span> and one among <span class="math-container">$\{\psi_4,\psi_5\}$</span> are set equal to a known value (for example, <span class="math-container">$\psi_3=0$</span> and <span class="math-container">$\psi_4=0$</span>). Could you help me to <strong>formally</strong> show this claim? In particular, I want to show both necessity <strong>and</strong> sufficiency.</p>
<p>If I look at the example above, I don't see why we need such normalisation.</p>
<p>I do understand that there cannot be an intercept term in <span class="math-container">$X$</span> in order to identify <span class="math-container">$\psi$</span>. For simplicity, let us suppose that there is no <span class="math-container">$X$</span> at all.</p>
<p>Then, Equation <span class="math-container">$(*)$</span> reduces to the system
<span class="math-container">$$
\begin{cases}
Y_{11}+Y_{21}+Y_{22}=3\psi_1\\
Y_{12}+Y_{32}=2\psi_2\\
Y_{31}+Y_{41}+Y_{42}=3\psi_3\\
Y_{51}=\psi_4\\
Y_{52}=\psi_5\\
\end{cases}
$$</span>
that has a unique solution with respect to <span class="math-container">$\psi$</span> without the need of further normalising.</p>
<p>(2) Why, at p.10 of <a href="https://www2.census.gov/ces/tp/tp-2002-06.pdf" rel="nofollow noreferrer">here</a>, the authors go back to &quot;expected values&quot; rather than working with &quot;sample means&quot;, given that we are concerned about uniqueness of solution of Equation <span class="math-container">$(*)$</span>?</p>

CC BY-SA 4.0
2021-01-26T17:39:03.827Z
You are confusing yourself because you fail to include individual fixed effects. Consider wage equations for individual $i=5$: First time period $Ey_{i1} = \phi_4 + \mu_5$ and second time period $Ey_{i2} = \phi_5 + \mu_5$. Two linear equations with 3 unknowns NOT IDENTIFIED. Set $\phi_4=0$ then wage at first firm identifies individual fixed effect and the difference the firm effect $\phi_5$. Intuition: When you include individual fixed effect you need moovers between firms for identification. Seperated groups exists when there are no moovers to connect them.
Jesper Hybel
CC BY-SA 4.0
2021-01-26T19:33:14.683Z
Thank you. Your comment was very useful. I realised that, without worker fixed effects, avoiding a constant term allows us to identify the firm fixed effects.  If we also have worker fixed effects, avoiding the constant is NOT SUFFICIENT anymore for identification. In the presence of BOTH worker and firm fixed effects, normalising one fixed effect within each group and avoiding the intercept allows us to identify worker and firm fixed effects.
Star
CC BY-SA 4.0
2021-01-26T19:53:16.627Z
May I ask you a last clarification: suppose we have covariates and we also want to identify $\beta$ (without intercept).  Are the normalisations described above still SUFFICIENT to identify the firm and worker fixed effects?  I think the answer is "NO" because the equations will now also contain $\beta$. Are the normalisations described above still NECESSARY to identify the firm and worker fixed effects? I think the answer is "YES". What do you think?
Star
<fixed-effects><identification><matching>
Identification of firm-worker fixed effect wage equation
Star
# Identification of firm-worker fixed effect wage equation

(Asked by: username_0 on 2021-01-25)

Consider [the traditional AKM model](https://onlinelibrary.wiley.com/doi/10.1111/1468-0262.00020)
where
$$
Y\_{it}=X\_{it}\beta+\psi\_{j(i,t)}+\epsilon\_{it}
$$
for $i=1,...,N$ (individual index), $t=1,...,T$ (time index), $j=1,...,J$ (firm index), and $j(i,t)$ is the firm employing worker $i$ at time $t$. For simplicity, I have ignored workers' fixed effects. $\psi\_{j(i,t)}$ is called firm $j(i,t)$'s fixed effect.

By stacking observations over time, the equation above can be rewritten as
$$
\underbrace{Y\_i}\_{T\times 1}=\underbrace{X\_i}\_{T\times K} \underbrace{\beta}\_{K\times 1}+\underbrace{F\_i}\_{T\times J} \underbrace{\psi}\_{J\times 1}+\underbrace{\epsilon\_i}\_{T\times 1}
$$
where the $F(t,j)$ is $1$ if worker $i$ was employed at firm $j$ in period $t$.

Assume that:

**[A1]** We have a sample of observations $\{Y\_i, X\_i, F\_i\}\_{i=1}^N$ i.i.d., for $N$ large and $T$ small.

**[A2]** $E(\epsilon\_i| X\_i, F\_i)=0$ for each $i=1,...,N$.

I would like to show how $\beta$ and $\psi$ are identified. I could not find any "understandable and organic" identification proof. Could you suggest one? I report here what I understood from reading/combining different sources.

---

**My identification attempt (incomplete)**

**Step 1:** By **[A2]**, we have that

$$
\begin{pmatrix}
E(X\_i' Y\_i)\\
E(F\_i' Y\_i)\\
\end{pmatrix}=\begin{pmatrix}
E(X\_i' X\_i) & E(X\_i' F\_i)\\
E(F\_i' X\_i) & E(F\_i' F\_i)\\
\end{pmatrix} \begin{pmatrix}
\beta\\
\psi
\end{pmatrix}
$$

**Step 2:** By **[A1]**, the matrices $\begin{pmatrix}
E(X\_i' Y\_i)\\
E(F\_i' Y\_i)\\
\end{pmatrix}$ and $\begin{pmatrix}
E(X\_i' X\_i) & E(X\_i' F\_i)\\
E(F\_i' X\_i) & E(F\_i' F\_i)\\
\end{pmatrix} $ are consistently estimable from sample analogues. Hence, they can be treated as known in the identification exercise.

**Step 3:** By combining steps 2-3, it follows that if $A\_{pop}\equiv \begin{pmatrix}
E(X\_i' X\_i) & E(X\_i' F\_i)\\
E(F\_i' X\_i) & E(F\_i' F\_i)\\
\end{pmatrix} $ is invertible, then $\beta$ and $\psi$ are identified.

**Step 4:** Under which conditions is $A\_{pop}$ invertible?

My understanding is that, instead of answering this question, Abowd, Kramarz, and Margolis provide **necessary and sufficient conditions** under which **the sample analogue** of the equation in Step 1 has a unique solution with respect to $(\beta,\psi)$. That is, they provide conditions under which
$$
\begin{pmatrix}
X'Y\\
F' Y\\
\end{pmatrix}=\begin{pmatrix}
X'X & X'F\\
F' X & F'F\\
\end{pmatrix}\begin{pmatrix}
\beta\\
\psi
\end{pmatrix}
$$ has a unique solution with respect to $(\beta,\psi)$ where $Y$, $X$, and $F$ stack $Y\_i$, $X\_i$ and $F\_i$ over individuals. I suppose that, by law of large numbers, if the sample analogue has a unique solution, then also the population equation will have a unique solution.

**Step 5:** Consider separating the sample in $G$ groups satisfying the connectivity requirement discussed [here](https://www2.census.gov/ces/tp/tp-2002-06.pdf).

Suppose, for simplicity, that $J=5$, $T=2$, $N=5$. Also suppose that worker 1 is employed at firm 1 in period 1 and at firm 2 in period 2; worker 2 is always employed at firm 1; worker 3 is employed at firm 3 in period 1 and at firm 2 in period 2; worker 4 is always employed at firm 3; worker 5 is employed at firm 5 in period 1 and at firm 4 in period 2.
Hence, $G=2$. In group 1, there are firms 1,2,3. In group 2, there are firms 4,5. This is the example discussed in Figure 1 [here](https://www2.census.gov/ces/tp/tp-2002-06.pdf).

In turn, the sample analogue of the equation in Step 1 when rearranging as discussed at p.5 of [here](https://www2.census.gov/ces/tp/tp-2002-06.pdf) is
$$
\text{[Equation $(\*)$]} \hspace{1cm}\begin{pmatrix}
X'Y\\
F\_1' Y\\
F\_2' Y
\end{pmatrix}=\underbrace{\begin{pmatrix}
X'X & X'F\_1 & X' F\_2\\
F\_1' X & F\_1'F\_1 & 0\_{3\times 2}\\
F\_2' X & 0\_{2\times 3} & F\_2' F\_2
\end{pmatrix}}\_{A\_{sample}}\begin{pmatrix}
\beta\\
\psi\\
\end{pmatrix}
$$
where
$$
F\_1'F\_1\equiv \begin{pmatrix}
3&0 & 0\\
0 & 2 & 0\\
0 & 0 & 3
\end{pmatrix}, F\_2' F\_2\equiv \begin{pmatrix}
1 & 0\\
0 & 1
\end{pmatrix}$$

From this point I'm lost. In particular,

(1) The authors tell us that Equation $(\*)$ has a unique solution with respect to $(\beta,\psi)$ **if and only if** one among $\{\psi\_1,\psi\_2,\psi\_3\}$ and one among $\{\psi\_4,\psi\_5\}$ are set equal to a known value (for example, $\psi\_3=0$ and $\psi\_4=0$). Could you help me to **formally** show this claim? In particular, I want to show both necessity **and** sufficiency.

If I look at the example above, I don't see why we need such normalisation.

I do understand that there cannot be an intercept term in $X$ in order to identify $\psi$. For simplicity, let us suppose that there is no $X$ at all.

Then, Equation $(\*)$ reduces to the system
$$
\begin{cases}
Y\_{11}+Y\_{21}+Y\_{22}=3\psi\_1\\
Y\_{12}+Y\_{32}=2\psi\_2\\
Y\_{31}+Y\_{41}+Y\_{42}=3\psi\_3\\
Y\_{51}=\psi\_4\\
Y\_{52}=\psi\_5\\
\end{cases}
$$
that has a unique solution with respect to $\psi$ without the need of further normalising.

(2) Why, at p.10 of [here](https://www2.census.gov/ces/tp/tp-2002-06.pdf), the authors go back to "expected values" rather than working with "sample means", given that we are concerned about uniqueness of solution of Equation $(\*)$?

**Tags:** fixed-effects, identification, matching

> **Comments:**
> **username_1**: You are confusing yourself because you fail to include individual fixed effects. Consider wage equations for individual $i=5$: First time period $Ey_{i1} = \phi_4 + \mu_5$ and second time period $Ey_{i2} = \phi_5 + \mu_5$. Two linear equations with 3 unknowns NOT IDENTIFIED. Set $\phi_4=0$ then wage at first firm identifies individual fixed effect and the difference the firm effect $\phi_5$. Intuition: When you include individual fixed effect you need moovers between firms for identification. Seperated groups exists when there are no moovers to connect them.  
> **username_0**: Thank you. Your comment was very useful. I realised that, without worker fixed effects, avoiding a constant term allows us to identify the firm fixed effects.  If we also have worker fixed effects, avoiding the constant is NOT SUFFICIENT anymore for identification. In the presence of BOTH worker and firm fixed effects, normalising one fixed effect within each group and avoiding the intercept allows us to identify worker and firm fixed effects.  
> **username_0**: May I ask you a last clarification: suppose we have covariates and we also want to identify $\beta$ (without intercept).  Are the normalisations described above still SUFFICIENT to identify the firm and worker fixed effects?  I think the answer is "NO" because the equations will now also contain $\beta$. Are the normalisations described above still NECESSARY to identify the firm and worker fixed effects? I think the answer is "YES". What do you think?  

---

## 1 answers

### Answer by username_1 on 2021-01-25. Score: 4 | Accepted answer

Think about a regression where you have two factors. Normally when you have a constant in the regression you would put one level of each factor to 0 as a reference level. Leaving out the constant you have two factors and put one reference level to 0 for one of these.

The situation is similar here in the sense that you have firm and individual level fixed effects, each being factors with usually many levels and what is needed is a reference level within each connected firm-employee group. What is new is the connectedness.

In practice lets assume that you are studying employment for a given country made up geographically of two Islands. All workers on one Island only ever works for firms on that Island, but changing between these firms. Workers on the other Island only work for firms on that Island, again changing between these firms. Each Island defines a group of workers and firms with no worker in one group ever working for any firm in the other group.

Within each group you can compare the difference between working for one firm versus another as well as the efefct of one individual relative to another. But because no worker ever change from a firm on one Island to another you cannot compare the fixed effects across groups.

**Definition (Connected)** A firm-employee group is connected, when the group contains all the workers who ever worked for any of the firms in the group and all the firms at which any of the workers were ever employed.

The text you link to have the algorithm needed to find these groups in a given employer/employee matched data set.

In practice you have to find these groups and set one firm or employee fixed effect equal to 0 within each group. Doing that insures identification of firm and worker fixed effects as well as standard beta/parameters, by insuring full rank of the matrix defining normal equation is of full rank and the solution for the parameter vector is unique.

However, in R using lfe package there is an automatic check for this and it will define reference levels for you. I do not know about stata but I guess it is the same.

> **Comments:**
> **username_0**: Thanks. This is useful but what I'm looking for is a formal, analytical proof that can complete mine. The narrative you provide is important but insufficient to complete my proof.  
> **username_1**: Fair enough. However, if that is the case it may be a good idea to say what about the proof - starting on page 10 of the note you link to - you need help in understanding.  
> **username_0**: Thanks. I have added details. Could you advise?  

---

