<p>To answer the first part of your question, we do not need any more assumptions for the comparison of experiments (besides some measurability issues).</p>
<p>Before going on, I'll fix some notations to ones that are standard in the game theory  literature, and for the sake of my convenience.</p>
<p>An experiment (or informtion structure) is defined as a tuple <span class="math-container">$(S,\pi)$</span> for a given state space <span class="math-container">$\Omega$</span>,
where <span class="math-container">$S$</span> is the set of signals endowed with some appropriate <span class="math-container">$\sigma$</span>-algebra, and <span class="math-container">$$\pi: \Omega \rightarrow \Delta (S)$$</span> is a signal function, where <span class="math-container">$\pi(s|\omega)$</span> is the probability that <span class="math-container">$s$</span> is realized given state <span class="math-container">$\omega$</span>.
In your notation, <span class="math-container">$X$</span> would correspond to <span class="math-container">$S$</span>, and <span class="math-container">$P_{\theta}(x)=\pi(x|\theta)$</span>.</p>
<p>To state the Blackwell's Equivalence Theorem, we would need some more definitions.</p>
<p>An experiment <span class="math-container">$(S',\pi')$</span> is a <span class="math-container">$\textbf{garbling}$</span> of <span class="math-container">$(S,\pi)$</span> if there exists a map <span class="math-container">$g: S \rightarrow \Delta(S')$</span> such that
<span class="math-container">$$\pi'(s'|\omega)=\sum_{s'\in S'}g(s'|s)\pi(s|\omega)$$</span>
, or <span class="math-container">$$\pi'= g \circ \pi$$</span> where <span class="math-container">$\circ$</span> denotes the composition of two stochastic maps
Intuitively, a garbling function <span class="math-container">$g: S \rightarrow \Delta(S')$</span> can be thought as adding noise, and blurring the information generated from <span class="math-container">$\pi$</span>. Since
<span class="math-container">$g(s'|s)$</span> is the probability that the signal realization <span class="math-container">$s\in S$</span> is changed into signal realization <span class="math-container">$s'\in S'$</span>, <span class="math-container">$\pi'$</span> is a signal function that is more uncertain, and noisier than <span class="math-container">$\pi$</span>
When the state space and the signal space <span class="math-container">$S, S'$</span> is finite, one can use matrices to represent garbling.
Let <span class="math-container">$\pi_i(s_j)=\pi(s_j|\omega_i)$</span>. An experiment <span class="math-container">$(S,\pi)$</span> can be represented by a matrix
<span class="math-container">$$\Pi=\begin{pmatrix} \pi_1(s) \\ \pi_2(s) \\ ... \\ \pi_m(s) \end{pmatrix}$$</span>
Then, <span class="math-container">$(S',\pi')$</span> is a garbling of <span class="math-container">$(S,\pi)$</span> if there exists an <span class="math-container">$n \times n'$</span> stochastic matrix G such that <span class="math-container">$\Pi'=\Pi G$</span></p>
<p>Obviously, garbling is not a complete order, but a <span class="math-container">$\textit{partial}$</span> order. Many information strutures cannot be directly compared with each other.</p>
<p>We say that <span class="math-container">$(S,\pi)$</span> is <span class="math-container">$\textbf{more informative}$</span> than <span class="math-container">$(S',\pi')$</span> if for <span class="math-container">$\textit{any}$</span> finite <span class="math-container">$A$</span> and <span class="math-container">$u: A \times \Omega \rightarrow \mathbb{R}$</span>, the decision maker prefers <span class="math-container">$(S,\pi)$</span> over <span class="math-container">$(S',\pi')$</span>. This definition is very strong since it requires any decision maker to prefer <span class="math-container">$(S,\pi)$</span> over <span class="math-container">$(S',\pi')$</span></p>
<p>We say that a distribution of actions conditional on state, <span class="math-container">$\chi: \Omega \rightarrow \Delta(A)$</span> is <span class="math-container">$\textbf{feasible}$</span> under <span class="math-container">$(S,\pi)$</span> if there exists DM's strategy <span class="math-container">$\sigma: S \rightarrow \Delta(A)$</span> such that <span class="math-container">$\chi=\sigma \circ \pi$</span>. In other words, <span class="math-container">$\chi$</span> is feasible if one can construct a behavioral strategy <span class="math-container">$\sigma$</span> as a function only of signal realizations, and the resulting action distribution <span class="math-container">$\sigma \circ \pi$</span> is <span class="math-container">$\chi$</span>. The set of feasible distribution of actions is equal to the DM's choice set.</p>
<p>Also, fix some prior belief over states <span class="math-container">$\mu \in \Delta (\Omega)$</span>. For a given signal realization <span class="math-container">$s$</span>, a Bayesian agent would update his belief to form a posterior belief <span class="math-container">$\mu_s(\omega)=\frac{\mu(\omega)\pi(s|\omega)}{\sum_{\omega'\in\Omega}\mu(\omega')\pi(s|\omega')}$</span>. Since each signal realization <span class="math-container">$s$</span> would correspond to a posterior belief <span class="math-container">$\mu_s$</span>, and the signal realization <span class="math-container">$s$</span> is generated in a probabilistic manner, each experiment <span class="math-container">$(S,\pi)$</span> would induce a distribution over posteriors <span class="math-container">$\tau\in\Delta(\Delta(\Omega))$</span>. WLOG assuming all <span class="math-container">$\mu_s\neq \mu_{s'}$</span> for distinct <span class="math-container">$s\neq s'$</span>, one can see <span class="math-container">$\tau(\mu_s)=\pi(s)=\sum_{\omega\in\Omega}\pi(s|\omega)\mu(\omega)$</span>.
In fact, <span class="math-container">$\sum_{supp(\tau)}\tau(\mu_s)\mu_s=\mu$</span> can be seen from straightforward calculation. This equation is usually referred to &quot;Bayes plausibility constraint&quot;, and it simply means that the expected posterior is just the prior.</p>
<p>We say a distribution <span class="math-container">$F$</span> is a <span class="math-container">$\textbf{Mean preserving spread}$</span> of <span class="math-container">$G$</span> if <span class="math-container">$G$</span> second-order stochastically dominates <span class="math-container">$F$</span> and <span class="math-container">$F$</span> and <span class="math-container">$G$</span> has the same mean. There are some alternative equivalent definitions to this, but I'll skip this.</p>
<p>Now, we have all the building blocks to state the beautiful Blackwell Equivalence Theorem (1951, 1953).</p>
<p>The following are equivalent</p>
<ol>
<li><span class="math-container">$(S',\pi')$</span> is a garbling of <span class="math-container">$(S, \pi)$</span></li>
<li>Any feasible distribution of actions under <span class="math-container">$(S',\pi')$</span> is also feasible under <span class="math-container">$(S,\pi)$</span></li>
<li><span class="math-container">$(S,\pi)$</span> is more informative than <span class="math-container">$(S',\pi')$</span></li>
<li><span class="math-container">$\tau$</span> is a mean preserving spraed of <span class="math-container">$\tau'$</span>, where <span class="math-container">$\tau$</span> is the distribution of posteriors induced by <span class="math-container">$(S,\pi)$</span></li>
</ol>
<p>The term <span class="math-container">$\textbf{Blackwell Order}$</span> refers to the <span class="math-container">$\textit{partial}$</span> order over the set of all experiments <span class="math-container">$\Pi$</span>, where <span class="math-container">$\pi \succeq \pi'$</span> if and only if one of the four conditions above holds.</p>
<p>Hope this answers your first question.</p>
<p>For the second part, we say an information structure <span class="math-container">$(S*,\pi*)$</span> is a <span class="math-container">$\textbf{combination}$</span> of <span class="math-container">$(S,\pi)$</span>, <span class="math-container">$(S',\pi')$</span> if
<span class="math-container">$$S*=S \times S'$$</span> and <span class="math-container">$$\sum_{s'\in S'}\pi^*(s,s'|\theta)=\pi(s|\theta)$$</span> <span class="math-container">$$\sum_{s\in S}\pi^*(s,s'|\theta)=\pi'(s'|\theta)$$</span>
Note that the above definition does not put any restriction on the correlation structure of <span class="math-container">$S$</span> an <span class="math-container">$S'$</span>. The only condition it requires is that <span class="math-container">$\pi*$</span> marginalizes to <span class="math-container">$\pi$</span> and <span class="math-container">$\pi'$</span></p>
<p>An information structure <span class="math-container">$(S*,\pi*)$</span> is an <span class="math-container">$\textbf{expansion}$</span> of <span class="math-container">$(S,\pi)$</span> if there exists some information structure <span class="math-container">$(S',\pi')$</span> such that <span class="math-container">$(S*,\pi*)$</span> is a combintation of <span class="math-container">$(S,\pi),(S',\pi')$</span></p>
<p>If <span class="math-container">$S*$</span> is an expansion of <span class="math-container">$S$</span>, <span class="math-container">$S*$</span> is at least as informative as <span class="math-container">$S$</span>. In fact, they are Blackwell equivalent. This is straightforward from the equivalence conditions above. There may be other proofs, but I'll use the feasibility conditions for now.</p>
<p>Assume <span class="math-container">$\chi: \Omega \rightarrow \Delta(A)$</span> is feasible under <span class="math-container">$(S,\pi)$</span>. Then, there exists some <span class="math-container">$\sigma: S \rightarrow \Delta(A)$</span> such that <span class="math-container">$$\chi_{\omega}(a)=\sum_{s}\pi(s|\omega)\sigma(a|s)$$</span>
Define <span class="math-container">$\sigma*: S \times S' \rightarrow \Delta(A)$</span> as <span class="math-container">$\sigma*(a|s,s')=\sigma(a|s)$</span> for all <span class="math-container">$s \in S$</span>, <span class="math-container">$s'\in S'$</span>
We have
<span class="math-container">$$\chi_{\omega}(a)=\sum_{s}\pi(s|\omega)\sigma(a|s)=\sum_{s}\sum_{s'}\pi*(s,s'|\omega)\sigma(a|s)=\sum_{s}\sum_{s'}\pi*(s,s'|\omega)\sigma*(a|s,s') 
\\ = \sum_{s,s'}\pi*(s,s'|\omega)\sigma*(a|s,s')$$</span>
The second equation follows from definition of expansion, and the third equation is just our definition of <span class="math-container">$\sigma*$</span>. Thus, the expansion <span class="math-container">$(S*,\pi*)$</span> is more informative than <span class="math-container">$(S,\pi)$</span></p>
<p>To show <span class="math-container">$(S,\pi)$</span> is more informative than <span class="math-container">$(S*,\pi*)$</span>, just define <span class="math-container">$\sigma$</span> as <span class="math-container">$\sigma(a|s)=\sigma*(a|s,s')$</span>.</p>
<p>Hope the answer helped! Any comments are welcome</p>

CC BY-SA 4.0
2022-01-09T17:15:12.903Z
Actually, infinite versions of the theorem usually require a lot more than some measurability assumptions. Usually, one needs to assume the existence of densities.
Michael Greinecker
CC BY-SA 4.0
2022-01-10T13:10:17.683Z
@MichaelGreinecker Thank you for your comment. Can you elaborate more on densities issues? any references would be helpful
djsteve
CC BY-SA 4.0
2022-01-10T15:20:19.900Z
The standard reference for these kinds of questions is the book "Mathematical theory of Statistics" by Strasser, which makes for really, really hard reading. The most readable reference I know is Chapter 1 of the book "Statistical Experiments and Decisions: Asymptotic Theory" by Shiryaev  and Spokoiny, which is still quite technical. There you can look for the assumption that a statistical experiment is "dominated," which means that each probability measure admits a density with respect to a single $\sigma$-finite measure.
Michael Greinecker
CC BY-SA 4.0
2022-01-09T15:17:04.293Z
2022-01-09T15:35:07.247Z
2022-01-09T15:35:07.247Z
djsteve
<p>Let us suppose that we have a Bayesian game where the information structure is defined to be as <span class="math-container">$P^X=\{(X,\mathcal{X},P_\theta)\}_{\theta\in\Theta}$</span> where a signal generated by the information structure on each state <span class="math-container">$\theta\in\Theta$</span> is just a random variable taking its value in <span class="math-container">$(X,\mathcal{X})$</span> endowed with the probability distribution <span class="math-container">$P_\theta$</span>. If we have another information structure <span class="math-container">$Q^Y=\{(Y,\mathcal{Y},Q_\theta)\}_{\theta\in\Theta}$</span> what assumptions are needed so as we could compare these information structures and how the Blackwell's Equivalence Theorem on Information Structures is applied to do the comparison?</p>
<p>Also, if one of the two information structures were an expansion from the other, say <span class="math-container">$P^X$</span> is an expansion of <span class="math-container">$Q^Y$</span>, what would this change?</p>

<mathematical-economics><game-theory><bayesian-game><probability><information>
What is the intuition behind Blackwell's Equivalence Theorem on Information Structures?
Hunger Learn
# What is the intuition behind Blackwell's Equivalence Theorem on Information Structures?

(Asked by: username_0 on 2022-01-07)

Let us suppose that we have a Bayesian game where the information structure is defined to be as $P^X=\{(X,\mathcal{X},P\_\theta)\}\_{\theta\in\Theta}$ where a signal generated by the information structure on each state $\theta\in\Theta$ is just a random variable taking its value in $(X,\mathcal{X})$ endowed with the probability distribution $P\_\theta$. If we have another information structure $Q^Y=\{(Y,\mathcal{Y},Q\_\theta)\}\_{\theta\in\Theta}$ what assumptions are needed so as we could compare these information structures and how the Blackwell's Equivalence Theorem on Information Structures is applied to do the comparison?

Also, if one of the two information structures were an expansion from the other, say $P^X$ is an expansion of $Q^Y$, what would this change?

**Tags:** mathematical-economics, game-theory, bayesian-game, probability, information


---

## 1 answers

### Answer by username_1 on 2022-01-09. Score: 5 | Accepted answer

To answer the first part of your question, we do not need any more assumptions for the comparison of experiments (besides some measurability issues).

Before going on, I'll fix some notations to ones that are standard in the game theory literature, and for the sake of my convenience.

An experiment (or informtion structure) is defined as a tuple $(S,\pi)$ for a given state space $\Omega$,
where $S$ is the set of signals endowed with some appropriate $\sigma$-algebra, and $$\pi: \Omega \rightarrow \Delta (S)$$ is a signal function, where $\pi(s|\omega)$ is the probability that $s$ is realized given state $\omega$.
In your notation, $X$ would correspond to $S$, and $P\_{\theta}(x)=\pi(x|\theta)$.

To state the Blackwell's Equivalence Theorem, we would need some more definitions.

An experiment $(S',\pi')$ is a $\textbf{garbling}$ of $(S,\pi)$ if there exists a map $g: S \rightarrow \Delta(S')$ such that
$$\pi'(s'|\omega)=\sum\_{s'\in S'}g(s'|s)\pi(s|\omega)$$
, or $$\pi'= g \circ \pi$$ where $\circ$ denotes the composition of two stochastic maps
Intuitively, a garbling function $g: S \rightarrow \Delta(S')$ can be thought as adding noise, and blurring the information generated from $\pi$. Since
$g(s'|s)$ is the probability that the signal realization $s\in S$ is changed into signal realization $s'\in S'$, $\pi'$ is a signal function that is more uncertain, and noisier than $\pi$
When the state space and the signal space $S, S'$ is finite, one can use matrices to represent garbling.
Let $\pi\_i(s\_j)=\pi(s\_j|\omega\_i)$. An experiment $(S,\pi)$ can be represented by a matrix
$$\Pi=\begin{pmatrix} \pi\_1(s) \\ \pi\_2(s) \\ ... \\ \pi\_m(s) \end{pmatrix}$$
Then, $(S',\pi')$ is a garbling of $(S,\pi)$ if there exists an $n \times n'$ stochastic matrix G such that $\Pi'=\Pi G$

Obviously, garbling is not a complete order, but a $\textit{partial}$ order. Many information strutures cannot be directly compared with each other.

We say that $(S,\pi)$ is $\textbf{more informative}$ than $(S',\pi')$ if for $\textit{any}$ finite $A$ and $u: A \times \Omega \rightarrow \mathbb{R}$, the decision maker prefers $(S,\pi)$ over $(S',\pi')$. This definition is very strong since it requires any decision maker to prefer $(S,\pi)$ over $(S',\pi')$

We say that a distribution of actions conditional on state, $\chi: \Omega \rightarrow \Delta(A)$ is $\textbf{feasible}$ under $(S,\pi)$ if there exists DM's strategy $\sigma: S \rightarrow \Delta(A)$ such that $\chi=\sigma \circ \pi$. In other words, $\chi$ is feasible if one can construct a behavioral strategy $\sigma$ as a function only of signal realizations, and the resulting action distribution $\sigma \circ \pi$ is $\chi$. The set of feasible distribution of actions is equal to the DM's choice set.

Also, fix some prior belief over states $\mu \in \Delta (\Omega)$. For a given signal realization $s$, a Bayesian agent would update his belief to form a posterior belief $\mu\_s(\omega)=\frac{\mu(\omega)\pi(s|\omega)}{\sum\_{\omega'\in\Omega}\mu(\omega')\pi(s|\omega')}$. Since each signal realization $s$ would correspond to a posterior belief $\mu\_s$, and the signal realization $s$ is generated in a probabilistic manner, each experiment $(S,\pi)$ would induce a distribution over posteriors $\tau\in\Delta(\Delta(\Omega))$. WLOG assuming all $\mu\_s\neq \mu\_{s'}$ for distinct $s\neq s'$, one can see $\tau(\mu\_s)=\pi(s)=\sum\_{\omega\in\Omega}\pi(s|\omega)\mu(\omega)$.
In fact, $\sum\_{supp(\tau)}\tau(\mu\_s)\mu\_s=\mu$ can be seen from straightforward calculation. This equation is usually referred to "Bayes plausibility constraint", and it simply means that the expected posterior is just the prior.

We say a distribution $F$ is a $\textbf{Mean preserving spread}$ of $G$ if $G$ second-order stochastically dominates $F$ and $F$ and $G$ has the same mean. There are some alternative equivalent definitions to this, but I'll skip this.

Now, we have all the building blocks to state the beautiful Blackwell Equivalence Theorem (1951, 1953).

The following are equivalent

1. $(S',\pi')$ is a garbling of $(S, \pi)$
2. Any feasible distribution of actions under $(S',\pi')$ is also feasible under $(S,\pi)$
3. $(S,\pi)$ is more informative than $(S',\pi')$
4. $\tau$ is a mean preserving spraed of $\tau'$, where $\tau$ is the distribution of posteriors induced by $(S,\pi)$

The term $\textbf{Blackwell Order}$ refers to the $\textit{partial}$ order over the set of all experiments $\Pi$, where $\pi \succeq \pi'$ if and only if one of the four conditions above holds.

Hope this answers your first question.

For the second part, we say an information structure $(S\*,\pi\*)$ is a $\textbf{combination}$ of $(S,\pi)$, $(S',\pi')$ if
$$S\*=S \times S'$$ and $$\sum\_{s'\in S'}\pi^\*(s,s'|\theta)=\pi(s|\theta)$$ $$\sum\_{s\in S}\pi^\*(s,s'|\theta)=\pi'(s'|\theta)$$
Note that the above definition does not put any restriction on the correlation structure of $S$ an $S'$. The only condition it requires is that $\pi\*$ marginalizes to $\pi$ and $\pi'$

An information structure $(S\*,\pi\*)$ is an $\textbf{expansion}$ of $(S,\pi)$ if there exists some information structure $(S',\pi')$ such that $(S\*,\pi\*)$ is a combintation of $(S,\pi),(S',\pi')$

If $S\*$ is an expansion of $S$, $S\*$ is at least as informative as $S$. In fact, they are Blackwell equivalent. This is straightforward from the equivalence conditions above. There may be other proofs, but I'll use the feasibility conditions for now.

Assume $\chi: \Omega \rightarrow \Delta(A)$ is feasible under $(S,\pi)$. Then, there exists some $\sigma: S \rightarrow \Delta(A)$ such that $$\chi\_{\omega}(a)=\sum\_{s}\pi(s|\omega)\sigma(a|s)$$
Define $\sigma\*: S \times S' \rightarrow \Delta(A)$ as $\sigma\*(a|s,s')=\sigma(a|s)$ for all $s \in S$, $s'\in S'$
We have
$$\chi\_{\omega}(a)=\sum\_{s}\pi(s|\omega)\sigma(a|s)=\sum\_{s}\sum\_{s'}\pi\*(s,s'|\omega)\sigma(a|s)=\sum\_{s}\sum\_{s'}\pi\*(s,s'|\omega)\sigma\*(a|s,s')
\\ = \sum\_{s,s'}\pi\*(s,s'|\omega)\sigma\*(a|s,s')$$
The second equation follows from definition of expansion, and the third equation is just our definition of $\sigma\*$. Thus, the expansion $(S\*,\pi\*)$ is more informative than $(S,\pi)$

To show $(S,\pi)$ is more informative than $(S\*,\pi\*)$, just define $\sigma$ as $\sigma(a|s)=\sigma\*(a|s,s')$.

Hope the answer helped! Any comments are welcome

> **Comments:**
> **username_2**: Actually, infinite versions of the theorem usually require a lot more than some measurability assumptions. Usually, one needs to assume the existence of densities.  
> **username_1**: @username_2 Thank you for your comment. Can you elaborate more on densities issues? any references would be helpful  
> **username_2**: The standard reference for these kinds of questions is the book "Mathematical theory of Statistics" by Strasser, which makes for really, really hard reading. The most readable reference I know is Chapter 1 of the book "Statistical Experiments and Decisions: Asymptotic Theory" by Shiryaev  and Spokoiny, which is still quite technical. There you can look for the assumption that a statistical experiment is "dominated," which means that each probability measure admits a density with respect to a single $\sigma$-finite measure.  

---

