<p>I talked with an economist friend and it appears the best way to get what I'm after is to bootstrap estimate the Shapley value. </p>

<p>e.g. Randomly sample with replacement my experimental data 1000 times, compute the Shapley value with each sample, and then average those computations. And at that point, it's not hard to construct a confidence interval using the 5% and 95% percentiles of the computations. </p>

<p>This may not be the most theoretically correct way, but it gives me precisely what I'm looking for - namely confidence intervals on the <strong>computed</strong> Shapley value. Except incidentally, I don't care about the confidence intervals on the data points themselves. </p>

CC BY-SA 3.0
2017-11-29T21:36:12.207Z
2017-11-29T21:36:12.207Z
Scottmas
<p>It sounds like you may have a quadratic loss function, but I am guessing a little.  If the players have played enough to be experienced in how the game works, then I would simply use the sample mean reward as my calculation point.</p>

<p>You should read up on the theory behind loss functions.  The players are making estimates, certain types of estimates are the natural minimization of certain loss functions.  Most gambling type behavior results from quadratic loss, though there are particular exceptions.  Equity securities center of location is the mode because there can be no such thing as a mean return.  Equity securities behaviors should result from an all-or-nothing loss function.  Physicians are another example where there is an asymmetric loss.</p>

<p>If a physician fails to diagnose you with a disease, then they lost the revenue from treatment and face malpractice claims.  If they misdiagnose you as having a disease but you do not, then they still collect the medical billings and may not face malpractice claims, especially if they do not reveal it was a misdiagnosis.  A diagnosis is a form of gamble.</p>

<p>Take a look at the losses experienced from failing to take a particular type of behavior.  </p>

CC BY-SA 3.0
2017-11-28T14:36:18.297Z
This isn't quite what I'm looking for. Would something like assuming a probability distribution and then summing the difference work?
Scottmas
CC BY-SA 3.0
2017-11-28T15:00:05.357Z
There is no rational grounding for it.  You do not and cannot know the probability mass or density functions running around inside their heads.  They were forced to make "decisions," which are point solutions.  They are minimizing a cost in their heads but against a density of their own making.  If I were a referee I would toss it as without any rational merit.  You need a solution that does not depend upon what is happening inside their head, with regard to uncertainty.
Dave Harris
CC BY-SA 3.0
2017-11-27T18:57:04.523Z
2017-11-27T18:57:04.523Z
Dave Harris
<p>So I'm trying to estimate a <a href="https://en.wikipedia.org/wiki/Shapley_value" rel="nofollow noreferrer">Shapley value</a> in a game with uncertain payoffs. Specifically, imagine a game where the payoff function as as follows</p>

<pre><code>(A) = 1 
(B) = 2
(B,C) = 4
</code></pre>

<p>For instance, you can imagine this game representing Person A and Person B deciding whether to go into business by themselves or together.</p>

<p>Calculating the Shapley value for this game is very straightforward by listing all the permutations along with the marginal contribution of each person in the given permutation divided by the number of permutations: </p>

<pre><code>[A, B] = [1, 3]
[B, A] = [2, 2]

[A, B] = [(1+2)/2, (3+2)/2] 
[A, B] = [1.5, 2.5]
</code></pre>

<p>So Person A should get \$1.5 and Person B should get \$2.5 in the grand coalition. </p>

<p>However, I am struggling to figure out how I would go about computing the Shapley value in the presence of uncertainty. For instance, imagine I change the payoff function to use confidence intervals as follows:</p>

<pre><code>(A) = 1 ± 0.2
(B) = 2 ± 0.6
(B,C) = 4 ± 0.5
</code></pre>

<p>This is important as I am trying to compute the Shapley value in an real life setting with experimental data. </p>

<p>What will the Shapley value be in this case WITH uncertainty?</p>

CC BY-SA 3.0
2017-11-27T09:04:23.483Z
What exactly is your question? Right now it invites speculation, which is not something the SE format supports.
Giskard
CC BY-SA 3.0
2017-11-27T13:34:55.033Z
Without uncertainty, the Shapley value is [1.5, 2.5]. What would it be WITH uncertainty?
Scottmas
CC BY-SA 3.0
2017-11-27T14:28:07.917Z
What does your cost or utility function look like?  What is the nature of the experiment?
Dave Harris
CC BY-SA 3.0
2017-11-27T14:44:11.427Z
In my particular use case there is no cost or utility function. We assign various coalitions of players, each coalition performs an activity multiple times, which allows us to estimate a payoff for each coalition. For example, some coalitions may produce a high average payoff but have a high variance in their performance, other coalitions may have a low payoff but be tightly clustered.
Scottmas
CC BY-SA 3.0
2017-11-28T15:04:47.367Z
You are misunderstanding what a confidence interval is.  A confidence interval says nothing about your actual data, it talks about your model.   If your model is the true model and you repeat the experiment an infinite amount of times, then your intervals will cover the parameter no less than x% of the time.  It does not mean it will cover it during this experiment.  You know nothing about its properties on one use.  What you are thinking about is a credible interval and I doubt you can collect the information to calculate it.
Dave Harris
<game-theory><expected-utility><cooperative-game-theory>
How to calculate Shapley Value with uncertainty?
Scottmas
# How to calculate Shapley Value with uncertainty?

(Asked by: username_0 on 2017-11-27)

So I'm trying to estimate a [Shapley value](https://en.wikipedia.org/wiki/Shapley_value) in a game with uncertain payoffs. Specifically, imagine a game where the payoff function as as follows

```
(A) = 1 
(B) = 2
(B,C) = 4

```

For instance, you can imagine this game representing Person A and Person B deciding whether to go into business by themselves or together.

Calculating the Shapley value for this game is very straightforward by listing all the permutations along with the marginal contribution of each person in the given permutation divided by the number of permutations:

```
[A, B] = [1, 3]
[B, A] = [2, 2]

[A, B] = [(1+2)/2, (3+2)/2] 
[A, B] = [1.5, 2.5]

```

So Person A should get \$1.5 and Person B should get \$2.5 in the grand coalition.

However, I am struggling to figure out how I would go about computing the Shapley value in the presence of uncertainty. For instance, imagine I change the payoff function to use confidence intervals as follows:

```
(A) = 1 ± 0.2
(B) = 2 ± 0.6
(B,C) = 4 ± 0.5

```

This is important as I am trying to compute the Shapley value in an real life setting with experimental data.

What will the Shapley value be in this case WITH uncertainty?

**Tags:** game-theory, expected-utility, cooperative-game-theory

> **Comments:**
> **username_1**: What exactly is your question? Right now it invites speculation, which is not something the SE format supports.  
> **username_0**: Without uncertainty, the Shapley value is [1.5, 2.5]. What would it be WITH uncertainty?  
> **username_2**: What does your cost or utility function look like?  What is the nature of the experiment?  
> **username_0**: In my particular use case there is no cost or utility function. We assign various coalitions of players, each coalition performs an activity multiple times, which allows us to estimate a payoff for each coalition. For example, some coalitions may produce a high average payoff but have a high variance in their performance, other coalitions may have a low payoff but be tightly clustered.  
> **username_2**: You are misunderstanding what a confidence interval is.  A confidence interval says nothing about your actual data, it talks about your model.   If your model is the true model and you repeat the experiment an infinite amount of times, then your intervals will cover the parameter no less than x% of the time.  It does not mean it will cover it during this experiment.  You know nothing about its properties on one use.  What you are thinking about is a credible interval and I doubt you can collect the information to calculate it.  

---

## 2 answers

### Answer by username_0 on 2017-11-29. Score: 0 | Accepted answer

I talked with an economist friend and it appears the best way to get what I'm after is to bootstrap estimate the Shapley value.

e.g. Randomly sample with replacement my experimental data 1000 times, compute the Shapley value with each sample, and then average those computations. And at that point, it's not hard to construct a confidence interval using the 5% and 95% percentiles of the computations.

This may not be the most theoretically correct way, but it gives me precisely what I'm looking for - namely confidence intervals on the **computed** Shapley value. Except incidentally, I don't care about the confidence intervals on the data points themselves.


---

### Answer by username_2 on 2017-11-27. Score: 0

It sounds like you may have a quadratic loss function, but I am guessing a little. If the players have played enough to be experienced in how the game works, then I would simply use the sample mean reward as my calculation point.

You should read up on the theory behind loss functions. The players are making estimates, certain types of estimates are the natural minimization of certain loss functions. Most gambling type behavior results from quadratic loss, though there are particular exceptions. Equity securities center of location is the mode because there can be no such thing as a mean return. Equity securities behaviors should result from an all-or-nothing loss function. Physicians are another example where there is an asymmetric loss.

If a physician fails to diagnose you with a disease, then they lost the revenue from treatment and face malpractice claims. If they misdiagnose you as having a disease but you do not, then they still collect the medical billings and may not face malpractice claims, especially if they do not reveal it was a misdiagnosis. A diagnosis is a form of gamble.

Take a look at the losses experienced from failing to take a particular type of behavior.

> **Comments:**
> **username_0**: This isn't quite what I'm looking for. Would something like assuming a probability distribution and then summing the difference work?  
> **username_2**: There is no rational grounding for it.  You do not and cannot know the probability mass or density functions running around inside their heads.  They were forced to make "decisions," which are point solutions.  They are minimizing a cost in their heads but against a density of their own making.  If I were a referee I would toss it as without any rational merit.  You need a solution that does not depend upon what is happening inside their head, with regard to uncertainty.  

---

