Answers.Body: <p>Indeed I haven't seen the term "logit probability" used in many places other than that specific paper. So, I cannot really comment on why they're using that term / where it comes from / if anyone else uses it, but I can confirm that what they mean by "logit probability" is basically the same thing that is more commonly referred to simply as "logits": <strong>they are the raw, unbounded scores of which we generally push a vector through a softmax function to generate a discrete probability distribution that nicely adds up to <span class="math-container">$1$</span></strong>.</p>
  
  <p>This definition fits the one you linked from wikipedia (although that link only covers the binary case, and AlphaGo Zero would have <a href="https://en.wikipedia.org/wiki/Multinomial_logistic_regression" rel="noreferrer">multinomial logits</a> since it has more than two outputs for the policy head).</p>
  
  <p>In the AlphaGo Zero paper, the described architecture has a "linear output layer" (i.e. no activation function for the outputs, or the identity function as activation function for the outputs, or however you like to describe it) for the policy head. This means that these outputs are essentially unbounded, they could be any real number. We know for sure that these outputs cannot directly be interpreted as probabilities, even if this isn't stated quite explicitly in the paper.</p>
  
  <p>By calling them logits (or logit probabilities for reasons unknown to me), they are essentially implying that these outputs will still be post-processed by a softmax to convert them into a vector that can be interpreted as a discrete probability distribution over the actions, even if they do not explicitly describe a softmax layer as being a part of the network.</p>
  
  <p>It is indeed possible that in Leela Zero they decided to make the softmax operation explicitly a part of the Neural Network architecture. Mathematically they end up doing the same thing... the AlphaGo Zero paper implies (by using the word "logit") that a softmax is used as a "post-processing" step, and in Leela Zero they explicitly make it a part of the Neural Network.</p>
  
  <p>Here are a couple more sources for the reasoning that usage of the word "logit" basically implies usage of a softmax, though indeed they do not cover the term "logit probability":</p>
  
  <ul>
  <li><a href="https://stats.stackexchange.com/a/52836/144483">https://stats.stackexchange.com/a/52836/144483</a></li>
  <li><a href="https://stackoverflow.com/a/34243720/6735980">https://stackoverflow.com/a/34243720/6735980</a></li>
  </ul>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2019-01-23T17:20:46.127Z
Answers.Text: Thanks for your answer.  That Wikipedia link to multinomial logistic regression especially helped since it ultimately and explicitly uses softmax to generate the probability distribution.  I will likely accept your answer, but I will wait to see if anyone else might have more information about the _logit probability_ phrase in particular.
Answers.UserDisplayName: sadakatsu
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2019-01-23T17:47:26.180Z
Answers.Text: @sadakatsu Of course :) I'd love to see if anyone else knows more about where that phrase comes from myself too, I was also wondering about that when I first tried implementing something similar and was looking into all the tiny details. Note that the original AlphaGo paper does explicitly mention using a softmax, and in AlphaGo Zero they also must be doing **something** to convert their linear outputs into something that can be interpreted as a probability distribution... so it's a fairly safe bet that they're still doing softmax.
Answers.UserDisplayName: Dennis Soemers
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2019-01-23T16:54:27.737Z
Answers.LastActivityDate: 2019-01-23T16:54:27.737Z
Answers.UserDisplayName: Dennis Soemers
Body: <p>DeepMind's paper <a href="https://www.nature.com/articles/nature24270.epdf?author_access_token=VJXbVjaSHxFoctQQ4p2k4tRgN0jAjWel9jnR3ZoTv0PVW4gB86EEpGqTRDtpIz-2rmo8-KG06gqVobU5NSCFeHILHcVFUeMsbvwS-lxjqQGg98faovwjxeTUgZAUMnRQ" rel="noreferrer">"Mastering the game of Go without human knowledge"</a> states in its "Methods" section on its "Neural network architecture" that the output layer of AlphaGo Zero's policy head is "A fully connected linear layer that outputs a vector of size 19^2+1=362, corresponding to the <em>logit probabilities</em> for all intersections and the pass move" (emphasis mine).  I am self-trained regarding neural networks, and I have never heard of a "logit probability" before this paper.  I have not been able by searching and reading to figure out what it means.  In fact, the <a href="https://en.wikipedia.org/wiki/Logit" rel="noreferrer">Wikipedia page on logit</a> seems to make the term a contradiction.  A logit can be converted into a probability using the equation <span class="math-container">$p=\frac{e^l}{e^l+1}$</span>, and a probability can be converted into a logit using the equation <span class="math-container">$l=\ln{\frac{p}{1-p}}$</span>, so the two cannot be the same.  The <a href="https://github.com/gcp/leela-zero/blob/master/training/caffe/zero.prototxt" rel="noreferrer">neural network configuration for Leela Zero</a>, which is supposed to have a nearly identical architecture to that described in the paper, seems to indicate that the fully connected layer described in the above quote needs to be followed with a softmax layer to generate probabilities (though I am absolutely new to Caffe and might not be interpreting the definitions of "p_ip1" and "loss_move" correctly).  The <a href="https://medium.com/applied-data-science/alphago-zero-explained-in-one-diagram-365f5abf67e0" rel="noreferrer">AlphaGo Zero cheat sheet</a>, which is otherwise very helpful, simply echoes the phrase "logit probability" as though this is a well-known concept.  I have seen several websites that refer to "logits" on their own (such as <a href="https://eli.thegreenplace.net/2016/the-softmax-function-and-its-derivative/" rel="noreferrer">this one</a>), but this is not enough to satisfy me that "logit probability" must mean "a probability generated by passing a logit vector through the softmax function".</p>
  
  <p>What is a logit probability?  What sources can I read to help me understand this concept better?</p>
  
Tags: <neural-networks><terminology><activation-functions><alphago-zero>
Title: What is a "logit probability"?
UserDisplayName: sadakatsu
ThreadText: # What is a "logit probability"?
  
  (Asked by: username_0 on 2019-01-23)
  
  DeepMind's paper ["Mastering the game of Go without human knowledge"](https://www.nature.com/articles/nature24270.epdf?author_access_token=VJXbVjaSHxFoctQQ4p2k4tRgN0jAjWel9jnR3ZoTv0PVW4gB86EEpGqTRDtpIz-2rmo8-KG06gqVobU5NSCFeHILHcVFUeMsbvwS-lxjqQGg98faovwjxeTUgZAUMnRQ) states in its "Methods" section on its "Neural network architecture" that the output layer of AlphaGo Zero's policy head is "A fully connected linear layer that outputs a vector of size 19^2+1=362, corresponding to the *logit probabilities* for all intersections and the pass move" (emphasis mine). I am self-trained regarding neural networks, and I have never heard of a "logit probability" before this paper. I have not been able by searching and reading to figure out what it means. In fact, the [Wikipedia page on logit](https://en.wikipedia.org/wiki/Logit) seems to make the term a contradiction. A logit can be converted into a probability using the equation $p=\frac{e^l}{e^l+1}$, and a probability can be converted into a logit using the equation $l=\ln{\frac{p}{1-p}}$, so the two cannot be the same. The [neural network configuration for Leela Zero](https://github.com/gcp/leela-zero/blob/master/training/caffe/zero.prototxt), which is supposed to have a nearly identical architecture to that described in the paper, seems to indicate that the fully connected layer described in the above quote needs to be followed with a softmax layer to generate probabilities (though I am absolutely new to Caffe and might not be interpreting the definitions of "p\_ip1" and "loss\_move" correctly). The [AlphaGo Zero cheat sheet](https://medium.com/applied-data-science/alphago-zero-explained-in-one-diagram-365f5abf67e0), which is otherwise very helpful, simply echoes the phrase "logit probability" as though this is a well-known concept. I have seen several websites that refer to "logits" on their own (such as [this one](https://eli.thegreenplace.net/2016/the-softmax-function-and-its-derivative/)), but this is not enough to satisfy me that "logit probability" must mean "a probability generated by passing a logit vector through the softmax function".
  
  What is a logit probability? What sources can I read to help me understand this concept better?
  
  **Tags:** neural-networks, terminology, activation-functions, alphago-zero
  
  ---
  
  ## 1 answers
  
  ### Answer by username_1 on 2019-01-23. Score: 7 | Accepted answer
  
  Indeed I haven't seen the term "logit probability" used in many places other than that specific paper. So, I cannot really comment on why they're using that term / where it comes from / if anyone else uses it, but I can confirm that what they mean by "logit probability" is basically the same thing that is more commonly referred to simply as "logits": **they are the raw, unbounded scores of which we generally push a vector through a softmax function to generate a discrete probability distribution that nicely adds up to $1$**.
  
  This definition fits the one you linked from wikipedia (although that link only covers the binary case, and AlphaGo Zero would have [multinomial logits](https://en.wikipedia.org/wiki/Multinomial_logistic_regression) since it has more than two outputs for the policy head).
  
  In the AlphaGo Zero paper, the described architecture has a "linear output layer" (i.e. no activation function for the outputs, or the identity function as activation function for the outputs, or however you like to describe it) for the policy head. This means that these outputs are essentially unbounded, they could be any real number. We know for sure that these outputs cannot directly be interpreted as probabilities, even if this isn't stated quite explicitly in the paper.
  
  By calling them logits (or logit probabilities for reasons unknown to me), they are essentially implying that these outputs will still be post-processed by a softmax to convert them into a vector that can be interpreted as a discrete probability distribution over the actions, even if they do not explicitly describe a softmax layer as being a part of the network.
  
  It is indeed possible that in Leela Zero they decided to make the softmax operation explicitly a part of the Neural Network architecture. Mathematically they end up doing the same thing... the AlphaGo Zero paper implies (by using the word "logit") that a softmax is used as a "post-processing" step, and in Leela Zero they explicitly make it a part of the Neural Network.
  
  Here are a couple more sources for the reasoning that usage of the word "logit" basically implies usage of a softmax, though indeed they do not cover the term "logit probability":
  
  * <https://stats.stackexchange.com/a/52836/144483>
  * <https://stackoverflow.com/a/34243720/6735980>
  
  > **Comments:**
  > **username_0**: Thanks for your answer.  That Wikipedia link to multinomial logistic regression especially helped since it ultimately and explicitly uses softmax to generate the probability distribution.  I will likely accept your answer, but I will wait to see if anyone else might have more information about the _logit probability_ phrase in particular.  
  > **username_1**: @sadakatsu Of course :) I'd love to see if anyone else knows more about where that phrase comes from myself too, I was also wondering about that when I first tried implementing something similar and was looking into all the tiny details. Note that the original AlphaGo paper does explicitly mention using a softmax, and in AlphaGo Zero they also must be doing **something** to convert their linear outputs into something that can be interpreted as a probability distribution... so it's a fairly safe bet that they're still doing softmax.  
  
  ---
  
  