Answers.Body: <p>to the cash bias: I think this is simply the money that is still available at time t=50 and has not yet been invested.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2021-11-08T09:57:36.437Z
Answers.LastActivityDate: 2021-11-08T09:57:36.437Z
Answers.UserDisplayName: Pastela
Answers.Body: <p>On page 8 they say:</p>
  <blockquote>
  <p>In the experiments of the paper, the 11 most-volumed non-cash assets are preselected for
  the portfolio. Together with the cash, Bitcoin, the size of the portfolio, m + 1, is 12. This
  number is chosen by experience and can be adjusted in future experiments. For markets
  with large volumes, like the foreign exchange market, m can be as big as the total number
  of available assets.</p>
  </blockquote>
  <p>They have 12 possible actions in the policy: buy one or more of the 11 non-cash assets, or sell them and hold more cash. It seems that the bias towards the cash position is a learnable parameter.</p>
  <p>Although now that I read that quote a few times, it seems that they treat <strong>Bitcoin as cash</strong>?! At first I thought they meant a currency like USD. But in effect the outcome is the same. As you increase the cash bias, the softmax activation gets biased towards that policy.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2024-02-13T09:56:10.390Z
Answers.LastActivityDate: 2024-02-13T09:56:10.390Z
Answers.UserDisplayName: NikoNyrh
Answers.Body: <ol>
  <li><p>Yes, the softmax is just a softmax, applied to the 12 values from the final linear layer.</p>
  </li>
  <li><p>As far as the &quot;cash bias&quot; goes — I'm not sure if the &quot;cash&quot; part has significance to the authors. But, the &quot;bias&quot; part is standard. The inputs to the last layer are 11-dimensional vectors. But the last layer has <em>12</em> parameters: one parameter for each input value, and one additive parameter called the bias.</p>
  </li>
  </ol>
  <p>That is, assuming the input vector is <span class="math-container">$(x_1, x_2, ..., x_{11})$</span>, then output will be:</p>
  <p><span class="math-container">$$
  y = w_0 + x_1w_1 + x_2w_2 + ... + x_{11}w_{11}
  $$</span></p>
  <p>The weight <span class="math-container">$w_0$</span> is called a bias. If you remove it, then you'll always map the input of all zeros, <span class="math-container">$(0, ... 0)$</span> to the output of <span class="math-container">$0$</span>. This might not be desirable, and might prevent the layer from converging. Adding a bias <span class="math-container">$w_0$</span> allows the layer to map any input to any output.</p>
  <p>Not that the <span class="math-container">$w_0$</span> is <em>not a true constant</em>. It's a trainable parameter like all others.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2023-05-18T22:11:21.390Z
Answers.LastActivityDate: 2023-05-18T22:11:21.390Z
Answers.UserDisplayName: Alex
Body: <p>I am reading a paper implementing a deep deterministic policy gradient algorithm for portfolio management. My question is about a specific neural network implementation they depict in this picture (<a href="https://arxiv.org/pdf/1706.10059v2.pdf" rel="nofollow noreferrer">paper</a>, picture is on page 14).</p>
  
  <p><a href="https://i.sstatic.net/nIX2S.png" rel="nofollow noreferrer"><img src="https://i.sstatic.net/nIX2S.png" alt="enter image description here"></a></p>
  
  <p>The first three steps are convolutions. Once they have reduced the initial tensor into a vector, they add that little yellow square entry to the vector, called the cash bias, and then they do a softmax operation.</p>
  
  <p>The paper does not go into any detail about what this bias term could be, they just say that they add this bias before the softmax. This makes me think that perhaps this is a standard step? But I don't know if this is a learnable parameter, or just a scalar constant they concatenate to the vector prior to the softmax.</p>
  
  <p>I have two questions:</p>
  
  <p>1) When they write softmax, is it safe to assume that this is just a softmax function, with no learnable parameters? Or is this meant to depict a fully connected linear layer, with a softmax activation?</p>
  
  <p>2) If it's the latter, then I can interpret the cash bias as being a constant term they concatenate to the vector before the fully connected layer, just to add one more feature for the cash assets. However, if softmax means just a function, then what is this cash bias? It must be a constant that they implement, but I don't see what the use of that would be, how can you pick a constant scalar that you are confident will have the intended impact on the softmax output to bias the network to put some weight on that feature (cash)? </p>
  
  <p>Any comments/interpretations are appreciated!</p>
  
Tags: <convolutional-neural-networks><papers><algorithmic-bias><softmax>
Title: What do the authors of this paper mean by the bias term in this picture of a neural network implementation?
UserDisplayName: Mike
ThreadText: # What do the authors of this paper mean by the bias term in this picture of a neural network implementation?
  
  (Asked by: username_0 on 2020-05-09)
  
  I am reading a paper implementing a deep deterministic policy gradient algorithm for portfolio management. My question is about a specific neural network implementation they depict in this picture ([paper](https://arxiv.org/pdf/1706.10059v2.pdf), picture is on page 14).
  
  [![enter image description here](https://i.sstatic.net/nIX2S.png)](https://i.sstatic.net/nIX2S.png)
  
  The first three steps are convolutions. Once they have reduced the initial tensor into a vector, they add that little yellow square entry to the vector, called the cash bias, and then they do a softmax operation.
  
  The paper does not go into any detail about what this bias term could be, they just say that they add this bias before the softmax. This makes me think that perhaps this is a standard step? But I don't know if this is a learnable parameter, or just a scalar constant they concatenate to the vector prior to the softmax.
  
  I have two questions:
  
  1) When they write softmax, is it safe to assume that this is just a softmax function, with no learnable parameters? Or is this meant to depict a fully connected linear layer, with a softmax activation?
  
  2) If it's the latter, then I can interpret the cash bias as being a constant term they concatenate to the vector before the fully connected layer, just to add one more feature for the cash assets. However, if softmax means just a function, then what is this cash bias? It must be a constant that they implement, but I don't see what the use of that would be, how can you pick a constant scalar that you are confident will have the intended impact on the softmax output to bias the network to put some weight on that feature (cash)?
  
  Any comments/interpretations are appreciated!
  
  **Tags:** convolutional-neural-networks, papers, algorithmic-bias, softmax
  
  
  ---
  
  ## 3 answers
  
  ### Answer by username_1 on 2021-11-08. Score: 0
  
  to the cash bias: I think this is simply the money that is still available at time t=50 and has not yet been invested.
  
  
  ---
  
  ### Answer by username_2 on 2024-02-13. Score: 0
  
  On page 8 they say:
  
  > In the experiments of the paper, the 11 most-volumed non-cash assets are preselected for
  > the portfolio. Together with the cash, Bitcoin, the size of the portfolio, m + 1, is 12. This
  > number is chosen by experience and can be adjusted in future experiments. For markets
  > with large volumes, like the foreign exchange market, m can be as big as the total number
  > of available assets.
  
  They have 12 possible actions in the policy: buy one or more of the 11 non-cash assets, or sell them and hold more cash. It seems that the bias towards the cash position is a learnable parameter.
  
  Although now that I read that quote a few times, it seems that they treat **Bitcoin as cash**?! At first I thought they meant a currency like USD. But in effect the outcome is the same. As you increase the cash bias, the softmax activation gets biased towards that policy.
  
  
  ---
  
  ### Answer by username_3 on 2023-05-18. Score: 0
  
  1. Yes, the softmax is just a softmax, applied to the 12 values from the final linear layer.
  2. As far as the "cash bias" goes — I'm not sure if the "cash" part has significance to the authors. But, the "bias" part is standard. The inputs to the last layer are 11-dimensional vectors. But the last layer has *12* parameters: one parameter for each input value, and one additive parameter called the bias.
  
  That is, assuming the input vector is $(x\_1, x\_2, ..., x\_{11})$, then output will be:
  
  $$
  y = w\_0 + x\_1w\_1 + x\_2w\_2 + ... + x\_{11}w\_{11}
  $$
  
  The weight $w\_0$ is called a bias. If you remove it, then you'll always map the input of all zeros, $(0, ... 0)$ to the output of $0$. This might not be desirable, and might prevent the layer from converging. Adding a bias $w\_0$ allows the layer to map any input to any output.
  
  Not that the $w\_0$ is *not a true constant*. It's a trainable parameter like all others.
  
  
  ---
  
  