Answers.Body: <p>It has become our human bias that data will arrive from a normal distribution. It is also the most prevalent distribution in nature occurring in many places. Hence, we sample from a normal distribution. Also, central limit theorem works around means lying around normal distribution.</p>
  <p>It is not taboo to use others if they are helpful to your network. But, a data from one distribution can transformed into other and if that is something that is required, the network will to do it since it can approximate anything (although a weak assumption, but, hey, its working right?).</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2021-03-17T13:47:13.890Z
Answers.Text: Sometimes the uniform distribution can be more appropriate. I am not familiar with the details of the GAN, but there's probably a reason for sampling from the Gaussian or maybe this is an assumption or maybe it makes more sense, in this case, to put more density or specific values. Maybe you should explain what that vector that the OP is referring to is used for, cuz, if it is similar to the latent vector in VAEs, then the explanation of sampling from a Gaussian is not just "because we like Gaussians" or "because it's a habit", which is somehow what your answer seems to partially suggest.
Answers.UserDisplayName: nbro
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2021-03-18T04:07:30.893Z
Answers.Text: It would be great if you could write the answer then. And yes uniform distributions are used. Did I say anywhere that others can't be used or it is taboo? And when I said it occurs in most places, it also occurs in images which GANs are prevalently used for. In a photograph, the subject is the important data, the rest of it is not important. That's a Gaussian for you.
Answers.UserDisplayName: Abhishek Verma
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2021-03-18T17:46:41.223Z
Answers.Text: You wrote "It has become our human bias that data will arrive from a normal distribution. ... Hence, we sample from a normal distribution". No, it's not a human bias (at least not of all humans). The fact that certain empirical distributions, such as the height of humans, seem to follow a normal distribution does not imply a bias or that we will select a normal distribution because we are biased towards it.
Answers.UserDisplayName: nbro
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2021-03-18T17:49:27.953Z
Answers.Text: Moreover, you say "Also, central limit theorem works around means lying around normal distribution.", but the CTL is about possibly non-Gaussian distributed r.v.s that collectively follow a Gaussian: how does this relate to the GAN case?
Answers.UserDisplayName: nbro
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2021-03-18T18:01:16.903Z
Answers.Text: I am giving him the social proof for normal distribution. Even non-Gaussian inadvertently follow the normal distribution somehow. I told you about the distribution of information in images. That is normal. That is enough.
Answers.UserDisplayName: Abhishek Verma
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2021-03-17T11:54:23.923Z
Answers.LastActivityDate: 2021-03-17T11:54:23.923Z
Answers.UserDisplayName: Abhishek Verma
Body: <p>I am new to GANs. I noticed that everybody generates a random vector (usually 100 dimensional) from a standard normal distribution <span class="math-container">$N(0, 1)$</span>. My question is: why? Why don't they sample these vectors from a uniform distribution <span class="math-container">$U(0, 1)$</span>? Does the standard normal distribution has some properties that other probability distributions don't have?</p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2023-02-19T04:01:53.173Z
Comments.Text: Seems to me that the normal distribution in high dimensions is causing problems with heavily under-sampled regions, so I'm wondering the same thing.
Comments.UserDisplayName: Tim Kuipers
Tags: <generative-adversarial-networks><probability-distribution><normal-distribution><uniform-distribution>
Title: Why do we sample vectors from a standard normal distribution for the generator?
UserDisplayName: dato nefaridze
ThreadText: # Why do we sample vectors from a standard normal distribution for the generator?
  
  (Asked by: username_0 on 2021-03-13)
  
  I am new to GANs. I noticed that everybody generates a random vector (usually 100 dimensional) from a standard normal distribution $N(0, 1)$. My question is: why? Why don't they sample these vectors from a uniform distribution $U(0, 1)$? Does the standard normal distribution has some properties that other probability distributions don't have?
  
  **Tags:** generative-adversarial-networks, probability-distribution, normal-distribution, uniform-distribution
  
  > **Comments:**
  > **username_1**: Seems to me that the normal distribution in high dimensions is causing problems with heavily under-sampled regions, so I'm wondering the same thing.  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_2 on 2021-03-17. Score: 0 | Accepted answer
  
  It has become our human bias that data will arrive from a normal distribution. It is also the most prevalent distribution in nature occurring in many places. Hence, we sample from a normal distribution. Also, central limit theorem works around means lying around normal distribution.
  
  It is not taboo to use others if they are helpful to your network. But, a data from one distribution can transformed into other and if that is something that is required, the network will to do it since it can approximate anything (although a weak assumption, but, hey, its working right?).
  
  > **Comments:**
  > **username_3**: Sometimes the uniform distribution can be more appropriate. I am not familiar with the details of the GAN, but there's probably a reason for sampling from the Gaussian or maybe this is an assumption or maybe it makes more sense, in this case, to put more density or specific values. Maybe you should explain what that vector that the OP is referring to is used for, cuz, if it is similar to the latent vector in VAEs, then the explanation of sampling from a Gaussian is not just "because we like Gaussians" or "because it's a habit", which is somehow what your answer seems to partially suggest.  
  > **username_2**: It would be great if you could write the answer then. And yes uniform distributions are used. Did I say anywhere that others can't be used or it is taboo? And when I said it occurs in most places, it also occurs in images which GANs are prevalently used for. In a photograph, the subject is the important data, the rest of it is not important. That's a Gaussian for you.  
  > **username_3**: You wrote "It has become our human bias that data will arrive from a normal distribution. ... Hence, we sample from a normal distribution". No, it's not a human bias (at least not of all humans). The fact that certain empirical distributions, such as the height of humans, seem to follow a normal distribution does not imply a bias or that we will select a normal distribution because we are biased towards it.  
  > **username_3**: Moreover, you say "Also, central limit theorem works around means lying around normal distribution.", but the CTL is about possibly non-Gaussian distributed r.v.s that collectively follow a Gaussian: how does this relate to the GAN case?  
  > **username_2**: I am giving him the social proof for normal distribution. Even non-Gaussian inadvertently follow the normal distribution somehow. I told you about the distribution of information in images. That is normal. That is enough.  
  
  ---
  
  