Answers.Body: <p>You can never be 100% sure that a difference is real and not a statistical fluke. This is the entire concept underlying Type I errors - these are errors where the null hypothesis (usually, that there is no difference) is incorrectly rejected (a difference is called significant, when in fact none truly exists). Especially when performing many hypothesis tests, it's possible that a variable with truly identical distributions between two groups appears to have very different distributions simply due to sampling variability.</p>
  <p>You can reduce the chance of making such an error by reducing the level of alpha used to determine significance, and by performing appropriate multiple hypothesis correction. With stringent significance thresholds and conservative correction, you can make it extremely unlikely that a &quot;significant&quot; difference could be due to random chance, but it's not usually possible to conduct an experiment with a Type I error rate of 0%.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2022-07-29T13:43:55.880Z
Answers.Text: But since the proteins are specific to group x , and therefore lacks any measurement in the group y (since they are not detected), Thus the scenario here is not to see if the means are different. how to run a statistical significance test against something not detected ( should it be assumed 0 mean and 0 sd for the non-detected group? and then to determine with the desired p-value threshold?)
Answers.UserDisplayName: Balasubramaniam Namasivayam
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2022-07-28T14:53:21.247Z
Answers.LastActivityDate: 2022-07-28T14:53:21.247Z
Answers.UserDisplayName: Nuclear Hoagie
Body: <p>I am wondering what is the significance of finding a particular protein specific to a disease or control group? when we detect 1000s of proteins in a proteomics experiment, how can one be sure that the specific proteins found in say, a disease group is really absent in control group than by random chance?</p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2022-07-28T16:33:05.500Z
Comments.Text: Please edit the question to limit it to a specific problem with enough detail to identify an adequate answer.
Comments.UserDisplayName: Community
Tags: <rna-seq><genomics><proteomics><mass-spectrometry>
Title: Gene/protein expression specific to a group in omics
ThreadText: # Gene/protein expression specific to a group in omics
  
  (Asked by: username_0 on 2022-07-28)
  
  I am wondering what is the significance of finding a particular protein specific to a disease or control group? when we detect 1000s of proteins in a proteomics experiment, how can one be sure that the specific proteins found in say, a disease group is really absent in control group than by random chance?
  
  **Tags:** rna-seq, genomics, proteomics, mass-spectrometry
  
  > **Comments:**
  > **username_1**: Please edit the question to limit it to a specific problem with enough detail to identify an adequate answer.  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_2 on 2022-07-28. Score: 2
  
  You can never be 100% sure that a difference is real and not a statistical fluke. This is the entire concept underlying Type I errors - these are errors where the null hypothesis (usually, that there is no difference) is incorrectly rejected (a difference is called significant, when in fact none truly exists). Especially when performing many hypothesis tests, it's possible that a variable with truly identical distributions between two groups appears to have very different distributions simply due to sampling variability.
  
  You can reduce the chance of making such an error by reducing the level of alpha used to determine significance, and by performing appropriate multiple hypothesis correction. With stringent significance thresholds and conservative correction, you can make it extremely unlikely that a "significant" difference could be due to random chance, but it's not usually possible to conduct an experiment with a Type I error rate of 0%.
  
  > **Comments:**
  > **username_0**: But since the proteins are specific to group x , and therefore lacks any measurement in the group y (since they are not detected), Thus the scenario here is not to see if the means are different. how to run a statistical significance test against something not detected ( should it be assumed 0 mean and 0 sd for the non-detected group? and then to determine with the desired p-value threshold?)  
  
  ---
  
  