&gt; Larger datasets will always lead to more statistical confidence<p>I think I understand what you&#x27;re trying to say, but I don&#x27;t agree with how you&#x27;ve phrased it.  More data can lower p-values or increase power for a given analysis, but the assumptions that go into using data don&#x27;t change when you simply have more of it.  And those assumptions are everything in statistics.<p>In fact, I think the temptation of &#x27;more is better&#x27; leads to more use of what is easily available which can be highly biased.  You also get much more &#x27;significant&#x27; results that are more tempting to believe in.  It&#x27;s harder to shy away from a very low p-value, even when you know the sampling may not be appropriate.<p>I&#x27;m a biologist, and as a field we have a lot of issues to address with bioinformatics.  Over-eager investigators will pull out interesting tidbits from datasets without considering how problematic that sort of hypothesis generation can be.  Fortunately the grant reviewers seem to be well aware of this for the most part.  I&#x27;ve heard of many people having grants rejected because they thought they found a &#x27;one in a million&#x27; phenomenon, but it turns out they looked a million times to find it :)  Good bioinformatics is still firmly grounded in genetics.