This study compares the contribution of item analysis methods developed in classical psychometrics and in the context of generalizability theory for the optimization of the dependability of educational measures. To this end, it shows which method to use in order to increase reliability or to reduce the impact of random fluctuations affecting the measure. Apart from the conclusions reached, the study raises questions that could be addressed through further research.