Longitudinal study provides a robust method for tracking developmental trajectories. Yet inherent problems of retesting pose challenges in distinguishing biological developmental change from prior testing experience. We examined factors potentially influencing change scores on 16 neuropsychological test composites over 1year in 568 adolescents in the National Consortium on Alcohol and NeuroDevelopment in Adolescence (NCANDA) project. The twice-minus-once-tested method revealed that performance gain was mainly attributable to testing experience (practice) with little contribution from predicted developmental effects. Group mean practice slopes for 13 composites indicated that 60% to ∼100% variance was attributable to test experience; General Ability accuracy showed the least practice effect (29%). Lower baseline performance, especially in younger participants, was a strong predictor of greater gain. Contributions from age, sex, ethnicity, examination site, socioeconomic status, or family history of alcohol/substance abuse were nil to small, even where statistically significant. Recognizing that a substantial proportion of change in longitudinal testing, even over 1-year, is attributable to testing experience indicates caution against assuming that performance gain observed during periods of maturation necessarily reflects development. Estimates of testing experience, a form of learning, may be a relevant metric for detecting interim influences, such as alcohol use or traumatic episodes, on behavior.