In spite of the importance of understanding in science learning, there is a shortage of tests that measure the level of understanding of high school students in physics. Thus, the objective of our research is to develop a test measuring the students’ level of understanding of kinematical concepts in high school physics which is valid as a diagnostic tool. The analysis of answers by an item response model shows that the levels of understanding defined by the test are well separated and constitute a hierarchical and cumulative scale.