Table 1 Sources of Validity Evidence Summarized in this Supplemental Report for PASA Reading, Math, and Science Description Evidence Validity Concern Findings Uses/Changes Proficiency Item frequencies of Construct were some items from Study provided preliminary Study proficient A students higher level test that information about student taking B and students could do. Students performance on higher level proficient B students performed less well on items, but only proficient taking C items items from higher test level students were assessed. than on items at their Prompted a large scale assigned test level study as a follow up. Proficiency Item frequencies of Construct were several items Results will be used in 2011-12 proficient A students from each higher level test conjunction with results Appendix B taking B items and form that students could do, from the 2012-13 proficient B students including some items for proficiency study to taking C items which a large percentage of examine any needed students (e.g., above 60%) restructuring of the PASA assigned to a lower test Additional item level level could earn a score of 5. analyses are currently being explored to further examine learning progressions. Proficiency Study Item frequencies of Construct Planning Stage, to be Results will be used in 2012-13 students at each grade conducted in Spring 2013 conjunction with results level on items within from the 2011-12 the same content proficiency study to strand across grades examine any needed restructuring of the PASA LCI LCI data from teachers Consequential PASA students have similar Methods for identifying Appendix C who administered PASA Construct learning characteristics to students for the PASA will in 2010-11. Utilized students taking AA-AAS remain. Results suggest subset of LCI responses across states. Some some differences in A, B and
Table 1 Sources of Validity Evidence Summarized in this Supplemental Report for PASA Reading, Math, and Science Description Evidence Validity Concern Findings Uses/Changes Proficiency Study Item frequencies of proficient A students taking B and proficient B students taking C items Construct were some items from higher level test that students could do. Students performed less well on items from higher test level than on items at their assigned test level Study provided preliminary information about student performance on higher level items, but only proficient students were assessed. Prompted a large scale study as a follow up. Proficiency 2011-12 Appendix B Item frequencies of proficient A students taking B items and proficient B students taking C items Construct were several items from each higher level test form that students could do, including some items for which a large percentage of students (e.g., above 60%) assigned to a lower test level could earn a score of 5. Results will be used in conjunction with results from the 2012-13 proficiency study to examine any needed restructuring of the PASA Additional item level analyses are currently being explored to further examine learning progressions. Proficiency Study 2012-13 Item frequencies of students at each grade level on items within the same content strand across grades Construct Planning Stage, to be conducted in Spring 2013 Results will be used in conjunction with results from the 2011-12 proficiency study to examine any needed restructuring of the PASA LCI Appendix C LCI data from teachers who administered PASA in 2010-11. Utilized subset of LCI responses Consequential Construct PASA students have similar learning characteristics to students taking AA-AAS across states. Some Methods for identifying students for the PASA will remain. Results suggest some differences in A, B and
2012%20Validity%20Supplemental%20Report.docx