Fall 2013 Information Literacy Reliability Criteria Link to GE Assessment Inter-rater Reliability Mapping (Outcome) (calculated as Kappa) Citation (4a.2 & 4b.2) 1a-Analyze, synthesize, .31 and/or evaluate ideas, concepts, and/or evidence. Evaluating Assumptions 1a-Analyze, synthesize, .08 (4a.1, 4b.1, 4a.2 & 4b) and/or evaluate ideas, concepts, and/or evidence. Identifying Key 1b-Describe diverse .19 Concepts and Sources aspects of a discipline (4a.1, 4) using discipline-specific concepts. Selecting Appropriate 1b-Describe diverse .15 Sources (4a.2 & 4b.2) aspects of a discipline using discipline-specific concepts. Types of Source 1c-Apply appropriate .31 Materials (4a.1 & 4b.1) problem-solving strategies to issues *Rubric reliability: α = .92
Fall 2013 Information Literacy Reliability Criteria Link to GE Assessment Mapping (Outcome) Inter-rater Reliability (calculated as Kappa) Citation (4a.2 & 4b.2) 1a-Analyze, synthesize, and/or evaluate ideas, concepts, and/or evidence. .31 Evaluating Assumptions (4a.1, 4b.1, 4a.2 & 4b) 1a-Analyze, synthesize, and/or evaluate ideas, concepts, and/or evidence. .08 Identifying Key Concepts and Sources (4a.1, 4) 1b-Describe diverse aspects of a discipline using discipline-specific concepts. .19 Selecting Appropriate Sources (4a.2 & 4b.2) 1b-Describe diverse aspects of a discipline using discipline-specific concepts. .15 Types of Source Materials (4a.1 & 4b.1) 1c-Apply appropriate problem-solving strategies to issues .31 *Rubric reliability: α = .92