Examining the Assessment of Creativity with Generalizability Theory: A Worked Example using Creative Problem Solving Assessment Tasks
<|begin_of_text|><|start_header_id|>system<|end_header_id|> You are a research archivist expert in dataset metadata. Answer the question truthfully.  <|eot_id|><|start_header_id|>user<|end_header_id|> Here is the Description of a dataset. Description:'The assessment of creativity is challenging. Elements of an assessment procedure, such as the creativity tasks that are used and the raters who assess those tasks, introduce variation in student scores that do not necessarily reflect actual differences in students’ creativity. This may bias assessments of students’ creativity levels. When researchers evaluate creativity assessment procedures, they often inspect these elements like tasks and raters separately. This dataset includes data from two creative problem solving (CPS) tasks from 137 primary school students, rated on 3 CPS aspects (originality, completeness, practicality) by two raters. With this dataset, we show that the use of Generalizability theory allows researchers to investigate creativity assessment procedures more comprehensively and in an integrated way' . Please return only a json list of at most 3 Keywords corresponding to the Description:.<|eot_id|><|start_header_id|>assistant<|end_header_id|> {"Answer" : ["assessment","creative problem solving","creativity","generalizability theory"]} <|eot_id|>
 Here is the Description of a dataset. Description:'The assessment of creativity is challenging. Elements of an assessment procedure, such as the creativity tasks that are used and the raters who assess those tasks, introduce variation in student scores that do not necessarily reflect actual differences in students’ creativity. This may bias assessments of students’ creativity levels. When researchers evaluate creativity assessment procedures, they often inspect these elements like tasks and raters separately. This dataset includes data from two creative problem solving (CPS) tasks from 137 primary school students, rated on 3 CPS aspects (originality, completeness, practicality) by two raters. With this dataset, we show that the use of Generalizability theory allows researchers to investigate creativity assessment procedures more comprehensively and in an integrated way' . Please return only a json list of at most 3 Keywords corresponding to the Description:.
The assessment of creativity is challenging. Elements of an assessment procedure, such as the creativity tasks that are used and the raters who assess those tasks, introduce variation in student scores that do not necessarily reflect actual differences in students’ creativity. This may bias assessments of students’ creativity levels. When researchers evaluate creativity assessment procedures, they often inspect these elements like tasks and raters separately. This dataset includes data from two creative problem solving (CPS) tasks from 137 primary school students, rated on 3 CPS aspects (originality, completeness, practicality) by two raters. With this dataset, we show that the use of Generalizability theory allows researchers to investigate creativity assessment procedures more comprehensively and in an integrated way
assessment; creative problem solving; creativity; generalizability theory