Samuel Greiff
The Field of Psychological Assessment: Where it Stands and Where it’s Going – A Personal Analysis of Foci, Gaps, and Implications for <i>EJPA</i>
University of Luxembourg
free accessthe field psychological assessment stands going personal analysis foci gaps implications ejpasamuel greiffsamuel greiff cognitive science assessment university luxembourg esch luxembourg search papers authorpublished onlinefebruary 15 2017httpsdoiorg10102710155759a000412pdf toolsadd favoritesdownload citationstrack citations shareshare onfacebooktwitterlinkedinreddit sectionsmorean initial overviewabout 5 years ago submitted first time paper coauthored colleague ejpa scanned types articles ejpa usually published time honestly wasnt sure whether articles content area assessment focus would fit journals scope new editor ejpa faced question somewhat different level articles interesting community journal even potential gaps field assessment exist gaps filledto obtain broad overview ran crude thus admittedly comprehensive search web science combining search terms psychological assessment various search terms acknowledging different data bases might lead different search results bakkalbasi bauer glover wang 2006 allow comparison timerelated developments ran search first years 20142016 years 20082010 results search displayed figure 1figure 1 number publications field psychological assessment subdisciplines shaded bars represent absolute frequencies left yaxis unshaded bars represent relative frequencies right yaxis search conducted january 8 2017 web science combined search terms psychological assessment clinic clinical assessment education educational assessment industrial organizational io personality personality methodolog methodology cogniti cognitive relative frequencies sum 100 overall hits matched one subcategories subcategories mutually exclusivein looking numbers two main messages took first field psychological assessment rise number hits 2014 2016 1411 hits increased almost 50 compared 2008 2010 976 hits seen comparing left right sides figure 1 second focus assessment fields clinical cognitive educational psychology strong slight increase number hits last followed articles methodological topics assessment personality assessment note search none categories mutually exclusive surprisingly hits conducted search industrial organizational assessment likely problem particular search terms used much reality small number publications area might also indicate area could strongly represented psychological assessment journals addition issue relative frequencies different fields remained virtually unchanged first second time periods seen comparing pattern unshaded bars left 20142016 ones right 20082010after running search taking look published ejpa past felt overall journal comprehensively reflects diversity field core mission journal advance psychological assessment across content disciplines continue strive coming years stated differently submissions psychological content areas welcome long focus advancements field assessment known submitting first paper 5 years ago would bit confident sending ejpa letter editor might also stressed explicitly article provided good match journals focus assessmenttradition innovationwe live world constant change technology significantly altered way society functions field psychological assessment immune influences innovative assessment instruments employ computerbased simulations use behavioral processrelated data improve assessment process cf stealth assessment shute ventura 2013 widen extent existing instruments able capture constructs examples area might contribute field instance oecds educational largescale assessment program known program international student assessment pisa computeradministered science tasks including simulations interactive tasks employed allow realistic diverse set science literacy tasks eg oecd 2016paperpencilbased instruments classical tests intelligence personality questionnaires currently remain backbone psychological assessment science surrounding fact almost submissions ejpa fall category two recent examples see schult fischer hell 2016 smits timmerman barelds meijer 2015 addition kinds papers journal explicitly invites submissions target innovative assessment approaches whether involve technological devices computers tablets sort innovationof course personal choice explicitly mention innovative assessment computerbased testing areas major development welcomed journal however meant shift focus rather extension existing focus fact surprised see small extent innovative assessment methods instruments represented conducted literature search addon analysis combined two major search terms psychological assessment one following terms 21st century skills stealth computer based computer assisted tablet overall hit rate less 1 included even first submission ejpa low level representation back minds vision field experience advancements coming years utilize new technologies way complement assessment theory practice turn lead valid assessment procedures research applied settingsimplications authors publication processirrespective content mission ejpa arguably field psychological assessment entity built three distinct cornerstones firm connection field psychological science focus assessment substantial advancement knowledge field commitment highest levels quality transparency empirical aspects contributionsstrong ties psychological science saying assessment instrument needs grounded psychological theory might viewed people statement obvious surprising often simple yet fundamental prerequisite fulfilled often assessment instruments name label mistaken actual content remains unclear items actually mapped onto underlying theoretical definition many cases relevant aspects theory adequately represented set tasks complex target construct prevalent issue likely cases clear distinction theoretical framework assessment framework might help clarify assessment instrument contains blind spots even deliberate regard construct coverage cf michie johnston francis hardeman eccles 2008 interesting analysis connect theory intervention without giving precise meaning assessment instrument psychological theory developing validating instrument remains essentially empty exercisefocus assessment advancement knowledge number submissions ejpa consistently rise mirroring increase number articles published field psychological assessment figure 1 increase submissions turn means selection criteria need applied thus amount new knowledge generated article assessment perspective important one submissions mainly target substantive research questions secondary focus assessment better fit contentfocused journals many excellent ones obviously evaluation amount new knowledge created article extent subjective one authors need peruse journal wish find plethora good examples articles generate considerable amounts new knowledge however articles target specific research questions might relevant ejpa well brief reports introduced couple years ago consequence need dedicated format specific research questions ejpa offers variety distinct formats ie original articles brief reports multistudy reports communicated previous editorials topics usually little interest ejpa papers primarily methodological nature papers offer translations existing instruments ziegler bensch 2013quality transparency ejpa dedicated upholding scientific standards highest possible quality adhering process rigorous peer review ensure aspects attracting highly committed associate editors experienced board consulting editors handpicked external reviewers time acknowledge transparency becoming increasingly important maybe particular field psychological science sometimes final manuscript end product sufficient communicating complete understanding done psychological assessment probably actual empirical analyses implemented key findings mind authors option submit codes results ie inputs outputs statistical software packages mplus r sas spss forth along manuscripts information passed external reviewers inspection additional measure article accepted publication ejpa authors henceforth required submit inputs outputs along brief description electronic supplementary material esm information published along final articlewith first editorial goal cover general developments field psychological assessment aspects fundamental publishing ejpa probably surprises regard deemed important sometimes helpful explicate implicit fact thinking back first submission article underwent several rounds revisions finally accepted aware points mentioned editorial might spared reviewers matter least one round revisionit hope spirit editorial written provide general information broad yet relevant might help guide authors decisions whether ejpa good outlet research stated differently help determine maximize chance success ejpa past future editorials continue address diverse topics assessmentrelevant methodological aspects journalrelated policy information thoughts opinions respect field psychological assessmentreferences bakkalbasi n bauer k glover j wang l 2006 three options citation tracking google scholar scopus web science biomedical digital libraries 3 7 doi 1011861742558137 first citation articlecrossref google scholar michie johnston francis j hardeman w eccles 2008 theory intervention mapping theoretically derived behavioural determinants behaviour change techniques applied psychology 57 660680 doi 101111j14640597200800341x first citation articlecrossref google scholar oecd 2016 pisa 2015 assessment analytical framework science reading mathematic financial literacy paris france oecd publishing doi 1017879789264255425en first citation articlecrossref google scholar schult j fischer f hell b 2016 tests scholastic aptitude cover reasoning facets sufficiently european journal psychological assessment 32 215219 doi 10102710155759a000247 first citation articlelink google scholar shute v j ventura 2013 measuring supporting learning games stealth assessment cambridge mit press first citation articlecrossref google scholar smits timmerman e barelds p h meijer r r 2015 dutch symptom checklist90revised use subscales justified european journal psychological assessment 31 263271 doi 10102710155759a000233 first citation articlelink google scholar ziegler bensch 2013 lost translation thoughts regarding translation existing psychological measures languages european journal psychological assessment 29 8183 doi 10102710155759a000167 first citation articlelink google scholarsamuel greiff cognitive science assessment university luxembourg 11 porte des sciences 4366 eschsuralzette luxembourg samuelgreiffunilufiguresreferencesrelateddetailscited byvalidly authentic recommendations researchers using simulations psychological assessmentmatthias stadler dragos iliescu samuel greiff6 december 2021 european journal psychological assessment vol 37 6evolutions testing research future likely bringdragos iliescu samuel greiff15 february 2021 european journal psychological assessment vol 37 1introducing new open science practices ejpasamuel greiff lindie van der westhuizen marcus mund john f rauthmann eunike wetzel30 november 2020 european journal psychological assessment vol 36 5clinical research utility highly sensitive person scalejournal mental health counseling vol 41 3ejpa introduces registered reports new submission formatsamuel greiff mark allen31 august 2018 european journal psychological assessment vol 34 4assessing behavior difficulties studentscarmen l zurbriggen susanne schwab anke de boer ute koglin28 march 2018 european journal psychological assessment vol 34 2how make sure paper desk rejected practical guide rejection ejpasamuel greiff matthias ziegler7 april 2017 european journal psychological assessment vol 33 2 volume 33issue 1january 2017issn 10155759eissn 21512426 informationeuropean journal psychological assessment 2017 33 pp 14 httpsdoiorg10102710155759a000412 2017hogrefe publishingpdf download