Abstract
In the process of designing a continuous improvement process for a set of personal attribute self-reporting assessments, an opportunity was seen to combine assessment analytics with brain activity to capture decision-making pathways while responding to assessment items. This pilot triangulation process is designed to address response process validation, as described by The American Psychological Association to begin to better understand whether the responder is following the intended purpose of the assessment. Method: The protocol involves collecting electroencephalographic (EEG) data, using standardized low-resolution brain electromagnetic tomography (sLORETA) to analyze and view voxel images of real-time brain activity collected while a participant responds to assessment items. This analysis examines gamma asymmetry in the frontal lobes, as well as opening the door to further wave comparisons in the future. Conclusions: The protocols used to expose the mindset of assessment responders will be shared, as well as pilot insights gained as a result of this imaging process. By collecting images from the moment of stimulus exposure to the moment that the respondent selects a likert scale answer, insights are gathered that include: how final answers compare to brain processing data, brain decision-making pathways when exposed to reverse or double negative assessment items, exposure of brain processing when faced with socially loaded statements, resulting brain processing of neutrally scored stimulus, and insights gained when all of this data is cross-walked against quantitative item analysis of population data such as inter-item correlations and item factor loading based on exploratory factor analysis.
Highlights
In the process of designing a continuous improvement process for a set of personal attribute self-reporting assessments, an opportunity was seen to combine assessment analytics with brain activity to capture decisionmaking pathways while responding to assessment items
The American Psychological Association (APA) Handbook of Testing and Assessment in Psychology states that assessment response processes require the collection of evidence demonstrating that the test taker is cognitively processing and properly interpreting the intended purpose of test items (Sireci & Sukin, 2013)
Some studies have used magnetic resonance imaging (MRI) to see which regions of the brain are activated when responding to tasks, most studies of response processes use indirect means such as cognitive interviews, think-aloud protocols, focus groups, or analysis of answer patterns and item response time data and attempt to set the stage with introductory statements of purpose (Sireci & Sukin, 2013, p. 76)
Summary
In the process of designing a continuous improvement process for a set of personal attribute self-reporting assessments, an opportunity was seen to combine assessment analytics with brain activity to capture decisionmaking pathways while responding to assessment items. Some studies have used MRI to see which regions of the brain are activated when responding to tasks, most studies of response processes use indirect means such as cognitive interviews, think-aloud protocols, focus groups, or analysis of answer patterns and item response time data and attempt to set the stage with introductory statements of purpose
Sign-in/Register to view highlights & summary Sign-in/Register to access full text options 
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a callDisclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.
