Developing and validating an online situational judgment test on the stress coping competence of nursing apprentices

Abstract

Converging evidence of high stress levels in the nursing profession as well as their detrimental effects on the execution of nursing actions, quality indicators of care, and self-reported job satisfaction justify the need for test environments that assess stress coping competences in dealing with domain-specific stress factors. Reliable and valid information on the test takers’ stress coping competence can help to identify individual deficits and supportive needs and thus, to design training measures that may contribute to job retention and a skilled workforce. This article describes the development and validation of a digital assessment that ensures authenticity by means of video-based situational judgement tests. Analyses of the performance data were conducted in four steps: (1) the scaling of the data with a partial credit model in order to identify items that are subject to measurement error, (2) differential-item-function analyses for different specializations in nursing education, (3) dimensionality tests, and (4) correlations between test performance and perceived psychological work stress in order to gauge criterion validity. The total sample consisted of n = 300 German nursing apprentices. The results show that the developed test instrument can be used for a reliable and valid measurement of coping skills of (prospective) nurses, covering two essential dimensions. Limitations of the current study and related objectives of future research are discussed together with questions of practical applicability.