How accurately does the Brief Job Stress Questionnaire identify workers with or without potential psychological distress?

Abstract

The manual for the Japanese Stress Check Program recommends use of the Brief Job Stress Questionnaire (BJSQ) from among the program's instruments and proposes criteria for defining "high-stress" workers. This study aimed to examine how accurately the BJSQ identifies workers with or without potential psychological distress. We used an online survey to administer the BJSQ with a psychological distress scale (K6) to randomly selected workers (n=1,650). We conducted receiver operating characteristics curve analyses to estimate the screening performance of the cutoff points that the Stress Check Program manual recommends for the BJSQ. Prevalence of workers with potential psychological distress defined as K6 score ≥13 was 13%. Prevalence of "high-risk" workers defined using criteria recommended by the program manual was 16.7% for the original version of the BJSQ. The estimated values were as follows: sensitivity, 60.5%; specificity, 88.9%; Youden index, 0.504; positive predictive value, 47.3%; negative predictive value, 93.8%; positive likelihood ratio, 6.0; and negative likelihood ratio, 0.4. Analyses based on the simplified BJSQ indicated lower sensitivity compared with the original version, although we expected roughly the same screening performance for the best scenario using the original version. Our analyses in which psychological distress measured by K6 was set as the target condition indicate less than half of the identified "high-stress" workers warrant consideration for secondary screening for psychological distress.