Rethinking Carelessness on Job Analysis Surveys

Abstract

This study examines bogus tasks embedded in a job analysis survey as a method to contribute to our understanding of the factors that impact the accuracy of job analysis ratings. The results show that incumbents accurately report if they have performed a task within the past 12 months, but were inaccurate when deciding if they were expected to perform a bogus task. Also, carelessness was positively correlated with ratings on valid tasks and supervisors and incumbents were equally careless. These findings contribute to the literature by showing that the rating “inferential leap” applies to the rating scale as well as the descriptor. They also provide additional support for removing inaccurate raters from the analysis. Finally, the findings suggest that raters may focus on broader role expectations rather than the specific task statements while completing job analysis questionnaires.