Statistical process control charts for better analysis of sequential data in psychology: The case of illusion of control experiments.

Abstract

Illusion of control (IOC) is a bias in the judgment of personal success with implications to learning theories and health policies; some important questions in the investigation of IOC may be related to traditional measures in the field, namely self-assessment using Likert scales about the sense of control. Statistical process control (SPC) and Shewhart charts are methods developed to monitor and control industrial processes, never applied in psychological studies before. The present two studies investigated the use of the technique of Shewhart charts in the analysis of IOC. The purpose was to explore the use of SPC and Shewhart charts in the analysis of data sequences from psychological experiments; the objective was to analyze the results of reaction time (RT) data sequences plotted in SPC charts, in comparison with self-assessment judgments from an IOC task. Participants were 63 undergraduate students (Study 1) and 103 mine workers (Study 2) instructed to try to control a traffic light on a computer by pressing or not the keyboard. Higher probabilities of the successful outcome generated judgments of illusion and shifts (due to cognitive activity) in the charts of RT; lower probabilities resulted in null illusion and RT presented a random and stable profile. Patterns for different groups emerged in Shewhart charts. SPC can contribute to the analysis of the behavior of sequences of data in psychological studies, so that the charts indicate changes and patterns not detected by traditional ANOVA and other linear models.