The Problem of Common Method Variance in IS Research

Abstract

Many IS researchers obtain data through the use of self-reports. However, self-reports have inherent problems and limitations, most notably the problem of common method variance. Common method variance can cause researchers to find a significant effect, when in fact, the true effect is due to the method employed. In this chapter, we examined published research in leading information systems (IS) journals to determine if common method variance is a potential problem in IS research and how IS researchers have attempted to overcome problems with method bias. We analyzed 116 research articles that used a survey approach as the predominant method in MIS Quarterly, Information Systems Research, and Journal of Management Information Systems. The results indicate that only a minority of IS researchers have reported on common method variance. We recommend that IS researchers undertake techniques to minimize the effects of common method variance, including using multiple types of respondents, longitudinal designs, and confirmatory factor analysis that explicitly models method effects.