Effectiveness Of Information Systems Research Articles

Information systems effectiveness: research designs for causal inference

Abstract. This paper examines the capacity of the research designs of 37 empirical studies of information systems (IS) effectiveness to provide a basis for the development of theories about behaviour related to IS effectiveness. The power of each study to support causal inference was evaluated in terms of (a) its handling of the time dimension, (b) its ability to weigh differences and (c) its resistance to internal validity threats that pose alternative explanations for its reported findings. Of the reviewed studies, 29.7% could account for the time dimension, 32.4% employed a comparison group and 16.2% were not susceptible to any internal validity threats. Only 13.5% of the studies combined an accounting for the time dimension with the use of a comparison group. Of these, however, only 5.4% were also invulnerable to internal validity threats. The research designs of nearly 95% of these published studies were deficient in supporting causal inference. In those studies, suggestions that one variable was causally related to another variable could not be substantiated. Encouragement for the future capacity of IS effectiveness research to support causal inference was found in a trend towards the use of quasiexperimental designs. Recommendations are made regarding ways to increase the inferential capacity of research designs employed in the study of IS effectiveness.

A Theoretical Assessment of the User-Satisfaction Construct in Information Systems Research

For nearly two decades, the user-satisfaction construct has occupied a central role in behavioral research in Information Systems (IS). In industry, the construct has often been used as a surrogate for IS effectiveness. Given its widespread use by both academics and practitioners, it is surprising that no comprehensive theoretical assessment of this construct has been performed. This paper provides such a review. It begins by examining conceptual and theoretical limitations of the construct's use as a measure of IS effectiveness. Attention is then focused on the evolution of the construct in the literature and the theoretical problems associated with its broader use. The fundamental similarity between user satisfaction and the social and cognitive psychologists' notion of an attitude is suggested. The next sections focus on a discussion of attitude structures and function. First, alternative theoretical views on attitude structure are presented. While one of these structures, the family of expectancy-value models, is reflected in current research on user satisfaction, the second, the family of cognitive approaches, is not. The two attitude structures are considered from the perspective of possible refinements to future work in IS. Next, an examination is made of the ways in which these structures have been integrated in terms of understanding the relationship of users' affective responses to other responses (i.e., behavior or cognition). This leads to a discussion of the function attitudes might serve for the user other than the evaluation of an information system or IS staff. Finally, the question of how behavior influences attitude is considered. The paper concludes with suggestions for future work.

Towards a framework for the study of the antecedents and consequences of information systems in organizations

Researchers and practitioners are increasingly emphasizing the need for the development of new forms of information systems to meet the changing requirements of their organizational users. If changes in information systems are to occur, they will need to be based on a comprehensive understanding of the antecedents and consequences of such systems within organizations. By focussing on the relationship which exists at the interface between information systems and their organizational context, the paper presents a framework within which systems can be studied and their consequences explained. In so doing, considerable importance is attached to the part played by the beliefs and expectations of those involved with both the development and use of information and control systems.

Assessing The Performance Impacts of Information Systems From The Resource-Based Perspective: An Empirical Test of The Indirect Effect of IS

Research into the strategic impacts of information systems (IS) from the resource-based view of competitive advantage has increasingly embraced the indirecteffect of IS on firm performance; that is, IS interact with other complementaryorganizational resources in influencing firm performance. Using both survey andarchival data, this study set out to test the indirect effect of IS and determine thecomplementary organizational resources contributing to IS impacts on firm performance.The results provide additional evidence in support of the indirect performanceeffect of IS. Specifically, the study found that the performance impacts ofIS arose from their interactions with firm-specific knowledge, information, verticalintegration and related diversification that complemented IS.