Methodology and experimental research in software engineering

Abstract

There has been a very rapid increase in the use of psychological experimentation as a method for addressing problems in the area of software engineering. However, there is a total lack of understanding on how to use this technique effectively so that the results of the experiment will have both validity and wide applicability. This paper describes what we feel is a major new research area which aims at formalizing the use of controlled group experimentation in programming language design and software engineering. The paper describes the growth of the problem, the critical need for this new research area and finally categorizes the problems that must be addressed as part of the research into these problems. An annotated bibliography contains literature references (through 1978) to the use of controlled group experimentation in software engineering and related areas of Computer Science.