Program Evaluation and Quality Control

Abstract

It is probably true to say that the topic of techniques for carrying out evaluations of language programs has not received as much attention as have the other topics dealt with in these EXPLORATIONS Seminars (with the possible exception of the first in this series, which examines the role of research in the formulation of language policy). There are many reasons why the topic of program evaluation has received less attention than, say, program design or teacher training or classroom techniques. Evaluation can be regarded as of a lower priority than the more obviously immediate activities associated with design and planning. Evaluation can be regarded as something to be done in the future, once the program is 'ready' for it. And with budget priorities being given to the more obviously creative aspects of program design, and the constantly evolving nature of the planning function, that future never comes and the program is never quite 'ready' for the scrutiny of the evaluation step. Another reason for neglect is to be found in a common perception of the nature of evaluation. In this commonly held perception, program evaluation requires those who have been most intimately involved in its conception, design and implementation to step aside and abandon their creation to the attention of an alien, outside individual or group of individuals who will measure it, analyze it, judge it, and present their findings in a report replete with statistical tables not easily understood by the program stakeholders for whose enlightenment the evaluation was purportedly carried out. This is an unfortunate and inaccurate perception of program evaluation. Unfortunate, because it encourages those responsible for program design and planning to hold evaluation at arms length instead of embracing it as an important and valuable management aid. Inaccurate, because it does not do justice to evaluation as a cooperative venture involving the active participation of program personnel and the evaluation specialist in an endeavour designed to answer questions of importance to program stakeholders. It would be counter-productive if not quite misleading to attempt to provide a unique formulaic set of procedures for program evaluation.