Using a Delphi study to identify effectiveness criteria for environmental assessment

Abstract

Effectiveness is a long-standing issue in impact assessment (IA) practice and research – the theme is fundamental to the continued development and improvement of IA, and is essential to understanding its impacts on and contributions to environmental management. Understanding effectiveness not only requires attention to the variables that shape the context within which an IA system operates, but it also requires gauges for evaluation. In this paper, we present the results of a Delphi study conducted to develop criteria that can be used in appraisal or audits of IA effectiveness. Involving 55 IA experts, the Delphi resulted in 49 criteria, organized into nine themes. Although the framework of criteria was developed for analysis of the Canadian assessment setting, the criteria can have value to other jurisdictions. The Delphi wove sustainability throughout the criteria rather than set it as a single criterion. While context remains a key theme in evaluation, the Delphi demonstrates that there may be universal qualities that IA should possess if it is to be an effective environmental management tool, and these may transcend context.