Enhancing knowledge construction processes within multicriteria decision analysis: The Collaborative Value Modelling framework

Abstract

This paper proposes a new Collaborative Value Modelling framework, that combines Delphi and multicriteria decision conferencing, to build widely informed evaluation models. Multicriteria Decision Analysis (MCDA) is commonly used to help decision-makers and other stakeholders in complex evaluation contexts. Further to the technical soundness and meaningfulness of the methods and tools used, it is critical to design adequate social processes to promote shared understanding around key evaluation issues while capturing multiple stakeholders’ values and perspectives. Multicriteria decision conferencing processes have been typically adopted for collaborative modelling using MCDA methods in decision conferences with relatively small groups. Such a socio-technical approach has proven to be effective, in a variety of contexts, in creating a collaborative environment that enables surfacing individual beliefs, identifying common concerns, managing eventual value conflicts and promoting agreement in group model building. But, extending this framework to broader participatory contexts requires a different design of the social process, in order to ensure that model building captures the full panoply of points of view. This challenge can be tackled by enhancing multicriteria decision conferencing with an all-embracing (Web-)Delphi participatory process. We depart from the existing collaborative knowledge acquisition methodology to design, with the Delphi method, a participatory knowledge construction process that elicits and analyses individual judgemental knowledge from a (very) large and diverse number of stakeholders. The knowledge acquired is then digested by a small group of key-players, in a subsequent decision conferencing, to collaboratively develop a widely informed multicriteria evaluation model. This new Web-Delphi-decision conferencing social setting has been tested already in real complex evaluation contexts using a specific multicriteria method, the Measuring Attractiveness by a Categorical Based Evaluation Technique (MACBETH), to develop a variety of value modelling activities. We call this socio-technical design the Collaborative Value Modelling framework. Here, we describe its real use to support the construction of value functions, focusing on how the judgemental knowledge collected flows between the participatory and collaborative stages of the framework. Results validate that enhancing MACBETH decision conferencing with an ex ante Web-Delphi process fosters higher participation and collaboration in multicriteria modelling.