Measuring Attractiveness By A Categorical Based Evaluation Technique Research Articles

Development of a Multi-Criteria Model for Sustainable Reorganization of a Healthcare System in an Emergency Situation Caused by the COVID-19 Pandemic

Healthcare systems worldwide are facing problems in providing health care to patients in a pandemic caused by the SARS-CoV-2 virus (COVID-19). The pandemic causes an extreme disease to spread with fluctuating needs among patients, which significantly affect the capacity and overall performance of healthcare systems. In addition, its impact on the sustainability of the entire economic and social system is enormous and certain sustainable management strategies need to be selected. To meet the challenges of the COVID-19 pandemic and ensure sustainable performance, national healthcare systems must adapt to new circumstances. This paper proposes an original multi-criteria methodology for the sustainable selection of strategic guidelines for the reorganization of a healthcare system under the conditions of the COVID-19 pandemic. The selection of an appropriate strategic guideline is made on the basis of defined criteria and depending on infection capacity and pandemic spread risk. The criteria for the evaluation of strategic guidelines were defined on the basis of a survey in which the medical personnel engaged in the crisis response team during the COVID-19 pandemic in the Republic of Serbia participated. The Level-Based Weight Assessment (LBWA) model and Measuring Attractiveness by a Categorical-Based Evaluation Technique (MACBETH) method were used to determine the weight coefficient criteria, while a novel fuzzy Ranking of Alternatives through Functional Mapping of Criterion Subintervals into a Single Interval (RAFSI) model was used to evaluate the strategic guidelines. The proposed multi-criteria methodology was tested in a case study in the Republic of Serbia. The validity of the proposed methodology is shown through the simulation of changes in input parameters of Bonferroni aggregation functions and through a comparison with other multi-criteria methodologies.

Development of a drinking water quality index based on a participatory procedure using mixed multicriteria methods.

The objective of this study is to propose and apply a novel approach to develop a drinking water quality index that enables water managers to routinely identify the vulnerabilities in a distribution system (DS) while taking into account the priorities of water managers and operators. Here, we propose an innovative approach based on the participation of eight researchers and water managers. The input from these participants was included through a combination of the Delphi and MACBETH (Measuring Attractiveness by a Categorical-Based Evaluation Technique) methods, which were applied to an index developed using fuzzy logic. The index was then validated by conducting sensitivity and comparative analyses on a database from field sampling campaigns conducted in various small municipal DSs in two Canadian provinces: Quebec and Newfoundland and Labrador. Finally, the drinking water quality index was applied to a database of the DS in Quebec City, Canada. Sensitivity and comparative analyses revealed that the developed index could allow for the characterization of water sample quality and could prove useful for prioritizing interventions in the DS. The index was also useful for representing the spatial variability of water quality, and provided nuanced information about water quality, especially when the water quality parameter values complied with guidelines and regulations. These results provide a transferable and integrated approach for developing customized drinking water quality indices. This study will help pave the way for water quality managers to better prevent episodes of possible water quality deterioration.

Assessment of Social Responsibility in Education in Secondary Schools

The increase in the importance given to the social dimension of companies has led to an awareness in society of the right to require economic, social and environmental responsibility. Although several methodologies of corporate social responsibility (CSR) are being introduced in organizations, and in many others, it is already part of the corporate culture; however, it is a concept that is still being explored in the area of education, where there is no prior record of the application of a strategic assessment model in centers of learning. This study describes an innovative multicriteria model designed with the Measuring Attractiveness by a Categorical Based Evaluation Technique (MACBETH) approach to assess CSR in high schools. It is in high schools that students are old enough to internalize the different dimensions of CSR and to include it in their most personal values throughout their entire life. The model is constructed using judgements from three decision centers with a great deal of experience and an extensive professional history in the field of high school teaching. This model, built specifically for centers of learning, assigns a score to the various limits between levels of excellence, considered as actions to be determined to identify the level of centers of learning. The model can be used as a tool for the continuous improvement of CSR as it allows the strengths and weaknesses of each center in the area of educational sustainability to be recognized and action plans to be produced for those with the worst performance. Furthermore, the model can be used as a tool for benchmarking, that is, the comparison of CSR efficiency between high schools, and act as a way of attracting students. The model has been applied in three state high schools of very different types.

Fuzzy Multicriteria Models for Decision Making in Gamification

Gamification is an innovative teaching technique that may prove hugely beneficial when properly used. For this reason, since 2002, the number of situations in which gamification is used has increased exponentially. This large number of options makes it difficult to choose the best application, especially in circumstances where there is the usual uncertainty that real-life decision making involves. To address this problem, this study creates two models, one using a fuzzy analytic hierarchy process (AHP), and the other, which combines fuzzy AHP with the measuring attractiveness by a categorical-based evaluation technique (MACBETH) approach, to choose the best gamification application for the ‘Operations Management’ course, within the Masters in Industrial Engineering. This is the first contribution in the literature combining fuzzy AHP and MACBETH. The decision centre used was the lecturer who teaches the course. There is no precedent in the literature using fuzzy logic to choose the best gamification application for a course. The results of the study show that Socrative is the best gamification application for this course within the Masters, and, as the models begin to be used in degree courses, the better choice would be Quizizz, the more clearly the earlier the course is taught within the degree programme.

An artificial-intelligence-based method for assessing service quality: insights from the prosthodontics sector

PurposeThe prosthodontics sector is facing major challenges because of scientific and technological advances that imply a clearer definition of lines of action and decision making processes. Measuring quality of service in this sector is a complex decision problem since the perceptions of three main players need to be considered: patients, dentists and dental technicians. This study sought to develop an artificial-intelligence-based (AI-based) method for assessing service quality in the dental prosthesis sector.Design/methodology/approachUsing strategic options development and analysis (SODA), which is grounded on cognitive mapping, and the measuring attractiveness by a categorical based evaluation technique (MACBETH), a constructivist decision support system was designed to facilitate the assessment of service quality in the dental prosthesis sector. The system was tested, and the results were validated both by the members of an expert panel and by the vice-president of the Portuguese association of dental prosthesis technicians.FindingsThe methodological process developed in this study is extremely versatile and its practical application facilitated the development of an empirically robust evaluation model in this study context. Specifically, the profile analyses carried out in actual clinics allowed the cases in which improvements are needed to be identified.Originality/valueAlthough already applied in the fields of AI and decision making, no prior work reporting the use of SODA and MACBETH for assessing service quality in the prosthodontics sector has been found.

“AniFair”: A GUI Based Software Tool for Multi-Criteria Decision Analysis—An Example of Assessing Animal Welfare

Multi-criteria decision analysis deals with decision problems in which multiple criteria need to be considered. The criteria might be measured on different scales so that comparability is difficult. One approach to help the user to organize the problem and to reflect on his or her assessment on the decision is Measuring Attractiveness by a Categorical Based Evaluation TecHnique (MACBETH). Here the user needs to provide qualitative judgment about differences of attractiveness regarding pairs of options. MACBETH was implemented in the M-MACBETH software using the additive aggregation model. The present article introduces the software tool “AniFair” which combines the MACBETH approach with the Choquet integral as an aggregation function, because the Choquet integral enables the modeling of interaction between criteria. With the Choquet integral, the user can define constraints on the relative importance of criteria (Shapley value) and the interaction between criteria. In contrast to M-MACBETH, with every instance of “AniFair” the user is made available at least two aggregation level. “AniFair” provides Graphical User Interfaces for the entering of information. The software tool is introduced via an example from the Welfare Quality Assessment protocol for pigs. With this, “AniFair” is applied to real data that were collected from thirteen farms in Northern Germany by an animal welfare expert. The “AniFair” results enabled a division of the farms into five groups of comparable performance concerning the welfare principle “Good feeding”. Hereby, the results differed in how much the interaction between criteria contributed to the Choquet integral values. The shares varied from 5% to 55%. With this, the vulnerability of aggregation results towards relative importance of and interaction between criteria was stressed, as changes in the ranking due to the definition of constraints could be shown. All results were exported to human readable txt or csv files for further analyses, and advice could be given to the farmers on how to improve their welfare situation.

A MIXED INTERVAL TYPE-2 FUZZY BEST-WORST MACBETH APPROACH TO CHOOSE HUB AIRPORT IN DEVELOPING COUNTRIES: CASE OF IRANIAN PASSENGER AIRPORTS

Hub airports are the ones that model networks in which most journeys go via a few central points. Famous hub airports deliver positive social and environmental impact to the communities along with economic effects. This paper is about to investigate indicators related to hub performance excellence from various angles, considering leading hub airports performance while determining the priorities in order to help airports especially in developing countries to find the way of progress. A list of Key Performance Indicators (KPIs) is prepared from the literature, which is prioritized using Best-Worst Method (BWM). The weights of these criteria are specified via application of interval type-2 fuzzy BWM. Then using five most important criteria, MACBETH (Measuring Attractiveness by a Categorical Based Evaluation TecHnique) ranking approach is used to analyse 19 Iranian international airports and find the most appropriate one for being hub airport. The results show Kish airport with the International Civil Aviation Organization (ICAO) code “OIBK” is prior to other airports and can be chosen as the hub airport that means Iran airports holding company is suggested to focus more investments in this airport to gain fastest possible benefits of an international hub airport.

MCDA-based deliberation to value health states: lessons learned from a pilot study

BackgroundHealth economists have shown a growing interest in deliberation and multi-criteria decision analysis (MCDA) as possible pathways to transparently integrate value judgments in cost-utility analyses. In line with these developments, this study piloted a consensus process to derive a German value set for the Short-Form Six-Dimension (SF-6D). In a conference setting, a group was tasked to deliberate on scores and weights for the SF-6D from the perspective of a self-determined and independent life.MethodsThe one-day consensus conference was based on a deliberative process in combination with the MCDA method MACBETH (Measuring Attractiveness by a Categorical Based Evaluation Technique). According to MACBETH, participants were asked to qualitatively rate pairwise comparisons of SF-6D health states. The scoring within each dimension was conducted in parallel group sessions. Final agreement on the scores as well as weights for the SF-6D dimensions were derived in a subsequent plenary assembly. Results were analyzed using the software M-MACBETH and qualitative content analysis.ResultsA total of 34 participants were recruited. While each of the 6 small groups presented a consented score, the plenary assembly reached consensus on all dimensions apart from pain. Concerning dimension weights, some participants favored prioritizing pain and mental health. Others disputed that trade-offs between dimensions and thus assigning weights were not acceptable in a context where this may involve withholding care from someone. As a consequence, no consensus on a value set was reached. Participants identified the group size of the plenary session and the applied weighting procedure as main obstacles to the process.ConclusionsThis pilot study presents a consensus-based approach for valuing health-related quality of life. However, further research is needed on deliberative processes that yield quantifiable results. Future conferences should explore smaller group sizes, longer durations of the deliberative process and alternatives to the additive value function applied in MACBETH.

Optimization of Decision Making in the Supply of Medicinal Gases Used in Health Care

Systems that supply medicinal gases—oxygen, nitrous oxide and medical air—serve all care units of a hospital; for example, they feed distribution systems for operating theatres, neonatal and pediatric units, dialysis, X-ray, casualty, special tests, outpatients, etc. Systems for the provision of medicinal gases are therefore critical in guaranteeing hospital sustainability, since the functionality or availability of other hospital systems depends on them. Availability of 100% in these systems would avoid the need to reschedule patient appointments. It would also eliminate repeat testing, which poses risk to staff and patients, and could avoid affecting people’s lives through unavailability of, for example, operating theatres or intensive care units. All this contributes to a more rational resource consumption and an increase in quality of care both for the hospital itself and for patients and visitors. Although these systems are of vital importance to health care organizations, no previous work has been found in the literature that optimizes the technical decisions on supply in these systems. This research describes a model for these systems via continuous-time Markov chains. The results obtained are used in a multicriteria model constructed with the measuring attractiveness by a categorical-based evaluation technique (MACBETH) approach. In order to assess reliability when incorporating doubt or uncertainty via the MACBETH approach, the model has been validated by means of the fuzzy analytic hierarchy process. The aim is to obtain the best objective decision, with respect to the design of these systems, by analyzing the use of economic resources, the risks, and the impact on hospital activity, all with the aim of guaranteeing the best quality of care. The models constructed by means of MACBETH and the fuzzy analytic hierarchy process give, as the most suitable alternatives, duplicate the external supply in medical oxygen systems and maintain the original design conditions for supply systems of nitrous oxide and medicinal air.

Enhancing knowledge construction processes within multicriteria decision analysis: The Collaborative Value Modelling framework

This paper proposes a new Collaborative Value Modelling framework, that combines Delphi and multicriteria decision conferencing, to build widely informed evaluation models. Multicriteria Decision Analysis (MCDA) is commonly used to help decision-makers and other stakeholders in complex evaluation contexts. Further to the technical soundness and meaningfulness of the methods and tools used, it is critical to design adequate social processes to promote shared understanding around key evaluation issues while capturing multiple stakeholders’ values and perspectives. Multicriteria decision conferencing processes have been typically adopted for collaborative modelling using MCDA methods in decision conferences with relatively small groups. Such a socio-technical approach has proven to be effective, in a variety of contexts, in creating a collaborative environment that enables surfacing individual beliefs, identifying common concerns, managing eventual value conflicts and promoting agreement in group model building. But, extending this framework to broader participatory contexts requires a different design of the social process, in order to ensure that model building captures the full panoply of points of view. This challenge can be tackled by enhancing multicriteria decision conferencing with an all-embracing (Web-)Delphi participatory process. We depart from the existing collaborative knowledge acquisition methodology to design, with the Delphi method, a participatory knowledge construction process that elicits and analyses individual judgemental knowledge from a (very) large and diverse number of stakeholders. The knowledge acquired is then digested by a small group of key-players, in a subsequent decision conferencing, to collaboratively develop a widely informed multicriteria evaluation model. This new Web-Delphi-decision conferencing social setting has been tested already in real complex evaluation contexts using a specific multicriteria method, the Measuring Attractiveness by a Categorical Based Evaluation Technique (MACBETH), to develop a variety of value modelling activities. We call this socio-technical design the Collaborative Value Modelling framework. Here, we describe its real use to support the construction of value functions, focusing on how the judgemental knowledge collected flows between the participatory and collaborative stages of the framework. Results validate that enhancing MACBETH decision conferencing with an ex ante Web-Delphi process fosters higher participation and collaboration in multicriteria modelling.

A Judgment-Based Risk Assessment Framework for Consumer Loans

Credit to personal consumption is an important activity of the financial system and crucial to the socioeconomic development of a country. It is important, therefore, that the methods and techniques used to evaluate consumer credit risk be as efficient and informative as possible, in order to strengthen decisions to approve or reject credit and promote sustainable economic growth. This study aims to create a multiple criteria expert system which integrates cognitive maps and the measuring attractiveness by a categorical-based evaluation technique (MACBETH) to create a complementary framework for consumer credit risk assessment. The results show that this integrated approach allows the evaluation process of consumer credit risk to be more informed and transparent, providing value for the evaluation processes of this type of credit application as a result of the privileged contact established with a panel of credit analysts. Advantages, limitations, and managerial implications are also discussed.

An integrated method using MACBETH and EDAS methods for evaluating steam boiler alternatives

AbstractThe evaluation of steam boiler alternatives is a Multi‐Criteria Decision Making (MCDM) process and includes various alternatives and conflicting criteria. As selecting the most appropriate steam boiler affects the operating cost of the textile company, this decision process is crucial for the dyehouse. In the literature, various MCDM methods are proposed for evaluating the alternatives and selecting the most appropriate one among them. In this paper, the steam boiler alternatives that will be used in a dyehouse of a textile company are evaluated with an integrated MCDM method. This integrated method based on MACBETH (Measuring Attractiveness by a Categorical‐Based Evaluation Technique) and EDAS (Evaluation based on Distance from Average Solution) methods. MACBETH is used to determine the weights of the criteria and alternatives are ranked with EDAS method. At the end, the best steam boiler alternative is determined for the dyehouse of the textile company.

Valuing health states: is the MACBETH approach useful for valuing EQ-5D-3L health states?

BackgroundQuality Adjusted Life Years (QALYs) are a key outcome measure widely used within health technology assessment and health service research studies. QALYs combine quantity and quality of life, with quality of life calculations relying on the value of distinct health states. Such health states’ values capture the preferences of a population and have been typically built through numerical elicitation methods. Evidence points to these value scores being influenced by methods in use and individuals reporting cognitive difficulties in eliciting their preferences. Evidence from other areas has further suggested that individuals may prefer using distinct elicitation techniques and that this preference can be influenced by their numeracy. In this study we explore the use of the MACBETH (Measuring Attractiveness by a Categorical Based Evaluation Technique) non-numerical preference elicitation approach for health states’ evaluation.MethodsA new protocol for preference elicitation based on MACBETH (only requiring qualitative judgments) was developed and tested within a web survey format. A sample of the Portuguese general population (n=243) valued 25 EQ-5D-3L health states with the MACBETH protocol and with a variant of the time trade-off (TTO) protocol, for comparison purposes and for understanding respondents’ preference for distinct protocols and differences in inconsistent evaluations. Respondents answered to a short numeracy test, and basic socio-economic information collected.ResultsResults show that the mean values derived from MACBETH and the TTO variant are strongly correlated; however, there are substantial differences for several health states’ values. Large and similar numbers of logical inconsistencies were found in respondents’ answers with both methods. Participants with higher levels of numeracy according to the test preferred expressing value judgments with MACBETH, while participants with lower levels were mostly indifferent to both methods. Higher correlations between MACBETH and TTO variant evaluations were observed for individuals with higher numeracy.ConclusionResults suggest that it is worth researching the use of non-numerical preference elicitation methods. Numeracy tests more appropriate for preference elicitation when no explicit considerations of uncertainty are made need to be explored and used. Further behavioural research is needed to fully understand the potential for using these methods in distinct settings (e.g. in different evaluation contexts and in face-to-face and non-face-to-face environments), as well as to explore the effect of literacy on assessments and on respondents’ preferences.

Developing a multi-criteria decision support system for evaluating knowledge transfer by higher education institutions

ABSTRACTThis study sought to develop a multiple-criteria decision support system for evaluating transfers of knowledge from higher education institutions (HEIs) to society at large. Drawing on a panel of knowledge transfer specialists, we developed the evaluation system by completing the three phases of the multiple-criteria decision analysis (MCDA) approach. The structuring phase used the strategic options development and analysis (SODA) methodology and cognitive mapping techniques. The evaluation phase applied the measuring attractiveness by a categorical-based evaluation technique (MACBETH), which allowed us to evaluate HEIs’ local and overall performance. The third phase consisted of formulating recommendations. Assuming a constructivist process-oriented stance, this research included a real-world application of the proposed system to Portuguese public HEIs. Our study demonstrates that HEI administrators can use the techniques applied to make strategic decisions when seeking to foster the transfer of knowledge to society at large.

A multiple criteria group decision-making approach for the assessment of small and medium-sized enterprise competitiveness

PurposeSmall- and medium-sized enterprises (SMEs) have become increasingly important in national and international markets because they contribute to the development of local and national economies. SMEs often face serious challenges when competing with multinational companies. The purpose of this paper is to develop a method for assessing SMEs’ competitiveness.Design/methodology/approachBased on a constructivist epistemology, this study makes an integrated use of cognitive mapping and the measuring attractiveness by a categorical-based evaluation technique (MACBETH). To this end, face-to-face sessions were conducted with a panel of entrepreneurs and senior managers who deal with the challenges of maintaining SME competitiveness every day. The proposed assessment system was tested and validated by the panel members.FindingsThe methodological processes adopted in this study provide promising results for decision makers seeking to identify the most competitive SMEs. Specifically, the results emphasize, among other points, the importance of innovation and the human dimension to gaining competitive advantages.Research limitations/implicationsThe evaluation system developed in this study is extremely versatile and confirms the usefulness of integrating cognitive mapping and MACBETH to facilitate evaluations of SME competitiveness. However, due to its idiosyncratic and process-oriented nature, generalizations need to be done with caution.Practical implicationsThe proposed method can be valuable to researchers seeking to develop mechanisms for evaluating SMEs’ entrepreneurial performance and include specialized know-how and sensemaking in organizational decision-making processes.Originality/valueThe integrated use of cognitive maps and MACBETH contributes to a better understanding of how to assess SMEs’ competitiveness. No prior work reporting the use of this dual methodology in this study context has been found.

Climate Change and Urbanization Impact on Hydropower Plant by Neural Network-Based Decision-Making Methods: Identification of the Most Significant Parameter

The change in climate and rate of urbanization affects and unbalances the equilibrium between the demand and supply of energy resources. Hydropower plants are one of the most affected systems. But not all the operational parameters get influenced by this change. The significance varies between the parameters and indicators. Until now, there are no studies which try to identify the most significant parameters which get mostly affected by the climatic as well as urbanization uncertainties. As a result, the present investigation aims to detect the main indicator which can represent the operational status of hydropower plants under climatic and urbanization impacts. The objective multi criteria decision-making methods followed the implementation of polynomial neural networks to estimate the significance of the indicators. Although the list of indicator is not exhaustive, the said features are mostly consulted before concluding on the operational status of the power plant. According to the results, the most significant parameter was efficiency of generator. In this aspect, it is to be noted that harmonic mean hierarchy process (HMHP) and measuring attractiveness by a categorical-based evaluation technique (MACBETH) methods were used as multi criteria decision-making methods and polynomial neural networks were used to predict the function which will represent the present status of a power plant. In this study, we also used sensitivity analysis.

Global decision support for airport performance and efficiency assessment

Airport benchmarking depends on airport performance and efficiency indicators, and it is an important issue for business, operational management, regulatory agencies, airlines and passengers. Using the MACBETH (Measuring Attractiveness by a Categorical Based Evaluation Technique) approach, a hierarchical additive value model is constructed with criteria weights and value scales derived from expert's judgments (obtained by an online survey) and by comparison of different reference levels and profiles of performance. This model measures airport performance and efficiency and also peer benchmarks it within a set of direct competitors or self-benchmarks itself during a specified period. GDS (Global Decision Support) model outputs, integrated into a management system, allows the identification of deficiencies requiring urgent intervention and corrective measures for its continuous improvement.

Developing a socio-technical evaluation index for tourist destination competitiveness using cognitive mapping and MCDA

The tourism sector has experienced remarkable growth over the past few years. Its relevance to the economy of a wide range of countries has made it the subject of analysis of researchers and tourist destination managers alike; in part, due to the increasing competition among tourist destinations. Interest has thus emerged in the design, development and application of methodologies that might allow the competitiveness of tourist destinations to be evaluated. Notwithstanding, many studies reveal shortfalls with regard to the definition and weighting of evaluation criteria. By combining knowledge- and experience-based techniques (i.e. cognitive mapping and the measuring attractiveness by a categorical based evaluation technique (MACBETH)), this study follows a socio-technical approach, aiming to create a consistent evaluation index for tourist destinations, as a measure of their competitiveness. Grounded on a real-world application, the results were validated both by a panel of experts and the head of one of the largest travel agencies operating in Portugal, and show that cognitive mapping allows the cause-and-effect relationships between determinants of tourist destination competitiveness to be better understood, while MACBETH introduces realism into the calculation of the respective trade-offs. The limitations and managerial implications of the system created are also discussed.

Classifying urban residential areas based on their exposure to crime: A constructivist approach

A sense of safety is an increasingly important factor when choosing residential spaces. This study sought to develop a multiple-criteria evaluation system for classifying urban residential areas based on their exposure to crime. By combining cognitive mapping and the measuring attractiveness by a categorical based evaluation technique (MACBETH), the research focused on increasing transparency in the process of classifying these spaces. This could facilitate the identification of appropriate improvement initiatives and, thereby, the reduction of crime rates. Based on a real-world application, information was first collected from crime, urbanism, and real estate experts who deal with crime-related challenges daily. The data were analyzed and discussed by an expert panel in face-to-face group meetings, which incorporated realism into the proposed evaluation mechanism. The results were validated both by the panel members and the chief superintendent of operations and deputy national director of Portugal’s Public Safety Police. This study demonstrated that cognitive mapping facilitates the identification of cause-and-effect relationships between a sense of safety and determinants of criminality and develops a better understanding of these links. MACBETH, in turn, introduces realism into the calculation of the relevant trade-offs. The limitations and managerial implications of the proposed system are also discussed.

Combining cognitive mapping and MCDA for improving quality of life in urban areas

Assessing quality of life (QoL) in urban areas is considered a difficult endeavor. Some of the main reasons for this difficulty are directly related to the complexity inherent in the multiplicity of criteria that must be considered in such an evaluation, as well as the subjectivity intrinsic to the issue under study. This complexity hinders the development of models capable of reflecting the performance of different urban environments in terms of their QoL. This study sought to overcome some of the more common limitations of current evaluation methods, by combining cognitive mapping and the measuring attractiveness by a categorical based evaluation technique (MACBETH), to develop a more informed, coherent and transparent evaluation system. The resulting framework and its application were validated both by the participating panel of experts and a representative of the parliamentary group of the Portuguese ecologist party “The Greens”. The advantages and limitations of our framework are also subject of analysis and discussion. It is worth noting that the whole process assumes a constructivist stance, allowing both objective and subjective elements to be combined in the decision-making framework.