Multi-criteria Evaluation Method Research Articles

Multi-Criteria Evaluation Method in the Field of University Education: Application to a Course on Energy Markets

The Bologna Plan adopted by European universities ended the hegemony of an evaluation system exclusively based on the performance of traditional examinations. In this area, with a view to revitalizing grading models in university education, a wide range of evaluation mechanisms has been developed in recent years. Using them, teachers may evaluate the learning levels of their students, including both the specific competences of the taught subject and the transversal competences that help students further develop their professional careers. This article presents a methodology based on a multi-criteria procedure through which students could be evaluated from different points of view, based on different types of evaluation mechanisms that are diversely weighted. Therefore, their levels of learning could be assessed more objectively. This article shows a practical case of applying this methodology, which has been used for the last five years in a course on energy markets taught as part of the Degree in Energy Engineering at the UPV.

Assessing the sustainability of the city-port transformations: Multi-Criteria Decision Analysis (MCDA) for alternatives portfolio selection

In recent years, the EU has sought to define sustainable transition pathways towards more equitable, prosperous, and inclusive urban and territorial models, capable of responding to the rapid degradation of ecosystems, and improving quality of life of citizens. In this context, ports have been recognised as key strategic hubs not only for economic and logistical competitiveness, but also to generate employment and investment opportunities, and to address the challenges of the climate change. The research presents a multi-scale, multi-dimensional and multi- group methodological framework to support decision-making processes related to the development of sustainable transformations of port cities, capturing the complexity of interactions and conflicts. Integrating Multi-Criteria Decision Analysis (MCDA) approaches and Problem Structuring Methods (PSM), the proposed methodology aims to address the following gaps identified in the literature: (i) a scattered application of multi-group methods; (ii) the lack of social instances within the decision problem; (iii) a weak sustainability perspective; (iv) the use of one-dimensional scale assessment in sectoral studies. The case study of the city-port of Gela in Sicily (Italy) provided an opportunity to test the proposed methodology and to integrate multi-dimensional sustainability issues into feasibility studies, promoting a more balanced relationship between city and port. The interdependencies between environment, society and economy allowed MCDA to be identified as a suitable approach to address complex decision-making and support the sustainability assessment of port areas transformation. Two multi-criteria and multi-group evaluation methods guided the decision-making process to select a portfolio of preferred alternatives by assessing technical, environmental, and economic impacts and analysing stakeholder conflicts and coalitions. The process was carried out as follows: on the one hand, a multidimensional impact matrix integrating Key Performance Indicators (KPIs) divided into technical, financial-economic, and environmental categories through the application of the multi-criteria method EVAMIX; on the other hand, a social assessment with a dendrogram of coalitions derived from the application of the multi-group method NAIADE by modelling stakeholders’ preferences regarding a portfolio of alternatives related to the decision problem.

Projektowanie zrównoważone w aspekcie zastosowania materiałów proekologicznych

The paper presents the problem of sustainable design in terms of multi-criteria evaluation methods focusing on the selection and use of building materials in the design. Based on the guidelines and procedures of such assessment methods as LEED (Leadership in Energy and Environmental Design), BREAM (Building Research Establishment Environmental Assessment Method), and others, environmentally friendly building materials were selected for the design of specific building structures was made. For the construction of low-rise single-family homes, products made from waste were used. For the construction of a multipurpose, highrise building, the material chosen was cross-laminated timber (CLT), which is characterized by good environmental performance. The design of a multipurpose urban complex used environmentally friendly concrete, the manufacturing process of which has a dramatically reduced carbon footprint. An analysis of the properties of the building materials, their selection in terms of sustainability, and their use in designs provide tangible benefits in terms of the quality of formation of the built environment.

Development of a Quantitative Model in Land Use Planning Using GIS

Land evaluation methods are crucial for evaluating the potentials and constraints of land for intended land use. In the procedure, environmental criteria such as topography, soil, climate, hydrology, and socioeconomic parameters are evaluated. Different technical procedures are also used for land evaluation ranging from simple methods based on expert knowledge to more complex methods based on simulation models. The main goal of this research is to evaluate land use and natural resources for future sustainable land planning using Geographic Information System (GIS). So, in this study, the Iranian ecological evaluation model was used for the analysis of the ecological and resources maps of the study area. First, ecological capability maps of different land uses such as forestry, agriculture, range management, environmental conservation, ecotourism, and development of villages, urban and industrial areas were developed by overlaying geographical maps based on Boolean overlay method (as a Multi-Criteria Evaluation Method) in GIS for the Township. The final step of this research was the prioritization of land uses considering the ecological and socio-economic characteristics (by distributing questionnaires to 63 experts (of the study area using a quantitative model. The results showed that the maximum area of proposed uses is 78.31\%, which is related to rainfed agriculture, showing this land use has high potential and socio-economic demands in the study area. Meanwhile, minimum area of proposed uses is related to forest and ecotourism. One of the most important practical results of this study is that different or even modified methods should always be used in the same region to check the capability of land and the common method will not always be as best method.

Метод и алгоритмы многокритериальной оценки графических пользовательских интерфейсов программных продуктов МЧС России

The article presents a new author's method of multi-criteria evaluation of the effectiveness of information systems and software products, which consists of three algorithms that comprehensively analyze the graphical user interface in such areas as the optimality of the spatial and temporal location of graphic elements, the aesthetics of the visual component and the adequacy of the logic of interaction with programs. 
 Due to the use of mathematical apparatus and constants from various fields of research, the final assessment is independent of the subjective opinions of experts, which increases the accuracy and adequacy of the calculation results.
 The developed scientific and methodological tools can be successfully applied in the EMERCOM system of Russia in order to select the most effective software from a range of alternatives of similar purpose and functionality.

Метод и алгоритмы многокритериальной оценки графических пользовательских интерфейсов программных продуктов МЧС России

The article presents a new author's method of multi-criteria evaluation of the effectiveness of information systems and software products, which consists of three algorithms that comprehensively analyze the graphical user interface in such areas as the optimality of the spatial and temporal location of graphic elements, the aesthetics of the visual component and the adequacy of the logic of interaction with programs. 
 Due to the use of mathematical apparatus and constants from various fields of research, the final assessment is independent of the subjective opinions of experts, which increases the accuracy and adequacy of the calculation results.
 The developed scientific and methodological tools can be successfully applied in the EMERCOM system of Russia in order to select the most effective software from a range of alternatives of similar purpose and functionality.

Modelling and Assessing Sustainable Urban Regeneration for Historic Urban Quarters via Analytical Hierarchy Process

The push for urban development and the rapid increase in population have left many historic urban cores vulnerable and subject to deterioration. SDG-11 is often mentioned as the goal in UNDP regeneration, revitalization, and preservation projects regarding historic urban sites around the globe. The goal emphasizes 10 targets that are complex in nature and require closer inspection regarding their interconnectedness when being utilized in real-world scenarios. The current study explores the complexities of the decision-making process in planning urban regeneration projects concerning targets of SDG-11. The study uses a Multi-Criteria Evaluation (MCE) method to investigate how and to what significance the targeted criteria were used in planning for two UNDP urban regeneration project zones in Cyprus. These cases have a complex cultural and socio-political dynamic and pose high contextual significance for the region; therefore, many of these targets are critical in achieving more sustainable regeneration projects. The data collection was done by critically examining the projects’ documentation and conducting interviews with experts involved in the two projects. The data is controlled for internal consistency and anomalies. The study makes its case by comparing the different approaches implemented in these two projects and how effective they were in achieving SDG-11 targets.

COMPARATIVE ANALYSIS OF APPROACHES TO DETERMINING THE PARAMETERS OF A CAPACITIVE ENERGY STORAGE FOR ELECTRIC ROLLING STOCK

The article deals with the main existing approaches to determining the parameters of on-board capacitive energy storages for electric rolling stock and their comparative analysis. The advantages and disadvantages of each of the ten considered approaches are set out. Each of the approaches is described and their comparative analysis is performed according to such criteria as the level of research complexity, the financial component of research, the possibility of taking into account the real operation conditions of electric rolling stock while carrying out the research, the method of evaluating the parameters of the on-board capacitive energy storage, the possibility of determining rational parameters, the universality of the approach, considering the technical and economic component and limitations on weight and size of indicators. The power and energy capacity of on-board capacitive energy storage devices, their weight-size indicators when applying each of the considered approaches for the same given operating conditions of the electric rolling stock are determined. A five-car articulated vehicle with an asynchronous traction drive and recovery systems, consisting of metro cars of models 81-7080, 81-7081, 81-7081-01, was chosen as the electric rolling stock. The experimental section between the final stations of the SviatoshynskBrovary line of the utility company “Kyivskyi Metropolitan” was chosen as the specified operating conditions. The payback period and the impact of storage systems with the selected parameters on the performance indicators of the given electric rolling stock while using various approaches are determined. It was found that the most developed approaches, the key point of which is the selection of rational parameters using theoretical research with the help of application-specific software and multi-criteria evaluation methods. The feasibility of using a multi-criteria approach, which allows choosing rational parameters of the capacitive energy storage for electric rolling stock based on three important evaluation criteria, i.e., weight, volume and payback period, is demonstrated. It was established that it is rational to use an on-board capacitive energy storage device of low power and energy intensity.

Alternative Liquid Fuels for Power Plants and Engines for Aviation, Marine, and Land Applications

The article considers the main tendencies of development of alternative liquid fuels used in aviation, land transport, and for the needs of power generation sector. An overview of the main constraints to the development of alternative fuel technologies in these technical areas was carried out. The main groups of the most promising components and fuel compositions capable of effectively replacing conventional liquid fuels have been generalized. The basic criteria for evaluating alternative fuels are formulated. Environmental indicators of fuel combustion are of paramount importance for aviation. Rheological characteristics, calorific value, and environmental friendliness are critical for land transport engines. The effectiveness of alternative fuels for the power generation sector needs to be assessed in terms of such factors as economic, environmental, rheological, and energy to find an optimal balanced formulation. The list of potential components of alternative liquid fuels is extremely large. For a comprehensive analysis of the efficiency and selection of the optimal composition of the fuel that meets specific requirements, it is necessary to use multicriteria evaluation methods.

INVESTIGATION OF THE APPLICATION OF BALANCED INDICATOR SYSTEMS FOR THE EVALUATION OF COMPANIES’ PERFORMANCE

Performance appraisal is one of the most important business processes in a company. Although many authors write on this topic, the topic remains relevant due to the need to analyze the performance and uniqueness of companies, as each author conducting research must adapt the most appropriate system of indicators to the selected companies. Analyzing the scientific literature, it has been noticed that most of the articles on the topic of balanced indicators are prepared by foreign authors, and in Lithuania this topic is not widely developed. The problem of the article is: how to create a system of balanced indicators to evaluate the performance of selected companies. The aim of the research is to theoretically substantiate and empirically evaluate the performance of companies in the sales sector using a system of balanced indicators. For any company that wants to work profitably, performance appraisal from a variety of perspectives is very important. This is the method of assessment used in this article, which looks at a company’s performance from four perspectives: finance, customers, internal processes, and improvement and development. The study selects companies of a similar nature and size from the sales sector. Companies of a similar nature are selected in order to obtain more accurate results and to avoid exclusions. Methods used in the article: analysis of scientific literature, comparison of theoretical insights, system of balanced indicators, method of multicriteria evaluation – EDAS. The system of balanced indicators and the EDAS ranking method help to determine the competitiveness of companies and to interpret which perspective of the company’s activities needs to be improved in order to make the company’s operations more profitable and efficient.

An Integrated GIS-Based ANP Analysis for Selecting Solar Farm Installation Locations: Case Study in Cumra Region, Turkey

With the depletion of traditional energy sources, which are defined as fossil fuels, the importance of renewable energy sources has increased even more. Renewable energy is a sustainable energy source that can be reproduced with the use of existing resources and has almost no harm to the environment. Solar energy is one of the leading types of energy among sustainable energy sources and is an inexhaustible source of energy for humanity that can be used for generations. Selecting an appropriate site for the installation of solar power plants is an important decision that increases the efficiency of a solar farm. In order to minimize the negative environmental, economic and social effects in the solar farm location studies, all criteria affecting the study should be taken into consideration. This study presents the application of combining analytical network process, which is one of the multi-criteria evaluation methods, with GIS, in order to determine the most suitable locations for solar power plants in Cumra Region, Konya, Turkey. Six main criteria have been defined for the most suitable site selection in this area. Criteria maps were prepared using the GIS software and weight values determined from analytical network process and combined for the site suitability map. Suitability map was divided into three categories as low, moderate and high suitable by using an equidistant classification method.

Integrating multiple perspectives in marine spatial planning using the GIS-based Logic Scoring of Preference method

Marine spatial planning processes require integrating diverse opinions, knowledge, and goals of multiple stakeholders as well as large volumes of environmental data. Multicriteria evaluation (MCE) methods have been used to combine spatial data in a way that represents stakeholder preferences; however, conventional methods are limited in their ability to represent and integrate multiple stakeholder perspectives. The main goal of this research study is to implement a generalized multicriteria evaluation method, Logic Scoring of Preference (LSP), integrated with geographic information systems (GIS) to represent different perspectives on the suitability for conservation areas for endangered killer whales (Orcinus orca). Both two and three dimensional (3D) criteria have been used for killer whale acoustic refugia suitability analysis in the study region of the Salish Sea between British Columbia, Canada and Washington, USA. Resulting suitability values were then combined in an overall integrated suitability analysis (OISA) to represent different decision-making outcomes such as consensus and trade-offs, logically defined by LSP aggregators, between stakeholders’ perspectives. The results demonstrate the ability of the Logic Scoring of Preference method to derive overall integrated suitability maps using a variety of logical aggregators. This method can be applied to facilitate marine spatial planning by enabling stakeholders and decision makers to explore, analyse and visualize possible decision scenarios and their trade-offs.

Multi-criteria evaluation and optimization of a new multigeneration cycle based on solid oxide fuel cell and biomass fuel integrated with a thermoelectric generator, gas turbine, and methanation cycle

Recently, due to increasing concerns about the reduction of fossil energies reserves and environmental crises, the development of more efficient and low-emission systems has become necessary. An alternative energy system should be able to improve the efficiency of energy production, have a reasonable investment cost and be environmentally friendly. The current research developed a multi-criteria evaluation method of a new multigeneration cycle (MGC) based on a solid oxide fuel cell (SOFC) and biomass fuel. In the planned MGC, the SOFC is fed by syngas from the biomass gasification process. To reduce environmental hazards, a fraction of the carbon dioxide was recycled for reutilization in the aforementioned process. A gas turbine and a thermoelectric generator (TEG) were employed to produce electrical energy and an absorption chiller was embedded to produce cooling. The output heat of the fuel cell was utilized for heating purposes. A part of the electricity produced was feed into the electrolysis cycle to produce hydrogen. Excess hydrogen was combined with carbon dioxide released from the MGC in a synthesis cycle to reduce pollutant emissions by producing methane. A thermodynamic-conceptual, exergoeconomic and environmental evaluation of the MGC was developed. The optimization based on the genetic algorithm to maximize performance and minimize the cost of the MGC was also developed. The results obtained from the optimization indicate that the proposed MGC can compete with most biomass-driven systems. Besides, the amount of carbon dioxide released can be significantly reduced compared to conventional coal, natural gas and petroleum-driven power plants.

Promoting a city-river balance within neighborhoods in transition along the Rhone

Relationships between cities and their waters have always been evolving. In a context of transition towards sustainability, finding a balance between the urban and river spaces may contribute to the development of new resilient neighborhoods. To that end, a tailor-made multi-criteria evaluation method appears necessary to gather information not only on sustainability performances of neighborhoods projects but also on specific features linked to a balanced relationships between rivers and cities.On these observations, we develop the concept of city-river balance by focusing on the Rhone territory. It serves as a basis to design an innovative decision-support tool for comparing forward-looking visions for rhodanian neighborhoods in transition. First, this paper presents the methodological research approach taken to develop the tool. Then, it explains the structure and functioning of the tool, followed by a test application to a case study, the Jonction sector in Geneva, Switzerland. Preliminary results show that specific city-river balance components and indicators can explicitly be thematized and measured. Moreover, such a tool could unveil hidden potentialities and help stakeholders to make informed-decision through a resilient vision for the regeneration of rhodanian neighborhoods. In that sense, it promotes not only a transition towards sustainability but also the emergence of a city-river balance.

OPRACOWANIE WSKAŹNIKÓW JAKOŚCI ŻYCIA W MIEŚCIE NA PODSTAWIE BAZ DANYCH PRZESTRZENNYCH

The subject of the study is the analysis of using the Topographic Objects Database (BDOT10k) and the Local Data Bank (BDL) to monitor sustainable development and quality of life in the city. The usefulness of this data was tested on the example of quality of life indicators in the city of Kielce and its neighborhood. The databases were analyzed in terms of their scope, relevance, and level of spatial aggregation. The study used the hierarchical analysis (AHP) and multi-criteria evaluation (MCE) method. The issue under consideration was presented in the form of a hierarchy, with a quality of life at the top. The lowest level of the hierarchy is formed by selected indicators defined in the standard ISO 37120. The methodology for calculating and visualization of each indicator is presented illustrating the diversity of life quality in the Kielce Functional Area.

GIS Based Planning of Forest Road Alignment in Periyar Tiger Reserve, Kerala, India

In hilly places, constructing and building forest roads requires a variety of economic and environmental criteria. To develop a solution that minimize construction, maintenance, and adverse environmental effects, road management must take into account as many alternative alignment options as they can. The idea of this research was to plan the network of forest roads in the Periyar Tiger Reserve's mountainous region using Geographic Information Systems (GIS) based on Multi-Criteria Decision Analysis (MCDA). These techniques were applied using the study area's slope, aspect, Elevation, NDVI, drainage and susceptibility to landslides datasets. In addition, the road network created using the GIS-MCDA approach was contrasted with the existing road networks. The key elements that affect the road network in the research area were found, and the necessary maps were produced and categorized. The maps were graded using MCDA to determine the weight of both useful aspects as the next step in determining the significance and role of the aforementioned elements in the cost of road building. Second, using the Arc GIS 10.4 weighted overlay analysis tool, a forest potential map for road building was created by overlaying the weighted maps of the influencing elements. Thirdly, the competence of a map was divided into Six categories: very high, high, moderate, low, very low and Restricted roading Suitability. Finally, using a weighted overlay method to combine the road network and road planning potential map, the existing road network was analyzed. The findings of this study indicated that the majority of existing roads were located in high and moderate road Suitability. A small percentage was located in low road Suitability, which can be taken into account for alignment. These results suggested that the design of forest road planning in hilly areas can be more precisely accomplished using the multi-criteria evaluation method. Similar method as used in this study can be applied to other forested sites.

Novel Multi-Criteria Sustainable Evaluation for Production Scheduling Based on Fuzzy Analytic Network Process and Cumulative Prospect Theory-Enhanced VIKOR

Achieving sustainability is currently an important development direction for the manufacturing industry. With the consideration of all pillars of sustainability, valid evaluation of sustainability during scheduling optimization has become an emerging critical issue in the production scheduling loops. In view of absence of comprehensive sustainable evaluation strategy, this letter proposes a novel multi-criteria evaluation method based on fuzzy analytic network process (FANP) and cumulative prospect theory (CPT)-enhanced VlseKriterijumska Optimizacija I Kompromisno Resenje (FANP-CVIKOR). To this end, we firstly identify fundamental performance indicators from the production scheduling scope, and construct a four-layer indicator system in light of the process sustainability index (ProcSI) architecture. Then, the weights of all hierarchical indicators are derived by designing a fuzzy-improved ANP method to better quantitatively depict the relative significance of indicators. On this basis, a VIKOR method enhanced by CPT is put forward to obtain the ranking of candidate scheduling schemes, in which CPT is capable to reflect the mental attitudes of a decision maker via the prospect value of a scheme. A case study for the flexible job shop validates the correctness and effectiveness of the proposed methodology. Meanwhile, the stability and sensitivity are further discussed, suggesting good potential in real-world applications.

Incorporating barriers in scenarios for energy efficiency improvement and promoting renewable energy in the Bulgarian residential sector

The progress in achieving targets for energy efficiency (EE) and renewable energy sources (RES) is hindered by a set of barriers linked with the end-users (social, educational, cultural, economic, and institutional), but previously, the effect of these barriers was only rarely quantified and no comprehensive methodology to do so is available. This paper, through a step-by-step methodology, examines the development of scenarios for the Bulgarian residential sector until 2030, focusing on the combination of available – for this sector – EE and RES technologies, after incorporating these barriers with the use of the HERON Decision Support Tool (HERON-DST). Two more research tools are used, LEAP (modeling tool) and AMS (multi-criteria evaluation method). Six different scenarios, three of which address barriers, were developed for LEAP. All scenarios are evaluated with the AMS method against a set of criteria/sub-criteria regarding their overall performance under the particular national framework. This results in the identification of the most appropriate (EE/RES) scenario for the country, i.e., addresses behavioral barriers and performs better (one with the highest AMS score) than the others under the particular national framework. This scenario promotes building shell improvement, efficient heating, and cooling in the Bulgarian residential sector. Its policy mixture mainly through financial incentives and more demanding building codes handles social, institutional, and economic barriers linked with end-users behavior. Conclusions concern the methodology, its outcomes, and future use.

Analysis of Vulnerability during Business and Off-business Hours in Case of Hazardous Materials Release Accidents

Korea has been experiencing human and environmental damage caused by accidental release of toxic chemicals such as the Gumi hydrofluoric acid accident and the Ulsan chemical accident. As the government managers do not know when, where, and how such accidents will occur, they have been trying to reduce the level of damage by recognizing victims in advance. In this study, assuming a chlorine gas release accident occurs in facilities handling hazardous chemicals, the impact range was analyzed considering the worst-case scenario of chemical release. After analyzing social, physical, and place-dependent vulnerabilities by applying the multi-criteria evaluation method, a vulnerability map of chemical release was prepared. The study focused on proposing a method for vulnerability assessment during non-economic and economic activity time by considering dynamic factors when evaluating vulnerability. The results of dynamic vulnerability analysis based on GIS are expected to support decision making that could respond differently to chemical release accidents depending on the time of occurrence, thereby minimizing human casualties.

Site Suitability Analysis for Landfill in an Industrial Area in Nigeria

This study was set against the background of identifying management strategies to combat the menace associated with poor solid waste management in urban areas of Nigeria. Therefore, it becomes highly necessary to determine suitable sites for landfill. Using remote sensing and geographic information tools and technologies the study identified the scenes of present dump sites; evaluated the conditions for selecting landfill sites; and determined suitable landfills in Ajaokuta, Nigeria. Data for the study were sourced from Sentinel-2A, 2021. Integrated GIS-based analysis using multi-criteria evaluation method was employed to scrutinise the appropriateness of the existing dumpsites for siting landfills. However, with reference to Federal Environmental Protection Agency (FEPA) guidelines, results of buffering and proximity analyses indicated that none of the existing dumpsites could be converted to landfill sites. Moreover, a fuzzy overlay of all the criteria considered was employed to identify and propose the most suitable areas for solid waste disposal sites in the study area. Based on the official stipulated distance, new sites were proposed for landfills. The study emphasised the increasing mounds and improper disposal of municipal solid wastes in Nigerian urban centres which have become too agonising and repulsive to sights. Nevertheless, if the recommendations of this study are taken with utmost seriousness, any unexpected outbreak of epidemic and environmental pollution will be greatly avoided in the study area.