Development Of Evaluation Methodology Research Articles

How important is evaluator's alignment for the reliability of assessment procedure for recognizing the good practice?

Abstract Implementing evidence-based interventions that are proven to be successful and effective in improving individual, community, and population health is widely recognized as the best approach to addressing public health challenges. To avoid the development and implementation of less effective or successful or even harmful practices, clear criteria for the assessment of practices that are considering different dimensions of the interventions in public health, are needed. Registers of programs and interventions in the field of prevention and health promotion play an important role here, provided that appropriate evaluation/assessment criteria are used for the selection of practices presented on the portals. Nevertheless, the challenge of choosing the “right” approach and criteria in assessing the health promotion and disease prevention interventions still remain. The development of the system for the assessment of health promotion and disease prevention interventions consists of several steps, from defining the criteria, development of evaluation methodology, selection of evaluators, piloting the assessment procedure and finally to regular use of the entire system/portal. An often-overlooked, but important step is how the evaluators understand the criteria and methodology and if it is properly used in assessing the interventions. In this workshop we will present how we used statistical tools to assess the consistency between the evaluators and thereby gaining insight into the reliability of the criteria as a measuring instrument for the assessment of the interventions as well as to check how the evaluators understand the criteria and methodology and if it is properly used in assessing the interventions.

Impact Investment 2022 Results: A Perspective from the Positive Changes Journal Award Winners

On December 7, 2022, the first annual award of the Positive Changes, a popular science journal about impact investments and social impact assessment, was presented. The award recognizes experts, journal contributors, and organizations for their input into the development of social and economic impact assessment. Read our article about who received the award and what for, how the winners of the award remembered 2022 in terms of impact and development of evaluation methodology, and what key events and new approaches can be highlighted.

Methodology for lifetime characteristics assessment of mechanical equipment in nuclear power plants. Ageing management of NPP mechanical equipment

In the 20s of the twenty-first century many nuclear power plants around the world have reached the final years of their design lifetime. The technical aspects of Plant Life Extension (PLEX) activities involve tests, in addition to the routinely performed ones, of the materials and structures of reactor units, as well as the carrying out operability analyses. In relation to this, the absence of regulatory and methodological basis becomes apparent, in Bulgaria as well. In recent years, new approaches have been adopted for evaluation of lifetime characteristics of components. The algorithm implemented is based on the active mechanism of degradation of the mechanical properties of materials. This paper discusses PLEX stages and corresponding activities. A methodology has been developed to assess the lifetime characteristics of Nuclear Power Plant (NPP) components such as to suit the stages of plant life extension and long-term operation. The methodology consists of: 1) Equipment classification; 2) Identification of the major degradation mechanisms of the mechanical properties of materials; 3) Determining the degradation effects of the mechanical properties of materials; 4) Identification of methods to control degradation effects (ageing); 5) Development of methodologies for evaluation of the ageing effects.

New Economic Evaluation Methodology Development of Industrial Projects

This article presents the contributions on the development of economic evaluation methodology (step-by-step) of industrial projects (M.E.E.P.I.). Also, there were researched and grouped the economic indicators of investment efficiency in a system of indicators (model V.R.Q.R.R.T.), typical of industrial projects in Romania, that shows most clearly the efficiency of the project, including the methodology presentation of indicators calculation. Has been made and the chart of evaluation, comparison and selection of industrial projects in accordance with the methodology M.E.E.P.I.

Presenteeism as a cause of employer’s economic losses: development of evaluation methodology and approbation in the Atria online tool

<h3>ЦЕЛЬ ИССЛЕДОВАНИЯ</h3> Разработать и апробировать методический подход к оценке ущерба по причине презентеизма среди работников компаний различного профиля экономической деятельности в Российской Федерации. <h3>МАТЕРИАЛ И МЕТОДЫ</h3> В 2020 г. эксперты «Национального медицинского центра терапии и профилактической медицины» Минздрава России создали инструмент внедрения корпоративных программ «Укрепления здоровья работающих» (платформа «АТРИЯ»). При разработке структуры опросника использована Стэнфордская шкала оценки презентеизма. Для расчета экономических потерь по причине презентеизма применен адаптированный метод оценки количества и качества выполненной работы. <h3>РЕЗУЛЬТАТЫ</h3> К октябрю 2021 г. в опросе приняли участие 181 работодатель и 7500 работников. Компании относились к следующим отраслям экономической деятельности: образование, наука, культура (23,8%), металлургическое производство (19,9%) и нефтехимическое производство (11,6%). Низкий уровень презентеизма выявлен у 31,1% (<i>n</i>=851) мужчин и 34,7% (<i>n</i>=1616) женщин, средний уровень — 66,2% (<i>n</i>=1812) и 61,4% (<i>n</i>=2858), высокий уровень — 2,7% (<i>n</i>=74) и 3,8% (<i>n</i>=177) у мужчин и женщин соответственно. Средний уровень презентеизма преобладал у работников всех сфер экономической деятельности. Наибольший (6,8%) показатель высокого уровня презентеизма наблюдался у работников органов государственной власти и управления, наименьший (2,1%) — у работников нефтегазовой сферы экономической деятельности. Работник с низким уровнем презентеизма «теряет» полчаса рабочего времени в день, со средним — 2 ч 16 мин, с высоким — 4 ч 27 мин. <h3>ЗАКЛЮЧЕНИЕ</h3> <i></i> Изучение уровней презентеизма работников и их экономических последствий для работодателей — относительно новый подход к сравнению с оценкой других показателей снижения производительности труда и представляет определенные методологические сложности вследствие субъективного характера. В настоящем исследовании разработана методология оценки презентеизма и рассчитаны экономические потери по причине презентеизма у работников, прошедших опрос на платформе для внедрения модельных корпоративных программ «АТРИЯ».

Development of Evaluation Methodology to Enhance Cavity Flooding Strategy on Operating Pwr Power Plant

Development of Evaluation Methodology to Enhance Cavity Flooding Strategy on Operating Pwr Power Plant

Development of Evaluation Methodology to Enhance Cavity Flooding Strategy on Operating Pwr Power Plant

Development of Evaluation Methodology to Enhance Cavity Flooding Strategy on Operating Pwr Power Plant

Study on the Development of Methodology for Evaluation of Driving Safety of Automated Vehicles on Real Roads

Study on the Development of Methodology for Evaluation of Driving Safety of Automated Vehicles on Real Roads

Development of Evaluation Methodology for Spraying Amount and Sprayed Condition of Curing Compound on Concrete Pavement Based on IoT Technology

Development of Evaluation Methodology for Spraying Amount and Sprayed Condition of Curing Compound on Concrete Pavement Based on IoT Technology

Development of A New Methodology for Evaluation of Beam Accuracy and Optical Quality of Solar Central Receiver Systems

In central tower concentrated solar power plants, the concentrated flux distribution at the receiver is controlled by the aiming strategy of thousands of heliostats in the field to accomplish the specific requirements of solar-thermal conversion processes. The main goal of this work is to evaluate the reflected solar flux from a heliostat or from a group of heliostats on a calibration target. The solar flux map at the target receiver is constructed using the information embedded in a captured high dynamic range image of the evaluated scene. In the present article, a methodology has been proposed to evaluate the optical performance of solar central receiver systems in terms of beam accuracy and optical quality of reflected light on calibration target. The developed system is a simple, automatic and effective tool used to accurately analyse the reflected solar flux without limitations of previous methods, such as using specific type of calibration target. The capability of the present methodology for accurate analysis is demonstrated through experimental indoor and outdoor tests.

Interdisciplinary Research in Artificial Intelligence: Challenges and Opportunities.

The use of artificial intelligence (AI) in a variety of research fields is speeding up multiple digital revolutions, from shifting paradigms in healthcare, precision medicine and wearable sensing, to public services and education offered to the masses around the world, to future cities made optimally efficient by autonomous driving. When a revolution happens, the consequences are not obvious straight away, and to date, there is no uniformly adapted framework to guide AI research to ensure a sustainable societal transition. To answer this need, here we analyze three key challenges to interdisciplinary AI research, and deliver three broad conclusions: 1) future development of AI should not only impact other scientific domains but should also take inspiration and benefit from other fields of science, 2) AI research must be accompanied by decision explainability, dataset bias transparency as well as development of evaluation methodologies and creation of regulatory agencies to ensure responsibility, and 3) AI education should receive more attention, efforts and innovation from the educational and scientific communities. Our analysis is of interest not only to AI practitioners but also to other researchers and the general public as it offers ways to guide the emerging collaborations and interactions toward the most fruitful outcomes.

A Survey on Test and Evaluation Methodologies of Pedestrian Localization Systems

The first formal attempt to standardize the test and evaluation of localization systems was the ISO/IEC 18305 standard. As reviewed in this paper, the ISO/IEC 18305 provides guidelines to evaluate an indoor localization system as a black box. Such evaluation is useful for end users, but not fully useful for either developers or researchers. As a result, both developers and researchers use their own evaluation methodologies, which have a set of weaknesses. Our objective is to compare the standard to the evaluation methodologies implemented by developers. We focus on pedestrian localization systems because they are the most numerous. In this work, we survey both competitions and individual works, between 2008–2018, with the ISO/IEC 18305 standard as a guideline. That is, we have reviewed the evaluation methodologies regarding the different aspects defined in the standard. We finalize with a summary of the shortcomings of the evaluation methodologies implemented by the developers, as well as the shortcomings of the standard. Our article ends with a summary of open issues that need to be addressed in order to foster the development of evaluation methodologies of localization systems. The main conclusion of our work is that the developers of localization systems are in need of guidelines to design evaluation methodologies, especially for the evaluation of system components. The standard fails to satisfy such requirement by proposing an evaluation strategy that focuses more on the end user than the developer.

Our Future Nuclear Data Needs

A well-established knowledge of nuclear phenomena including fission, reaction cross sections, and structure/decay properties is critical for applications ranging from the design of new reactors to nonproliferation to the production of radioisotopes for the diagnosis and treatment of illness. However, the lack of a well-quantified, predictive theoretical capability means that most nuclear observables must be measured directly and used to calibrate empirical models, which in turn provide the data needed for these applications. In many cases, either there is a lack of data needed to guide the models or the results of the different measurements are discrepant, leading to the development of evaluation methodologies to provide recommended values and uncertainties. In this review, we describe the nuclear data evaluation process and the international community that carries it out. We then discuss new measurements and improved theory and/or modeling needed to address future challenges in applied nuclear science.

Development of methodology for evaluation of innovative IT-projects

Innovative business development based on a digital transformation is the urgent task for companies. It is able to ensure the implementation of innovation strategy and digital transformation of business. Due to the high development speed and the IT-market updating, the problem is lack of methods of rational choice of the IT-project. In practice, companies often implement IT-projects without reasonable selection and ranking, which leads to a high proportion of failed innovative IT-projects. As a result, the company does not receive a commercially successful product or service that stands out to the consumer among competitors. The evaluation of innovative IT-projects is based on the financial indicators analysis of the expected results from the implementation. The evaluation of the strategic coherence of the project is ignored. The research approaches the methodical of ranking innovative IT-projects in companies. The method consists in a comprehensive analysis of the impact of the proposed project results in various aspects of the company (strategic, environmental, organizational and technological). The study highlights the features of innovative projects in the field of information technology, a comparative analysis of methodological approaches to the evaluation of innovative projects, modified the model of acceptance of IT-innovations.

Need for implementation of pharmacoeconomics in healthcare system, case of analysis of antibiotic consumption in Republic of Macedonia for 2016

Pharmacoeconomics is new and modern health science, implemented in developed societies, to play core role in creating health policies. The main aim of pharmacoeconomic analysis is development of science methodology for evaluation of costs and outcomes of treatment, evaluation of economic parameters in the face of outcomes of clinical results, from different treatment options. Pharmaceutical companies implemented pharmacoeconomic principles for diversifying marketing approach and market access in pharmaceutical development. New healthcare systems demand increased costs for medical care, pharmaceutical products and medical devices. Process of medical costs for evaluation of costs evolved, indirect and hidden costs are part of sole process of evaluation. Health authorities from one side and pharmaceutical companies from other side developed unique methodologies for evaluation. With these implemented changes, traditional concept for evaluation of efficacy and safety of medical devices and pharmaceutical products was overbridged and pharmacoeconomics is base for research, development, registration, reimbursement, as well as dispensing and follow the life cycle of medicines. Results from antibiotic consumption analysis in Republic of Macedonia at 2016 showed that total antibiotic consumption and antibiotic consumption per DDD/1000 citizens is according to average EU trends, mostly similarly to the usage trends of low-income countries. But usage of new and innovative antibiotic is on very low level, which indicates the need of further implementing of pharmacoeconomic analysis and principles in decision making process, for improved health care for the patients. The ultimate goal of implementing the pharmacoeconomic system in each country is enhancing the benefit to the patient through improved resource allocation. Keywords: pharmacoeconomics, type of pharmacoeconomic analysis, antibiotic consumption, Republic of Macedonia

건설산업의 이미지 평가방법론 개발

건설산업의 이미지 평가방법론 개발

Development of the evaluation methodology for the material relocation behavior in the core disruptive accident of sodium-cooled fast reactors

The in-vessel retention (IVR) of core disruptive accident (CDA) is of prime importance in enhancing safety characteristics of sodium-cooled fast reactors (SFRs). In the CDA of SFRs, molten core material relocates to the lower plenum of reactor vessel and may impose significant thermal load on the structures, resulting in the melt-through of the reactor vessel. In order to enable the assessment of this relocation process and prove that IVR of core material is the most probable consequence of the CDA in SFRs, a research program to develop the evaluation methodology for the material relocation behavior in the CDA of SFRs has been conducted. This program consists of three developmental studies, namely the development of the analysis method of molten material discharge from the core region, the development of evaluation methodology of molten material penetration into sodium pool, and the development of the simulation tool of debris bed behavior. The analysis method of molten material discharge was developed based on the computer code SIMMER-III since this code is designed to simulate the multi-phase, multi-component fluid dynamics with phase changes involved in the discharge process. Several experiments simulating the molten material discharge through duct using simulant materials were utilized as the basis of validation study of the physical models in this code. It was shown that SIMMER-III with improved physical models could simulate the molten material discharge behavior, including the momentum exchange with duct wall and thermal interaction with coolant. In order to develop an evaluation methodology of molten material penetration into sodium pool, a series of experiments simulating jet penetration behavior into sodium pool in SFR thermal condition were performed. These experiments revealed that the molten jet was fragmented in significantly shorter penetration length than the prediction by existing correlation for light water reactor conditions, due to the direct contact and thermal interaction of molten materials with coolant. The fragmented core materials form a sediment debris bed in the lower plenum. It is necessary to remove decay heat safely from this debris bed to achieve IVR. A simulation code to analyze the behavior of debris bed with decay heat was developed based on SIMMER-III code by implementing physical models, which simulate the interaction among solid particles in the bed. The code was validated by several experiments on the fluidization of particle bed by two-phase flow. These evaluation methodologies will serve as a basis for advanced safety assessment technology of SFRs in the future.

About assessment of the methodology of the epidemiological situation

Objective: the study of methods for the assessment of the prevalence and development of methodology for evaluation of the epidemiological situation in the RF subjects during the calendar year. The condition of an objective evaluation is the use of external criteria. Therefore, the assessment of one or another administrative territory is performing accordingly to the distribution of morbidity rate in separate subjects of the Russian Federation. As a criterion there is proposed to use the average prevalence of the subject of the Russian Federation - the median and its confidence limits with 95% significance. As a tool for grading of the scale there are considered as the total confidence interval, as possibilities of transition to centile method. There were elaborated methodical principles of the evaluation of the epidemiological situation. The base is the position that the objective, in territorial aspect may be the estimation only of the role of the stable factors. At the first stage the epidemiological situation should be to assessed on the theoretical prevalence of the year under consideration or on the forecast. Later, after the performing of the retrospective epidemiological analysis of morbidity in the subject and establishing the role of the determinants of the epidemic process in the index of considered year (internal control) it is possible to make adjustment and newly re-assess the epidemiological situation.

Evaluation of corrosion resistance of coated steel strips embedded in mortar under chloride exposure

Purpose – The purpose of this paper was mainly to select one of the three types of coatings for protection of steel used as reinforcement in composite pipes (thin steel shell covered by cement-mortar) subjected to chloride exposure. To achieve this target, an attempt was made to develop a simple methodology for evaluating the performance of corrosion protection measures in terms of chloride threshold level (CTL) and corrosion initiation time (TI). Design/methodology/approach – Bare, epoxy, red oxide and zinc primer-coated steel strips were embedded in cement mortar with sand/cement and water/cement ratios of 2 and 0.5 (by mass), respectively, to prepare the specimens which were exposed to chloride solution having a high concentration of 10 per cent NaCl. For determining the amounts of the water-soluble chloride diffused inside the specimens, powdered samples of mortar were collected from two different depths from the exposed surface of specimens on completion of each of the four different exposure times. The corrosion current densities were determined at two different stages. A step-by-step procedure for calculating CTL and TI using the measured chloride contents and corrosion current densities was established with the help of relevant information available in the literature. Findings – Based on the comparison of the values of CTL and TI calculated for bare steel and steel with all three types of coatings, utilizing the experimental data and the proposed calculation procedure, the epoxy-coated steel was found to have the best performance. Originality/value – This research has resulted into development of a simple methodology for evaluation of the performance of protective measures against corrosion of steel embedded in mortar or concrete exposed to chloride-bearing environment.

Development of methodology for evaluation and real water loss reduction in water supply systems in transition countries

Key strategy for water supply companies, aiming increasing their capacity and expanding the network, should be to focus on reducing water losses and non revenue water in general. Water loss reduction, after conveniently achieving initial progress, requires continuous efforts to maintain or improve the achieved level of water losses. This paper proposes a methodology developed on the basis of collected and analyzed knowledge and experience gained in water utilities in BiH and neighboring countries. The methodology is also based on the experiences presented in the literature relating to water losses in developed countries, which are applicable or adaptable, so as affordable for the countries in transition.