Evaluation Process Research Articles

Systematic literature review on evaluation models and methods in enterprise architecture research

Several enterprises implemented enterprise architecture (EA) projects to align business and information technology (IT) strategies. The evaluation process is needed to ensure the implementation of EA projects provides effectiveness, efficiency, and feasibility of EA information systems (IS) and assesses previous project experience to avoid future EA project risks. The study aims to present a systematic literature review (SLR) of the models and evaluation methods used or developed, especially in the field of EA research. Based on the inclusion and exclusion criteria, 21 articles were selected for review. The results of the study present an overview of the models and methods used as well as new approaches developed for EA evaluation as well as information based on approaches related to models and methods identified as organizing information and data analysis to broaden future research insights. The literature review also provides additional simple theories related to the implications and techniques of the identified models and methods. The study contributes to company stakeholders to encourage the implementation of EA, identify improvements and enhancements to EA projects as well as further references and insights for practitioners and researchers regarding EA evaluation as an effort to assess the success of achieving enterprise goals.

Recommended Nuclear Structure and Decay Data for A=202 Isobars

Evaluated nuclear structure and decay data for all nuclei with mass number A=202 (202Os, 202Ir, 202Pt, 202Au, 202Hg, 202Tl, 202Pb, 202Bi, 202Po, 202At, 202Rn, 202Fr and 202Ra), are presented. All available experimental data are compiled and evaluated, and best values for level and γ-ray energies, quantum numbers, lifetimes, γ-ray intensities and transition probabilities, as well as other nuclear properties, are recommended. Inconsistencies and discrepancies that exist in the literature are discussed. A number of computer codes (https://www-nds.iaea.org/public/ensdf_pgm/) developed by members of the NSDD network were used during the evaluation process. This work supersedes the earlier evaluation by F.G. Kondev (2007Ko42), published in Nuclear Data Sheets108, 1471 (2007).

Psychiatric Diagnosis: A Clinical Guide to Navigating Diagnostic Pluralism.

The controversies surrounding the Diagnostic and Statistical Manual of Mental Disorders and International Classification of Diseases have generated significant debate across the psy-sciences. This debate has been further fueled by the launch of the Research Domain Criteria as a framework to facilitate advances in neuroscientific research, a renewed emphasis on dimensional models of psychopathology, currently exemplified by the Hierarchical Taxonomy of Psychopathology, and development of the Psychodynamic Diagnostic Manual by the psychodynamic community. In this article, we provide a clinical overview of recent debates surrounding categorical and dimensional approaches to psychiatric diagnosis, offer a critical assessment of proposed alternatives, and discuss how clinicians can navigate a plurality of diagnostic frameworks. Our discussion emphasizes that diagnostic frameworks need to be contextualized within the process of a comprehensive clinical evaluation, and their advantages and disadvantages should be understood in relationship to the theoretical orientations and practical needs of clinicians.

Evaluation of chemical properties and humification process during co-composting of spent mushroom substrate (Pleurotus ostreatus) and pig manure under different mass ratios

Spent mushroom substrate (SMS) from Pleurotus ostreatus is high in salinity, susceptible to deterioration caused by mold, and not suitable for direct application in soil. Its high C/N ratio and low pH inhibit the humification process during composting. Pig manure (PM) possesses high density and low porosity, impeding microbial metabolism. Co-composting SMS and PM can overcome these challenges. A 120-day composting experiment was conducted with varying mass ratios of SMS and PM, supplemented with calcium bentonite and microbial inoculum. After composting, there was observed a significant rise in the N and K2O contents, ranging from 11.1% to 84.1% and 55.1%–296.8%, respectively. Additionally, there was a decrease in the C/N ratio by a range of 18.9%–60.1%. The total nutrient content of SMS post-composting solely was a mere 4.9%, failing to meet the 5% required by China's Professional Standard outlined for organic fertilizers (NY/T525-2021). Composting PM alone simplified the molecular structure of humic-extracted acid (HE) and reduced the C content of humic acid (HA) by up to 18.1%. In contrast, co-composting SMS and PM in equal proportions stimulated microbial consumption of water-soluble substances, resulting in increase in C contents of HE and HA by 11.5% and 18.7%, respectively, along with a 15.4% rise in the polymerization level of the composted materials. Furthermore, this combination facilitated the conversion of inert humic component, reducing C content of humin by 79.3%, lowering the electrical conductivity (EC) value by 23.0%, and boosting GI value by 154.1%. Increasing the proportion of SMS in co-compost proved advantageous in enriching its organic matter content. The composting process involved bio-degradation of O-containing functional groups like phenols and alcohols, utilization of polysaccharides by microorganisms, and development of carboxyl groups in the HA. Based on the above index analysis, the most effective compost ratio to achieve higher humification level and compost quality was determined to be a mass ratio of SMS to PM of 5:5, followed by 6:4.

Analysis of Physiological and Biochemical Parameters in the Radish (Raphanus sativus L.) Obtained in Different Cultivation Systems

This paper presents the results obtained from the analysis of physiological and biochemical parameters in the radish, species Raphanus sativus L., variety Rond Ecarlate, which was grown in three different systems (in the field, in the solarium and in the climate chamber). Several parameters necessary for the evaluation of biomass, physiological processes and nutritional values were determined. Regarding the biometric parameters, it was noticed that in the field cultivation the plants formed 11-12 leaves, in the solarium average 12-13 leaves, and in the climatic chamber the analyzed plants formed 7-9 leaves, on an average. The total biomass of the plant was recorded with the following average values: in the field 70.05 grams, in the solarium 92.3 grams and in the climate chamber 32.9 grams. Regarding the circumference of the tuberous hypocotyl axis, the values are higher in plants grown in solarium (16.9 cm), with the smallest dimensions being recorded in plants grown in the climate chamber (7.2 cm). The highest average pulp firmness value was observed in plants grown in the solarium (0.27 kg force), and the lowest values were seen in plants grown in the climate chamber (0.14 kg force). Regarding the amount of water lost through perspiration by the leaves of radish plants, the highest average values were recorded at plants grown in the solarium, and the lowest at plants grown in the climatic chamber. The average soluble dry matter content was higher (over 4%) in plants grown in the climate chamber compared to other harvesting systems. The analysis of the average carbohydrate content shows that the total soluble carbohydrates were present only in the hypocotyl axis and glucose was found both in the hypocotyl axis of the studied plants and in the leaves. Vitamin C was present in variable amounts, both in the hypocotyl axis and in the leaves. The average amino acid content (expressed in amino nitrogen) was between 0.003% and 0.006%. The anthocyanin was present with highest values (54.5 mg) in field-grown plants, and catalase activity was present both in the hypocotyl axis and in the leaves and roots. Air humidity and temperature had a high influence on the development of plant biomass, on the content of dry matter and on the loss of water through transpiration. The biometric, physiological and biochemical parameters varied depending on the cultivation system.

A fuzzy analytic hierarchy process model to enhance energy security: the case of Morocco

Energy security has become increasingly important because of its impact on all sectors of the economy, and even more because of the scarcity of primary energy resources and price fluctuations caused by geopolitical tensions. This has prompted all countries to assess their energy situation and take strategic measures to mitigate energy risks. Accordingly, the aim of this study is to identify the dimensions of energy security with the greatest impact on Morocco's energy security, as well as the priority strategic measures for mitigating energy risk. To this end, we consider the fuzzy analytic hierarchy process (F-AHP) method, which is a multiple criteria decision analysis method, which has been used to obtain results based on a structured evaluation process. The obtained results, following the considered comparison matrix, underscore that availability and resilience dimensions have the greatest impact on the Moroccan energy security, with respective weights of 48% and 28%. Besides, mitigating energy risk in Morocco primarily involves the development of renewable energies compared with seven other proposed measures, along with their degree of priority.

Utility of a Multidisciplinary Burn OT Clinic in Early Identification of Hypertrophic Burn Scars

Abstract Date Presented 03/23/24 OTs will gain professional knowledge of the specialized evaluation process in a multidisciplinary burn clinic, identification of scar appearance, and benefits of early intervention scar management techniques. Primary Author and Speaker: Nicole Victoria Avena Contributing Authors: Emily R. Ulloa

Patient-Led Research to Develop a Training Programme for Restoring Musical Joy in Cochlear Implant Recipients: A Reflexive Process Evaluation.

The role of patients in healthcare research is slowly evolving, although patient roles in the research process are limited. This paper reports on a patient-led research project aiming to develop a musical hearing training programme for patients with a cochlear implant (CI): the Musi-CI programme. A CI is an inner ear prosthesis that allows people with severe hearing loss to hear. However, while speech can be understood, CI users cannot fully enjoy music or feel aversion to it. The Musi-CI programme aims to reduce this music aversion to ultimately improve music enjoyment and social participation. The development of the Musi-CI programme was supported by a consortium of professionals in CI rehabilitation and research. The aim of this paper is to describe and evaluate the Musi-CI programme development process and its impact on professional CI rehabilitation and research. Programme development was described using a 3-layered process model of action research, distinguishing the CI user process, the healthcare professional process and the research process. To evaluate perceptions on the programme development process, consortium partners provided written commentsand participated in a reflexive evaluation session that was video-recorded. Reflexive evaluation aims for collective learning and strengthening collaboration among participants. Written comments and video data were analysed using template analysis. The involvement of an expert by experience was perceived as challenging but rewarding for all consortium partners, opening up new perspectives on CI-rehabilitation practice and research. Data analysis revealed two themes on the programme development process, professional space and acknowledgement, and two themes on the outcomes on CI rehabilitation and research: critical reflection and paradigm shift. Experts by experience represent a different knowledge domain that may contribute to change in rehabilitation and research. The development of the programme was initiated by a professional musician and CI user who organized the funding, had a leading role throughout the research process, including the write-up of the results, and co-authored this paper.

Implementing Individually Tailored Prescription of Physical Activity in Routine Clinical Care: A Process Evaluation of the Physicians Implement Exercise = Medicine Project.

Although the prescription of physical activity in clinical care has been advocated worldwide, in the Netherlands, "Exercise is Medicine" (E = M) is not yet routinely implemented in clinical care. A set of implementation strategies was pilot implemented to test its feasibility for use in routine care by clinicians in 2 departments of a university medical center. An extensive learning process evaluation was performed, using structured mixed methods methodology, in accordance with the Reach, Effect, Adoption, Implementation, and Maintenance framework. From 5 implementation strategies employed (education, E = M tool embedded in the electronic medical records, lifestyle coach situated within the department, overviews of referral options, and project support), the presence of adequate project support was a strong facilitator of the implementation of E = M. Also, the presence of the lifestyle coach within the department seemed essential for referral rate. Although clinicians appreciated the E = M tool, barriers hampered its use in practice. Specific implementation strategies, tailored to the setting, are effective in facilitating the implementation of E = M with specific regard to education for clinicians on E = M, deployment of a lifestyle coach within a department, and project coordination. Care providers do see a future for lifestyle coaches who are structurally embedded in the hospital, to whom they can easily refer.

Parenting Interventions During the COVID-19 Pandemic: A Systematic Review of the Rationales, Process, Feasibility, Acceptability, and Impacts of Adaptation.

Evidence shows that parenting interventions are an effective method of reducing caregiver-perpetrated child maltreatment. The recent COVID-19 pandemic has changed the provision of parenting interventions worldwide, with many interventions adapting to continue providing services during the crisis. This global systematic review examined how parenting interventions targeting child maltreatment and its risk and protective factors were adapted during the COVID-19 pandemic. We searched for studies published between 2020 and 2022 and identified 31 eligible studies. The data on the rationale, process, feasibility, acceptability, and impacts of adaptations were narratively synthesized in accordance with the Framework for Reporting Adaptations and Modifications to Evidence-Based Interventions. Results showed that most adaptations were proactive and focused on delivery methods, predominantly digitalization. While feasibility and acceptability were generally observed, the impacts of adapted programs were inconclusive. Inadequate reporting, especially regarding rationale, fidelity, facilitator capacity building, stakeholder involvement, and decision-making processes, was noted. The review recommends enhanced planning, documentation, and reporting of program adaptations using established guidelines, as well as process and impact evaluations.

The role of patient-related factors in the implementation of a multimodal home-based rehabilitation intervention after discharge from inpatient geriatric rehabilitation (GeRas): a qualitative process evaluation.

Structured aftercare programs are implemented to facilitate the transition from rehabilitation centers to patients' home environments. Taking the program GeRas as an example, this paper aims to evaluate the influence of patient-related factors on the implementation of the geriatric aftercare program GeRas from patients' and providers' perspectives. To capture patients' and providers' perspectives, qualitative interviews were conducted using a semi-structured interview guide. The analysis was inductive-deductive and based on the thematic analysis by Braun and Clarke and guided by Domain IV of the CFIR. 16 participants (10 patients, 4 providers, 2 family members) were interviewed from May 2023 to November 2023. Patient-related factors were perceived as an important aspect during the implementation of the GeRas program. The results were allocated to the four Constructs of Domain IV of the CFIR (Motivation, Opportunity, Capability, Needs). Especially patients' intrinsic motivation, social environment, and physical capabilities seemed to be crucial for successful implementation. While extrinsic motivation can mitigate missing personal capabilities, it cannot replace the presence of intrinsic motivation and capabilities. The results showed that patient-related factors are interlinked. The relevance of patient-related factors during the implementation of the GeRas program shows that such programs must consider these factors during intervention planning.

ANAGRAM-BASED EVALUATION OF GOLEK KUDUP SARI DANCE LEARNING NEEDS FOR JUNIOR HIGH SCHOOL STUDENTS

This research aims to discover the results of the innovation of learning evaluation of Golek Kudup Sari Dance based on anagram games at SMPN 2 Bumijawa. In general, the dance learning model at SMPN 2 Bumijawa is still conventional including the evaluation process. Furthermore, an online media-based learning and evaluation process was developed. The research method used in this research is Research and Development. The data collected in this research is qualitative data in the form of empirical data. The results showed that anagram game-based evaluation is very efficient to be applied to dance learning at SMPN 2 Bumijawa. The conclusion obtained in the research is that anagram-based Golek Kudup Sari Dance learning is needed by teachers and students as an innovative curriculum implementation. In a sustainable manner, the process of learning dance through online games at SMPN 2 Bumijawa is expected to continue to be applied and developed further.

Evaluating artificial intelligence for medical imaging: a primer for clinicians.

Artificial intelligence has the potential to transform medical imaging. The effective integration of artificial intelligence into clinical practice requires a robust understanding of its capabilities and limitations. This paper begins with an overview of key clinical use cases such as detection, classification, segmentation and radiomics. It highlights foundational concepts in machine learning such as learning types and strategies, as well as the training and evaluation process. We provide a broad theoretical framework for assessing the clinical effectiveness of medical imaging artificial intelligence, including appraising internal validity and generalisability of studies, and discuss barriers to clinical translation. Finally, we highlight future directions of travel within the field including multi-modal data integration, federated learning and explainability. By having an awareness of these issues, clinicians can make informed decisions about adopting artificial intelligence for medical imaging, improving patient care and clinical outcomes.

The Acceptability, Engagement, and Feasibility of Mental Health Apps for Marginalized and Underserved Young People: Systematic Review and Qualitative Study.

Smartphone apps may provide an opportunity to deliver mental health resources and interventions in a scalable and cost-effective manner. However, young people from marginalized and underserved groups face numerous and unique challenges to accessing, engaging with, and benefiting from these apps. This study aims to better understand the acceptability (ie, perceived usefulness and satisfaction with an app) and feasibility (ie, the extent to which an app was successfully used) of mental health apps for underserved young people. A secondary aim was to establish whether adaptations can be made to increase the accessibility and inclusivity of apps for these groups. We conducted 2 sequential studies, consisting of a systematic literature review of mental health apps for underserved populations followed by a qualitative study with underserved young male participants (n=20; age: mean 19). Following the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines, an electronic search of 5 databases was conducted in 2021. The search yielded 18,687 results, of which 14 articles met the eligibility criteria. The included studies comprised a range of groups, including those affected by homelessness, having physical health conditions, living in low- and middle-income countries, and those with sexual and gender minority identities. Establishing and maintaining user engagement was a pervasive challenge across mental health apps and populations, and dropout was a reported problem among nearly all the included studies. Positive subjective reports of usability, satisfaction, and acceptability were insufficient to determine users' objective engagement. Despite the significant amount of funding directed to the development of mental health apps, juxtaposed with only limited empirical evidence to support their effectiveness, few apps have been deliberately developed or adapted to meet the heterogeneous needs of marginalized and underserved young people. Before mental health apps are scaled up, a greater understanding is needed of the types of services that more at-risk young people and those in limited-resource settings prefer (eg, standard vs digital) followed by more rigorous and consistent demonstrations of acceptability, effectiveness, and cost-effectiveness. Adopting an iterative participatory approach by involving young people in the development and evaluation process is an essential step in enhancing the adoption of any intervention, including apps, in "real-world" settings and will support future implementation and sustainability efforts to ensure that marginalized and underserved groups are reached. PROSPERO CRD42021254241; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=254241.

Construction of an Evaluation Indicator System for Civic and Political Applications in Professional Practice Courses Based on CIPP: Taking the VBSE Practical Training Course as an Example

This study takes the virtual business society environment (VBSE) practical training course as a case study and applies the theoretical framework of the context, input, process, product (CIPP) model to construct an evaluation indicator system for the application of civic and politics in professional practice courses. The context evaluation is measured from the support of the VBSE practical training course into course civic and politics, teachers’ cognition, and the integration of course objectives; the input evaluation is measured from the matching degree of teachers’ civic and political competence, and the matching degree of teaching resources; the process evaluation is measured from the degree of implementation of civic and politics teaching and the degree of students’ acceptance; and the product evaluation is measured from the degree of impact of civic and politics teaching.

Optimizing Accounting for Data Assets Helpful To Developing Sustainable Regional Economies

This paper aims to develop accounting methods for data assets helpful to developing sustainable regional economic development within the digital economy. By considering data-asset characteristics such as virtuality and sharing, it proposes accounting treatments and processes for data-asset evaluation and management. Through a case study of Guangdong Power Grid Co., Ltd., the optimized method is evaluated. Results show a 70% increase in data-asset valuation compared to intangible assets, with a 17.8% growth in total profits. The method reduces asset-management costs by 3.67% and amortization by CN¥98,600. These findings highlight the importance of optimizing accounting methods for data assets able to foster sustainable regional economic development in the digital-economy era.

Comparative Evaluation of Fenton and Persulfate Processes with UV/H2O2 for Batik Wastewater Treatment: Optimizing Fe2+ and S2O8 2- Ratio by H2O2 for Enhanced Pollutant Degradation

Wastewater generated from industrial processes including the batik industry in Indonesia contains high organic pollutants and dyes. In this study, the advanced oxidation process that will produce hydroxyl radicals was used to degrade pollutants in this batik industry wastewater. This study aims to compare the Fenton and Persulfate processes with the influence of variations in the concentration of Fe2+ and S2O8 2- added. This method is carried out by adding H2O2 as an oxidant which is added to each catalyst, namely Fe2+ and S2O8 2- in the presence of a combination of UV light. Fenton process was carried out in 60 minutes and Persulfate process was carried out in 45 minutes. In this study, there was a tendency to increase the efficiency of COD and color removal along with the increasing concentration of each catalyst added. The highest COD and color removal efficiency occurred at a ratio of H2O2:Fe2+ and H2O2: S2O8 2- of 1: 0.08.

Safety evaluation of human-caused errors in civil aviation based on analytic hierarchy process and fuzzy comprehensive evaluation method

Safety evaluation of human-caused errors in civil aviation based on analytic hierarchy process and fuzzy comprehensive evaluation method

Enhancing service delivery via Work-Integrated Learning (WIL) at uMzimkhulu Local Municipality, South Africa

Municipalities in South Africa face numerous challenges that hinder efficient service delivery. One of these challenges is the lack of implementation of required services, leading to citizen dissatisfaction and protest actions. This study aims to investigate methods for improving service delivery in public institutions in South Africa through the implementation of work-integrated learning (WIL) programmes. Data for this study was collected from the uMzimkhulu local municipality in KwaZulu-Natal, specifically from the Harry Gwala District. A total of 56 participants took part in the study, including 28 WIL students and 28 mentors. This ensured representation from all departments within the municipality. Two separate sets of questionnaires were used to collect data from these two groups. Data analysis was performed using the Statistics Packaging for Social Sciences (SPSS) version 27. The study identified several challenges that currently hinder the effective implementation of WIL programmes within the municipality. As a result, it is recommended that the municipality provide training for WIL students and establish efficient monitoring and evaluation processes for the WIL programmes. Additionally, the municipality should involve students in WIL programmes in matters related to progressive initiatives and provide further support to enhance their ability to handle client services. It is also advised that the municipality prioritise the development of facilities and resources for WIL students to fully engage them in their work.

Protocol for a feasibility registry-based randomised controlled trial investigating a tailored follow-up service for stroke (A-LISTS)

BackgroundStroke affects long-term physical and cognitive function; many survivors report unmet health needs, such as pain or depression. A hospital-led follow-up service designed to address ongoing health problems may avoid unplanned readmissions and improve quality of life.MethodsThis paper outlines the protocol for a registry-based, randomised controlled trial with allocation concealment of participants and outcome assessors. Based on an intention-to-treat analysis, we will evaluate the feasibility, acceptability, potential effectiveness and cost implications of a new tailored, codesigned, hospital-led follow-up service for people within 6–12 months of stroke. Participants (n = 100) from the Australian Stroke Clinical Registry who report extreme health problems on the EuroQol EQ-5D-3L survey between 90 and 180 days after stroke will be randomly assigned (1:1) to intervention (follow-up service) or control (usual care) groups. All participants will be independently assessed at baseline and 12–14-week post-randomisation. Primary outcomes for feasibility are the proportion of participants completing the trial and for intervention participants the proportion that received follow-up services. Acceptability is satisfaction of clinicians and participants involved in the intervention. Secondary outcomes include effectiveness: change in extreme health problems (EQ-5D-3L), unmet needs (Longer-term Unmet Needs questionnaire), unplanned presentations and hospital readmission, functional independence (modified Rankin Scale) and cost implications estimated from self-reported health service utilisation and productivity (e.g. workforce participation). To inform future research or implementation, the design contains a process evaluation including clinical protocol fidelity and an economic evaluation.DiscussionThe results of this study will provide improved knowledge of service design and implementation barriers and facilitators and associated costs and resource implications to inform a future fully powered effectiveness trial of the intervention.Trial registrationACTRN12622001015730pr.Trial sponsorFlorey Institute of Neuroscience and Mental Health, 245 Burgundy Street, Heidelberg, VIC, 3084, PH: +61 3 9035 7032