Evaluation Process Research Articles

An innovative model of access and triage to reduce waiting in an outpatient epilepsy clinic: a process evaluation

PurposeInterventions that improve timely access to outpatient health services are essential in managing demand. This process evaluation aimed to describe the implementation, mechanism of impact and context of an intervention to reduce waiting for first appointments in an outpatient epilepsy clinic.Design/methodology/approachThe UK Medical Research Council framework was used as the theoretical basis for a process evaluation alongside an intervention trial. The intervention, Specific Timely Appointments for Triage (STAT), is a data-driven approach that combines a one-off backlog reduction strategy with methods to balance supply and demand. A mixed methods process evaluation synthesised routinely collected quantitative and qualitative data, which were mapped to the domains of implementation, mechanisms of impact and contextual elements.FindingsThe principles of the STAT model were implemented as intended without adaptation. The STAT model reached all patients referred, including long waiters and was likely generalisable to other medical outpatient clinics. Mechanisms of impact were increased clinic capacity and elimination of unwanted variation. Contextual elements included the complexity of healthcare systems and the two-tier triage practice that contributes to prolonged waiting for patients classified as non-urgent.Originality/valueThis process evaluation shows how a data-driven strategy was applied in a medical outpatient setting to manage demand. Improving patient flow by reducing waiting in non-urgent, outpatient care is a complex problem. Understanding how and why interventions work is important for improved timeliness of care, and sustainability of public health services.

Systematic development of an injury and illness prevention programme for athletes with a physical impairment: the TIPAS study

Background/aimThe participation of individuals with physical impairment in sports has numerous benefits, yet there is also the risk of sustaining sport-related injuries or illnesses. Therefore, prevention programmes of these problems...

AnNoBrainer, An Automated Annotation of Mouse Brain Images using Deep Learning.

Annotation of multiple regions of interest across the whole mouse brain is an indispensable process for quantitative evaluation of a multitude of study endpointsin neuroscience digital pathology. Prior experience and domain expert knowledge are the key aspects for image annotation quality and consistency. At present, image annotation is often achieved manually by certified pathologists or trained technicians, limiting the total throughput of studies performed at neuroscience digital pathology labs. It may also mean that simpler and quicker methods of examining tissue samples are used by non-pathologists, especially in the early stages of research and preclinical studies. To address these limitations and to meet the growing demand for image analysis in a pharmaceutical setting, we developed AnNoBrainer, an open-source software tool that leverages deep learning, image registration, and standard cortical brain templates to automatically annotate individual brain regions on 2D pathology slides. Application of AnNoBrainer to a published set of pathology slides from transgenic mice models of synucleinopathy revealed comparable accuracy, increased reproducibility, and a significant reduction (~ 50%) in time spent on brain annotation, quality control and labelling compared to trained scientists in pathology. Taken together, AnNoBrainer offers a rapid, accurate, and reproducible automated annotation of mouse brain images that largely meets the experts' histopathological assessment standards (> 85% of cases) and enables high-throughput image analysis workflows in digital pathology labs.

Let’s play! Transforming STEM education with board games

This study examines the development and effectiveness of four board games designed to promote cognitive learning activities and STEM education, focusing on kinematics and energy. We used the Engagement - Purpose - Deign - Prototype - Evaluation process to develop four board games. The study involved 53 senior high school students in Vietnam. We used a mixed methods approach to evaluate the impact of these board games on students’ cognitive understanding and motivation in STEM education. Data collection included multiple-choice tests before and post-tests from the previous literature study to measure cognitive gains. We also surveyed students using 5-point Likert scales and open-ended questions to explore their motivation and engagement. Quantitative and qualitative analyses assessed whether board games significantly improved students’ motivation and learning outcomes. These results suggest that integrating board games into STEM education can improve student engagement and understanding of STEM learning. In light of the results, we discussed the implications of the Engagement - Purpose - Deign - Prototype - Evaluation process and the effectiveness of four board games.

Understanding the challenges and successes of implementing ‘hybrid’ interventions in healthcare settings: findings from a process evaluation of a patient involvement trial

Introduction‘Hybrid’ interventions in which some intervention components are fixed across sites and others are flexible (locally created) are thought to allow for adaptation to the local context while maintaining fidelity....

Daily Runoff Prediction Based on FA-LSTM Model

Accurate and reliable short-term runoff prediction plays a pivotal role in water resource management, agriculture, and flood control, enabling decision-makers to implement timely and effective measures to enhance water use efficiency and minimize losses. To further enhance the accuracy of runoff prediction, this study proposes a FA-LSTM model that integrates the Firefly algorithm (FA) with the long short-term memory neural network (LSTM). The research focuses on historical daily runoff data from the Dahuangjiangkou and Wuzhou Hydrology Stations in the Xijiang River Basin. The FA-LSTM model is compared with RNN, LSTM, GRU, SVM, and RF models. The FA-LSTM model was used to carry out the generalization experiment in Qianjiang, Wuxuan, and Guigang hydrology stations. Additionally, the study analyzes the performance of the FA-LSTM model across different forecasting horizons (1–5 days). Four quantitative evaluation metrics—mean absolute error (MAE), root mean square error (RMSE), coefficient of determination (R2), and Kling–Gupta efficiency coefficient (KGE)—are utilized in the evaluation process. The results indicate that: (1) Compared to RNN, LSTM, GRU, SVM, and RF models, the FA-LSTM model exhibits the best prediction performance, with daily runoff prediction determination coefficients (R2) reaching as high as 0.966 and 0.971 at the Dahuangjiangkou and Wuzhou Stations, respectively, and the KGE is as high as 0.965 and 0.960, respectively. (2) FA-LSTM model was used to conduct generalization tests at Qianjiang, Wuxuan and Guigang hydrology stations, and its R2 and KGE are 0.96 or above, indicating that the model has good adaptability in different hydrology stations and strong robustness. (3) As the prediction period extends, the R2 and KGE of the FA-LSTM model show a decreasing trend, but the whole model still showed feasible forecasting ability. The FA-LSTM model introduced in this study presents an effective new approach for daily runoff prediction.

Analisis Kebutuhan Evaluasi Pembelajaran Unsur Dalam Tari Merak Bagi Peserta Didik Sekolah Menengah Pertama Berbasis Crossword Puzzle

This research to create innovative learning in creative evaluation through a crossword puzzle. The problem is focused on the fact that teachers still use conventional or paper-based learning evaluation models. To approach this issue, Sugiyono's theory on Evaluation is used as a reference for conducting the research. The learning evaluation process was carried out at SMP IT INSAN CENDEKIA to analyze the needs of students and teachers in the learning evaluation process at the school. The research method used is Research and Development (R&D), which will produce an online-based learning evaluation innovation. Data was collected through qualitative research used to capture art learning evaluation assessment data conducted by teachers using observation, interviews, and documentation data collection techniques. The data was analyzed descriptively qualitatively. Quantitative research was used to test the validity and reliability of the products to be produced. The results of the research show that the wordwall puzzle is very practical for use by students of SMP IT INSAN CENDEKIA in the learning evaluation process, with 22 out of 24 students able to understand and use this application effectively. This study concludes that the online-based crossword puzzle learning evaluation model can provide new innovations in the evaluation process and has a high level of effectiveness and efficiency.

Evaluating the impact of a ward environment with 20 single occupancy rooms and two four-bedded bays on patient and staff experiences and outcomes in an acute NHS Trust: a mixed-methods study protocol

IntroductionTraditionally, wards in acute care hospitals consist predominately of multioccupancy bays with some single rooms. There is an increasing global trend towards a higher proportion of single rooms in hospitals,...

Effects of current intensities on material removal rate, electrode wear rate, and surface roughness of machining high carbon high chromium steel

AbstractThe electrical discharge machining is very successful and generally recognized for producing complicated shapes and small openings with exceptional precision. The objective of this study is to assess the impact of different electrical discharge machining parameters on the attributes of the machining process. The evaluation of the machining process was conducted based on the workpiece‘s material removal rate, the rate at which the electrodes wear, and the level of surface roughness. Simultaneously achieving a high material removal rate, low electrode wear rate, and high surface roughness is not possible with a specific combination of approaches due to their contradicting nature. Frequently, it is necessary to independently apply many measures instantaneously in order to assess their impact on various responses. This research investigates the machining of high carbon high chromium steel making use of electrical discharge machining with aluminum, copper, and graphite electrodes. The study focuses on the impact of different current intensities on the rate of material removal, electrode wear, and surface roughness. The experimental results demonstrate that the highest material removal rate (mmcubicmin−1) is achieved at a current density of 12 A when using a copper electrode (54.67), as opposed to aluminum electrode (22.91) and graphite electrode (29.43).

Blockchain-supported online banking scheme

Online banking not merely enables customers to make transactions within a short time and access transactional information anywhere but also facilitates financial institutions to simplify transaction procedures and reduce their operating expenses. Common concerns by both customers and financial institutions are the secure authentication measures for protecting sensitive financial information from cybersecurity threats and maintaining their trust in a secure environment. This paper presents a blockchain-supported scheme to establish secure authentication and mutual trust for handling online banking processes. The proposed solution’s model design, inference process, proof method, security analysis, and performance evaluation are included in this study. With the decentralized applications and smart contracts, that benefit from disruptive innovations in blockchain technology, the proposed scheme enables financial institutions to provide efficient, immutable, transparent, and secure online financial services for customers. In addition, the computational efforts of the proposed solution show that high performance can be achieved in executing financial transactions while safeguarding sensitive data and retaining trust in a decentralized environment which is some of the most significant weak security of the existing authentication schemes for online banking platforms.

Family Involvement During Comprehensive Developmental Evaluations: Perspectives of Diverse Mothers.

Early diagnosis and social support postdiagnosis (i.e., family involvement) can lead to improved outcomes for children with autism spectrum disorder (ASD) and other developmental disorders. Children of minority ethnic and racial groups are typically diagnosed later in childhood compared with White children, contributing to disparities in outcomes. Research has not yet explored family involvement during comprehensive developmental evaluations nor accounted for cross-cultural differences in family roles and involvement. This qualitative study sought to characterize the nature and impact of family involvement during the developmental evaluation process among racially and ethnically marginalized mothers of children with developmental delays and possible ASD. Mothers (N = 27) of children who had a positive autism screen during their 18- or 24-month well-child visit but did not receive an ASD diagnosis after comprehensive developmental evaluation participated in individual semi-structured interviews exploring experiences with developmental screening, related services, and family involvement/social support. Qualitative data were transcribed, coded, and analyzed using applied thematic analysis. Data were stratified by partner status (i.e., partnered vs. nonpartnered) to examine differences in support and family involvement across varying family compositions. Three qualitative themes emerged: (1) mothers sought family involvement when making decisions about pursuing developmental evaluations, (2) family involvement affected mothers' navigation of logistical challenges, and (3) mothers involved family members for emotional support. Differences by partner status emerged in themes 1 and 2. Findings highlight benefits of and potential approaches to harnessing family involvement to support parents' navigation of the developmental evaluation process and ultimately improve child outcomes.

Implementation of a digital exercise programme in health services to prevent falls in older people.

StandingTall uses eHealth to deliver evidence-based balance and functional strength exercises. Clinical trials have demonstrated improved balance, reduced falls and fall-related injuries and high adherence. This study aimed to evaluate the implementation of StandingTall into health services in Australia and the UK. Two hundred and forty-six participants (Australia, n =184; UK, n =62) were recruited and encouraged to use StandingTall for 2h/week for 6-months. A mixed-methods process evaluation assessed uptake and acceptability of StandingTall. Adherence, measured as % of prescribed dose completed, was the primary outcome. The study, conducted October 2019 to September 2021 in Australia and November 2020 to April 2022 in the UK, was affected by COVID-19. Participants' mean age was 73 ± 7years, and 196 (81%) were female. Of 129 implementation partners (e.g. private practice clinicians, community exercise providers, community service agencies) approached, 34% (n =44) agreed to be implementation partners. Of 41 implementation partners who referred participants, 15 (37%) referred ≥5. Participant uptake was 42% (198/469) with mean adherence over 6 months being 41 ± 39% of the prescribed dose (i.e. 39 ± 41 min/week) of exercise. At 6 months, 120 (76%) participants indicated they liked using StandingTall, 89 (56%) reported their balance improved (moderately to a great deal better) and 125 (80%) rated StandingTall as good to excellent. For ongoing sustainability, health service managers highlighted the need for additional resources. StandingTall faced challenges in uptake, adoption and sustainability due to COVID-19 and a lack of ongoing funding. Adherence levels were lower than the effectiveness trial, but were higher than other exercise studies. Acceptance was high, indicating promise for future implementation, provided sufficient resources and support are made available. Australian and New Zealand Clinical Trials Registry ACTRN12619001329156.

A comprehensive approach to evaluate risk mitigation strategies in offshore wind farms using spherical fuzzy decision making analysis

The escalating impact of global warming, primarily exacerbated by carbon emissions from conventional energy sources, has prompted significant advancements in offshore wind energy as a pivotal avenue for sustainable development. Amid the surging interest in renewable energy, offshore wind-farms have emerged as a promising solution. To ensure their efficient and effective operation, it becomes imperative to systematically identify and mitigate potential risks. This study addresses the critical need to systematically prioritize risk reduction strategies for offshore wind farms, a problem that has not been comprehensively explored in the literature. A multi-criteria analysis has been adopted to simultaneously evaluate the contradictory criteria in the evaluation process. The novelty of this study lies in its integration of spherical fuzzy sets with multi-criteria decision-making (MCDM) techniques to handle uncertainties and evaluate contradictory criteria simultaneously. As a result of all this analysis, the most critical risks for offshore wind-farms and risk mitigation strategies that can be adopted within the determined risks have been revealed. The main findings reveal that turbine underperformance, disruption of habitats, and grid connection issues are the most critical risks. Furthermore, a combination of robust design and engineering and collaboration and partnerships emerged as the most effective risk mitigation strategies.

Experimental Study on Shear Creep Characteristics of Residual Soil with Different Stone Content

The residual soil on a slope can slowly move downward under the influence of gravity, forming a creep landslide. These types of landslides are known for their extensive coverage, significant magnitude, and prolonged duration of hazard. A systematic study of the creep properties of creep landslide geotechnical bodies is essential for the analysis of the deformation process and long-term safety evaluation of landslides. This paper focuses on studying a creep landslide involving residual soil in western Henan Province. The creep characteristics of residual soil with different stone content are investigated through direct shear creep experiments. The findings reveal that stone content has a profound impact on the creep behavior of residual soil. As the stone content of the soil increased, the structure of the test soil changed significantly, resulting in a gradual decrease in its shear creep. The Burgers model can effectively fit the deceleration creep and steady-state creep stages of the residual soil. With the increase in stone content, the four parameters of the Burgers model show a significant increase, with the instantaneous elasticity coefficient G1 and the viscosity coefficient η1 experiencing more noticeable changes. The average long-term strength of specimens with different stone content is only 54% of their instantaneous strength. Additionally, as the stone content increases, the ratio of long-term strength to instantaneous strength also increases. Notably, the long-term strength of specimens with 10–30% stone content is significantly lower than that of specimens with 50–70% stone content.

Pembuatan Neon Box Berbasis Panel Surya sebagai Pemanfaatan Energi Mandiri di SMK Negeri 2 Pengasih Kulon Progo

<p><em>Innovative Independent MBKM activities are initiations and efforts to facilitate student learning rights in self-development to improve student competence by skill and knowledge in the fields of Education, Industry, Society, Entrepreneurship, and Research. Students carry out Innovative Independent MBKM activities through Educational Practices at one of the SMKs in Kulon Progo. SMK Negeri 2 Pengasih is a superior vocational high school in the Kulon Progo region which is the destination for carrying out Educational Practices activities. This school does not have technology for the utilization of renewable technology. Neon boxes are made by involving observation, design, working process, trial, and job evaluation. The purpose of creating a neon box is to reduce dependence on conventional energy sources, generate long-term cost savings, and decrease the carbon footprint. Through the neon box innovation, the results were obtained that this tool can integrate solar panel technology as independent energy utilization.</em></p>

Quantifying Residents’ Perceptions of Smart Community Construction through a Hybrid EWM-PROMETHEE II Method: A Case Study of Shenzhen, China

Smart community construction (SCC) is pivotal for urban modernization, yet extant research often neglects the residents’ perceptions of these initiatives, focusing predominantly on technological advancements. A hybrid evaluation method integrating the Entropy Weight Method (EWM) and PROMETHEE II was developed to quantify residents’ perceptions of SCC. Through the literature review and expert interview, the evaluation indicators for residents’ perceptions of the SCC were identified, leading to the development of an evaluation indicator system consisting of 5 dimensions and 25 indicators. The hybrid evaluation method that combines EWM and PROMETHEE II was then applied to quantify the level of residents’ perceptions of SCC across five communities in Shenzhen city of China, using data from 410 valid questionnaires. The results indicated that the Baolong community had the highest level of the SCC, while the Nanyuan community exhibited the lowest ranking. Sensitivity analysis confirmed the robustness of these results, thereby validating the evaluation process. Moreover, recommendations were proposed to enhance residents’ perceptions of smart community initiatives. This research not only introduces a novel evaluation method that expands the body of knowledge on the SCC and residents’ perceptions but also helps the government develop sustainable SCC strategies.

Evaluation of COVID-19 IPC Strategies in Selected Hospitals in the Philippines

The existing guidelines on Infection, Prevention, and Control (IPC) from the WHO were implemented within the Philippines by the Department of Health (DOH). However, to date, no evaluation process has been published to prove its effectiveness and to enhance its process. The evaluation process will help to further enhance the IPC process to mitigate COVID-19 cases. The study aims to work out the evaluation of the infection prevention and control (IPC) strategies by the nurses and nursing attendants in selected hospitals. A cross-sectional survey and a Focus group discussion were conducted in two selected hospitals to assess compliance to the COVID 19 IPC strategies. The population included nurses and nursing attendants within the two selected hospitals that cater to COVID-19 patients. An IPC strategy for COVID-19 compliance checklist was created to be used for the evaluation process. results show that the respondents have good compliance with IPC strategies. The compliance of the nurses and nursing attendants is indicative of an honest evaluation of the IPC strategies during this study. The IPC strategies are improving over time and an endless evaluation process is required.

Protocol for the process evaluation of the GOAL trial: investigating how comprehensive geriatric assessment (CGA) improves patient-centred goal attainment in older adults with chronic kidney disease in the outpatient setting

IntroductionThe GOAL Cluster Randomised Controlled Trial (NCT04538157) is now underway, investigating the impact of comprehensive geriatric assessment (CGA) for frail older people with chronic kidney disease (CKD). The primary outcome...

Implementation of integrated care for type 2 diabetes Mellitus and Periodontitis in Germany: study protocol for a practice-based and cluster-randomized trial

BackgroundType 2 Diabetes mellitus (T2DM) and periodontitis share common risk factors and influence one another. However, primary care and oral health care continue to operate separate from each other and fail to synchronize care for patients with T2DM and periodontitis. The purpose of this practice-based trial is to evaluate the implementation of a new integrated care pathway for patients with T2DM and periodontitis. The new approach integrates a screening for T2DM risk in dental care settings in patients with periodontitis, a screening for periodontitis risk in primary care settings in patients with T2DM, and mutual referrals between dentists and primary care physicians.MethodsTwo practice-based studies will be carried out in parallel: (i) In dental care settings: a practice-based, multi-centric, cluster-randomized, controlled trial with a control and an intervention group; (ii) in primary care settings: a practice-based, multi-centric, non-randomized, controlled trial with a synthetic control group calculated from claims data. Following a two-step recruitment approach, 166 dentists and 248 general practitioners will be recruited, who themselves will recruit a total of 3808 patients in their practices. Patient data will be collected at baseline, 12 months, and 24 months after study enrollment. The evaluation comprises: (i) impact evaluation, using a hierarchical linear mixed model; (ii) process evaluation, based on surveys alongside the trials; (iii) economic evaluation. In addition, a Discrete-Choice-Experiment will identify provider’s payment preferences for the new care approach.DiscussionUpon successful implementation, the intervention will enable health care providers to detect a risk for T2DM and periodontitis in patients at an early stage, thus providing patients an opportunity for timely diagnosis and therapy. Ultimately, this can lead to increased quality of life and reduced health care expenditures. On a methodologic level, the project provides novel insights into a complex intervention on the intersection of general practice and dental care.Trial registrationThe study was prospectively registered at the German Clinical Trials Register (https://drks.de/search/de/trial/DRKS00030587) on 3. July 2023 under ID “DRKS00030587“.

Implementing a real-time patient experience feedback in inpatient rehabilitation: Process evaluation informed by the normalisation process theory.

Near real-time patient experience feedback (NRTPEF) can enable a patient-centric, immediate service recovery but has not been widely used in inpatient rehabilitation. We 1) assess the utility, feasibility, and acceptability of implementing a new NRTPEF, perceived by patients and providers; and 2) understand how the NRTPEF became embedded into routine provider practices. Mixed methods process evaluation of the 8-month implementation of an innovative NRTPEF in an inpatient rehabilitation unit, using interviews and focus groups with all the service-unit leaders and interviews with a randomised sample of patients. Beyond descriptive statistics and content analysis, the Normalisation Process Theory (NPT) informed a framework analysis. Patients and service-unit leaders perceived high utility in the NRTPEF (median: 9 for both; 0-10 scale) and qualitative comments emphasised the value of providing/obtaining timely feedback. The system was found feasible and acceptable for patients (median: 9.5), but with an improvement margin for providers (median: 7.3). Suggestions include strengthening the data-relay format. Even in the pilot form, providers found the NRTPEF became embedded into practice (median 10; average: 8.6). The analysis based on the NPT shows how providers saw differential value, engaged with, and used the patient feedback into reconfigured practices. An innovative NRTPEF was found useful, feasible and acceptable, but with refinement opportunities before scale-up.