Process Evaluation Tool Research Articles

Process Integration of Hydrogen Production Using Steam Gasification and Water-Gas Shift Reactions: A Case of Response Surface Method and Machine Learning Techniques

An equilibrium-based steady-state simulator model that predicts and optimizes hydrogen production from steam gasification of biomass is developed using ASPEN Plus software and artificial intelligence techniques. Corn cob’s chemical composition was characterized to ensure the biomass used as a gasifier and with potential for production of hydrogen. Artificial intelligence is used to examine the effects of the significant input variables on response variables, such as hydrogen mole fraction and hydrogen energy content. Optimizing the steam-gasification process using response surface methodology (RSM) considering a variety of biomass-steam ratios was carried out to achieve the best results. Hydrogen yield and the impact of main operating parameters were considered. A maximum hydrogen concentration is found in the gasifier and water-gas shift (WGS) reactor at the highest steam-to-biomass (S/B) ratio and the lowest WGS reaction temperature, while the gasification temperature has an optimum value. ANFIS was used to predict hydrogen of mole fraction, 0.5045 with the input parameters of S/B ratio of 2.449 and reactor pressure and temperature of 1 bar and 848°C, respectively. With the steam-gasification model operating at temperature (850°C), pressure (1 bar), and S/B ratio of 2.0, an ASPEN simulator achieved a maximum of 0.5862 mole fraction of hydrogen, while RSM gave an increase of 19.0% optimum hydrogen produced over the ANFIS prediction with the input parameters of S/B ratio of 1.053 and reactor pressure and temperature of 1 bar and 850°C, respectively. Varying the gasifier temperature and S/B ratio have, on the other hand, a crucial effect on the gasification process with artificial intelligence as a unique tool for process evaluation, prediction, and optimization to increase a significant impact on the products especially hydrogen.

PH-Responsive textile with anthocyanin-laden hydrogel yarns: a colorimetric and feasibility study

Abstract Responsive materials can transform their visual appearance in reaction to environmental stimuli. One example of such responsiveness involves the use of plant-based anthocyanins as pH-mediated allochroic pigments. Despite the increasing interest and applications of this pigment, its applications in urban contexts are very limited. By using pH-mediated colour change as a phenomenon to trial a colourimetric quantitative framework, this study seeks to bridge smart material design with colour science approaches to enable future scale-up applications. The colour values of anthocyanins immobilised in sodium alginate-based hydrogel discs and yarns were measured in response to varying pH values. The colourimetric measurements in CIELAB colour space provided a device for setting independent colour values that demonstrated a clear pattern across the pH range of 1–12. The colour difference (ΔE00) of mean colour values was perceivably different across the pH scale, with a minimum value of 2.7. Key variables of the process have been summarised, and their relationships have been discussed. Finally, a proof-of-concept small-scale textile prototype encompassing anthocyanin-laden hydrogel yarns was developed. The findings of this study contribute towards the integration of non-destructive means of colour measurement as a quantitative tool for biochemical process evaluation.

Evaluation of dynamic control of continuous capture with periodic counter-current chromatography under feedstock variations

Multi-column periodic counter-current chromatography is a promising technology for continuous antibody capture. However, dynamic changes due to disturbances and drifts pose some potential risks for continuous processes during long-term operation. In this study, a model-based approach was used to describe the changes in breakthrough curves with feedstock variations in target proteins and impurities. The performances of continuous capture of three-column periodic counter-current chromatography under ΔUV dynamic control were systematically evaluated with modeling to assess the risks under different feedstock variations. As the concentration of target protein decreased rapidly, the protein might not breakthrough from the first column, resulting in the failure of ΔUV control. Small reductions in the concentrations of target proteins or impurities would cause protein losses, which could be predicted by the modeling. The combination of target protein and impurity variations showed complicated effects on the process performance of continuous capture. A contour map was proposed to describe the comprehensive impacts under different situations, and nonoperation areas could be identified due to control failure or protein loss. With the model-based approach, after the model parameters are estimated from the breakthrough curves, it can rapidly predict the process stability under dynamic control and assess the risks under feedstock variations or UV signal drifts. In conclusion, the model-based approach is a powerful tool for continuous process evaluation under dynamic changes and would be useful for establishing a new real-time dynamic control strategy.

Harnessing the benefits of the Nutrition Care Process Quality Evaluation and Standardization Tool: a national auditing initiative to improve quality of documentation.

The Nutrition Care Process Quality Standardization and Evaluation Tool (NCP QUEST) is a validated audit instrument assessing the quality of NCP documentation by Registered Dietitians Nutritionists (RDNs). The present quality improvement project describes change in documentation quality as measured by NCP QUEST and word count of notes after a monthly national digital training provided to Veteran Affairs (VA) RDNs. The training and adoption of NCP QUEST was voluntary. Facilities were recruited among those that had participated during the design and validation study of NCP QUEST. The NCP QUEST score was calculated and the word count was determined for 52 documentation notes (28 from NCP QUEST non-user facilities and 24 from NCP QUEST user facilities) before and after training. The mean pre-training NCP QUEST score for notes from NCP QUEST non-user facilities was 13.71 and 13.88 for NCP QUEST user facilities. The mean post training total NCP QUEST score for non-user facilities was 14.00 and 17.65 for user facilities, with no improvement for the non-user facilities (P=0.69). A significant improvement was identified for the NCP QUEST user facilities (P≤0.001). All facilities experienced a significant reduction in the word count of assessment notes (P=0.04). Use of the electronic NCP terminology website increased 123-fold and was sustained after the training. NCP QUEST users reported that the audit tool is useful. The NCP QUEST should be at the center of RDNs' training and more strategic effort is needed to engage practitioners in the optimal application of the NCP.

Thermo-capillary-gravity bidirectional modelling for evaluation and design of wire-based directed energy deposition additive manufacturing

Wire-based directed energy deposition (w-DED) is an additive manufacturing process well-suited for building large-scale structural components. Deposit bead geometry and its relation to process parameters is a vital aspect of a w-DED process, which is crucial for preventing defects and minimising material waste. In this study, a thermo-capillary-gravity bidirectional analytical model is developed based on the fundamental governing physics, enabling fast predictions of both w-DED bead geometries and process parameters. A novel method is also proposed to determine the power transfer efficiency and wire melting efficiency defined in the model. In the forward modelling, deposit bead geometries, such as layer height and width, can be predicted for given process parameters and material properties. In the reverse modelling, the outputs of the model are process parameters, including heat source power and travel speed, to achieve the deposit bead geometries as required for a given application. This bidirectional modelling approach is applicable to different w-DED processes, and it has been validated for the deposition of steel walls using plasma transferred arc and cold wire gas metal arc processes. The developed bidirectional analytical model could be used as an efficient and reliable tool for w-DED process evaluation and design.

Techno-economic and exergy analysis of e-methanol production under fixed operating conditions in Germany

Electric-based methanol (e-MeOH) has the potential to substitute fossil-based hydrocarbons as the prominent feedstock in the production of climate-neutral synthetic fuels and organic chemicals because e-MeOH can be fully produced from renewable energy sources, such as solar photovoltaic (PV) and wind energy. It is basically produced via direct CO2-hydrogenation from captured CO2 and electrolytic H2. Although the techno-economics of the e-MeOH production process have been extensively studied, the published results have not included direct comparison of the reactor design configuration, different kinetic models, and exergy analysis.To assess the process performance, the e-MeOH plant is modelled and simulated in Aspen Plus® on the basis of the state-of-the-art Lurgi MegaMethanol® technology. The in-house tool TEPET (Techno-Economic Process Evaluation Tool) assists with the techno-economic analysis, including a sensitivity analysis regarding CO2 and H2 costs and an exergy analysis of the e-MeOH plant.With the recommended process configuration, the e-MeOH plant could achieve energetic and exergetic Power-to-Fuel (PtF) efficiency of 52.4% and 56.4%, respectively. The e-MeOH can be produced in 2018 at NPC 1129–1481 €t−1 or 57–74 €GJ−1. These values would be doubled if the e-MeOH plant operates exclusively with the help of solar and wind energy in Germany. The study also investigates the impact of different published kinetic models of methanol synthesis, which alter the NPC by around 2.3%.

Co-learning through participatory evaluation: an example using Theory of Change in a large-scale EU-funded tourism intervention

Tourism interventions, as tools for social change and preservation of natural and cultural assets are inherently complex. This study presents an improved method for the evaluation of complex tourism interventions. We argue that participatory methods can promote a culture of evaluation that supports partners throughout evidencing project impacts, eliminating negative attitudes to evaluation resulting from fear of being judged on performance. We demonstrate that Theory of Change (ToC) is an effective tool that allows organisations to actively co-create and own an evaluation strategy to ensure the delivery of project outcomes. We show how ToC can be applied as a useful process and impact evaluation tool. This paper represents a novel methodological application of ToC based on participatory approaches to evaluation to disseminate knowledge and to improve decision-making in the field of tourism interventions and tourism policy making.

Equity Lens Protocol: Reflecting on Harms From the COVID-19 Response and Mitigation Strategies Implemented in a Local Public Health System.

This report describes an Equity Lens Protocol and its use to guide partners' systematic reflection on harms and mitigation strategies of the COVID-19 response in a local public health system. This process evaluation tool is based on the Guidance document for assuring an equitable response to COVID-19 prepared by the Pan American Health Organization. We used a participatory approach to engage public health partners in systematically reflecting on harms, mitigation strategies, and lessons learned and implications for practice. Outputs from using this tool included identified: (a) specific harms (e.g., loss of income and challenges to learning) related to particular COVID-19 response measures (e.g., home confinement and school closure) and (b) mitigation strategies implemented to reduce harms. In response to the protocol's guiding questions, partners also identified lessons learned and practice recommendations for strengthening equity work in public health responses (e.g., an equitable response requires an investment in people, structures, and relationships before a crisis). This report-and accompanying protocol-illustrates use of a practical method for systematic reflection on public health responses through an equity lens.

Monitor to innovate with feedback loops: process evaluation protocol for an anemia prevention intervention.

Background: Digital process monitoring and evaluation tools designed to capture near-to-real-time intervention data paired with feedback loops have the potential to innovate intervention delivery. Objective: To describe how a multilevel social norms field trial (RANI) is using feedback loops to enhance intervention delivery. Methods: We use a mixed-methods process evaluation design to monitor the Reduction of Anemia through Normative Innovations (RANI) project; a three-year randomized control trial which aims to lower rates of anemia among women in Odisha, India. Surveys and structured observation monitor fidelity to implementation andacceptability ofimplementation activities among study participants. Quantitative data evaluates implementation dose, coverage, exposure, and reach of intervention activities, and qualitative data will delve more deeply into reasons for high or low functioning. Iron folic acid supplement supply and demand are also monitored for stock-outs. Data collected from 130 intervention villages is processed, visualized, and triangulated in near to real-time via Real-time Monitoring for Knowledge Generation (RPM4K), a locally developed software application. Data visualization products facilitate the examination of monitoring data to mitigate bottlenecks and identify and implement tweaks to our intervention delivery strategy on an ongoing basis. Discussion: Feedback loops facilitate timely course corrections. Feedback loops can also engender a shared understanding of ground realities for a geographically dispersed and culturally diverse team. Leveraging feedback loops, we identify opportunities to provide on-going supportive supervision for our community facilitators promoting joint problem-solving, and communication. Monthly media and hemoglobin level demonstration strategies are informed by participant engagement and acceptability. Stock-outs of iron folic acid tablets activate contingency plans to mobilize local stakeholders and advocate for timely resolutions. Unintended effects are monitored based on ongoing feedback from community facilitators. Conclusions: Documenting our processes can inform the future implementation or scale up of similar projects embracing feedback loops to iterate and innovate their intervention delivery.

Monitor to innovate with feedback loops: process evaluation protocol for an anemia prevention intervention

Background: Digital process monitoring and evaluation tools designed to capture near-to-real-time intervention data paired with feedback loops have the potential to innovate intervention delivery. Objective: To describe how a multilevel social norms field trial (RANI) is using feedback loops to enhance intervention delivery. Methods: We use a mixed-methods process evaluation design to monitor the Reduction of Anemia through Normative Innovations (RANI) project; a three-year randomized control trial which aims to lower rates of anemia among women in Odisha, India. Surveys and structured observation monitor fidelity to implementation and acceptability of implementation activities among study participants. Quantitative data evaluates implementation dose, coverage, exposure, and reach of intervention activities, and qualitative data will delve more deeply into reasons for high or low functioning. Iron folic acid supplement supply and demand are also monitored for stock-outs. Data collected from 130 intervention villages is processed, visualized, and triangulated in near to real-time via Real-time Monitoring for Knowledge Generation (RPM4K), a locally developed software application. Data visualization products facilitate the examination of monitoring data to mitigate bottlenecks and identify and implement tweaks to our intervention delivery strategy on an ongoing basis. Discussion: Feedback loops facilitate timely course corrections. Feedback loops can also engender a shared understanding of ground realities for a geographically dispersed and culturally diverse team. Leveraging feedback loops, we identify opportunities to provide on-going supportive supervision for our community facilitators promoting joint problem-solving, and communication. Monthly media and hemoglobin level demonstration strategies are informed by participant engagement and acceptability. Stock-outs of iron folic acid tablets activate contingency plans to mobilize local stakeholders and advocate for timely resolutions. Unintended effects are monitored based on ongoing feedback from community facilitators. Conclusions: Documenting our processes can inform the future implementation or scale up of similar projects embracing feedback loops to iterate and innovate their intervention delivery.

Preventing Falls Among Older Adults in Primary Care: A Mixed Methods Process Evaluation Using the RE-AIM Framework.

Falls are a leading cause of injuries and injury deaths for older adults. The Centers for Disease Control and Prevention's Stopping Elderly Accidents Deaths and Injuries (STEADI) initiative, a multifactorial approach to fall prevention, was adapted for implementation within the primary care setting of a health system in upstate New York. The purpose of this article is to: (a) report process evaluation results for this implementation using the Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) framework and (b) examine the utility of RE-AIM for assessing barriers and facilitators. This evaluation used mixed methods. Qualitative evaluation involved semistructured interviews with key stakeholders and intercept interviews with health care providers and clinic staff. Quantitative methods utilized surveys with clinic staff. Process evaluation tools were developed based on the AIM dimensions of the RE-AIM framework. The study was conducted over a 2-month period, approximately 18 months postimplementation, and complements previously published results of the program's reach and effectiveness. Primary barriers by RE-AIM construct included competing organizational priorities (Adoption), competing patient care demands (Implementation), and staff turnover (Maintenance). Primary facilitators included having a physician champion (Adoption), preparing and training staff (Implementation), and communicating about STEADI and recognizing accomplishments (Maintenance). Results revealed a high degree of concordance between qualitative and quantitative analyses. The framework supported assessments of various stakeholders, multiple organizational levels, and the sequence of practice change activities. Mixed methods yielded rich data to inform future implementations of STEADI-based fall prevention.

THE USE OF ASSESMENT TOOLS IN GERIATRIC NURSING

The care of a geriatric patient has its particularities. Each geriatric patient suffers from syndromes that are characteristic of this age. In the work of a nurse who is caring for geriatric patients using the nursing process method, measuring scales and evaluation tools play an irreplaceable role, especially when assessing a geriatric patient.The aim of the paper is to summarize the available assessment tools that are suitable for use in geriatric patients.Methods: the method of literature review was used.Results. We summarize the available evaluation tools and their possibilities of use in geriatric nursing in the area of self-sufficiency, movement, risk of pressure ulcers, in the area of assessment of nutrition and cognitive functions.Conclusions. The use of evaluation tools in geriatric nursing brings benefits not only for the patient but also for the nurse. Their use is possible not only in the assessment phase, but continuously during the entire approach to the geriatric patient.

Techno-economically-driven identification of ideal plant configurations for a new biomass-to-liquid process – A case study for Central-Europe

The conversion of agricultural waste materials such as bark or straw into 2nd generation biofuels constitutes an auspicious way to meet part of the future fuel demand in a sustainable way. The number of possible production routes is diverse, and the techno-economic analyses of these routes have been conducted in very different ways. The route involving gasification, gas purification, and a subsequent Fischer-Tropsch synthesis enables the production of hydrocarbons that achieve current fuel standards after upgrading in the existing refinery infrastructure. To evaluate a promising biomass-to-liquid process, a methodology is presented that incorporates economic constraints into the process design, allowing identification of a regionally optimal process design. The production costs of the new concepts are estimated by setting up a detailed flowsheet simulation in AspenPlus® based on experimental data from the successful demonstration runs of the EU-Project COMSYN. In addition, an existing techno-economic evaluation methodology incorporated into the in-house software tool TEPET (Techno-Economic Process Evaluation Tool) has been extended to evaluate the processes’ performance in different European regions and to include transportation and refining costs. The approach enables the identification of regional sweet spots shown on a map for Central-Europe, indicating production costs and favorable process design for each region. Furthermore, the results of an automated mapping for the optimal process design depending on the heat and electricity market are presented. The performed analyses show that the techno-economic evaluation tends to expand the technology in regions with low feedstock costs, while the optimal process design is defined by the regional heat and electricity market. In this work, net production costs of less than 1.12 €2019/lbiofuel were determined for regions in Hungary, Poland and Slovakia.

Profile of Critical Thinking Skills Associated with Science Learning Outcomes of Junior High School Students in Mataram City

Efforts to develop critical thinking skills are still educational goals which are expected to improve learning outcomes which have an impact on the performance and quality of students. It is important to measure critical thinking skills so that the right techniques can be found to develop and improve these thinking skills. This study aims to describe critical thinking skills and their relationship with science learning outcomes of SMPN students in the city of Mataram. This type of research is a quantitative descriptive study with a sample of 418 Grade VII students and 435 Grade VIII students who were determined using purvosive techniques. Collecting data using test instruments that have been validated by experts and tested for reliability. The results showed that the critical thinking skills profile of the students of SMPN Mataram City was classified as moderate, with an average score of 68.83 for grade seven (VII) and 70.69 for grade eight (VIII). So it can be said that the relationship between critical thinking skills and science learning outcomes is very low as indicated by the R square value. R square for class VII is 0.074, which means that critical thinking skills have an effect of 7% on science learning outcomes. R square for class VII is 0.097, which means that critical thinking skills have an effect of 9% on science learning outcomes. The critical thinking skills of SMPN students in Mataram City needs to be improved by improving the learning process and learning evaluation tools.

STEADI in Primary Care: A Process Evaluation of the New York State Implementation

This session presents findings from a STEADI process evaluation that was conducted within a primary care setting in New York State. This process evaluation used mixed methods including quantitative analysis of surveys with clinic staff as well as qualitative methods such as intercept interviews with healthcare providers and clinic staff, and structured interviews with key stakeholders. The RE-AIM framework guided development of the process evaluation tools. The process evaluation was conducted over a 2-month period approximately 18 months post-implementation. Facilitators included: (a) Adoption - physician champion and administrative support; (b) Implementation - wellness coordinators, preparation and training, and organizational quality measures; (c) Maintenance - feedback from patients, local and national recognition, and impact on fall-related outcomes. Barriers included: (a) Adoption – organizational priorities and complexity of electronic health records; (b) Implementation – resistance to change and competing patient care demands; (c) Maintenance - staff turnover and follow through of referrals.

Process Evaluation of Literacy Practices within a Multi-Tiered System of Supports Framework

Extant coverage of multi-tiered systems of support (MTSS) in the research literature has tended to focus on student outcomes as opposed to the process of adult implementation. This conceptual article presents a model of process evaluation as a means to assess the fidelity of implementation of a multi-tiered system of supports (MTSS) framework to support instructional practices in reading in schools. The article begins by defining MTSS and its core components and overviewing the applicability of process evaluation in assessing MTSS implementation and outcomes. Novel process evaluation tools are presented, including examples of their application in evaluating MTSS implementation for tiered reading instruction. Implications are drawn regarding how MTSS process evaluations can be conducted by school psychologists or other evaluators in school settings, and why it can be valuable to do so.

Data mining as a hatchery process evaluation tool

ABSTRACT The hatchery is one of the most important segments of the poultry chain, and generates an abundance of data, which, when analyzed, allow for identifying critical points of the process . The aim of this study was to evaluate the applicability of the data mining technique to databases of egg incubation of broiler breeders and laying hen breeders. The study uses a database recording egg incubation from broiler breeders housed in pens with shavings used for litters in natural mating, as well as laying hen breeders housed in cages using an artificial insemination mating system. The data mining technique (DM) was applied to analyses in a classification task, using the type of breeder and house system for delineating classes. The database was analyzed in three different ways: original database, attribute selection, and expert analysis. Models were selected on the basis of model precision and class accuracy. The data mining technique allowed for the classification of hatchery fertile eggs from different genetic groups, as well as hatching rates and the percentage of fertile eggs (the attributes with the greatest classification power). Broiler breeders showed higher fertility (> 95 %), but higher embryonic mortality between the third and seventh day post-hatching (> 0.5 %) when compared to laying hen breeders’ eggs. In conclusion, applying data mining to the hatchery process, selection of attributes and strategies based on the experience of experts can improve model performance.

Virtual reality in social marketing: a process evaluation

PurposeThe purpose of this paper is to present an innovative reflexive process evaluation method for a social marketing programme featuring an innovative virtual reality (VR) simulation experience for adolescents.Design/methodology/approachA process evaluation framework focusing on three key elements – context, implementation and mechanisms of impact – was followed in this study. In total, 374 participants (mean age: 15.2 years, 58 per cent female) completed outcome evaluation surveys before and after the programme delivery, and 300 participants completed qualitative feedback forms following their participation in the VR component of the programme.FindingsA process evaluation delivers insights beyond those attained in outcome evaluations, enhancing the understanding of factors contributing to programme success or failure that can be used to improve future programme iterations. The VR experience demonstrated high satisfaction scores with users, and the findings demonstrate the importance of a multi-disciplinary and industry partnered programme approach to support VR implementation and delivery.Research limitations/implicationsThis research demonstrates that additional learnings are obtained from a process evaluation. The findings are limited to one specific research programme, and the outcome effects of the VR simulation have not been assessed in isolation.Practical implicationsThe methods outlined in this paper offer a process evaluation tool that can be used by marketers and other practitioners to reflect on programme success or failure to enhance core offerings.Originality/valueThe application of Moore et al.’s (2015) process evaluation framework delivers a reflexive research tool that can be applied to critically consider three key elements: context, implementation and mechanisms of impact of developed programmes. VR’s capacity to provide a satisfying and highly valued programme resource that participants value for its realistic, novel and immersive experiential learning experience was demonstrated.

The He Pikinga Waiora process evaluation tool guiding implementation of chronic condition interventions in Māori and other Indigenous communities

The International Journal of Integrated Care (IJIC) is an online, open-access, peer-reviewed scientific journal that publishes original articles in the field of integrated care on a continuous basis.IJIC has an Impact Factor of 5.120 (2020 JCR, received in June 2021)

Process Evaluation Tool Development and Fidelity of Healthy Retail Interventions in American Indian Tribally Owned Convenience Stores: the Tribal Health Resilience in Vulnerable Environments (THRIVE) Study.

ABSTRACTBackgroundThe Tribal Health Resilience in Vulnerable Environments (THRIVE) study aimed to increase healthy food access in 2 rural American Indian communities. The intervention sought to increase fruit and vegetable availability, variety, and convenience through placement, promotion, and pricing of healthy foods and beverages in tribal convenience stores.ObjectiveThe aim of this study was to describe the development and implementation of the study process evaluation tool to assess intervention fidelity as part of this cluster-controlled trial.MethodsEight stores (2 intervention and 2 control stores per Nation) participated in the study, implemented from May 2016 to May 2017. A web-based survey tailored to store layouts and intervention components assessed how often intervention items were available, approximate quantity available, and whether placement of healthier food items and promotional materials were implemented as designed. After pilot testing the survey, tribal staff members implemented it to collect process evaluation data in the 8 stores during a period of 9–12 mo, assessing study implementation and potential changes in control stores.ResultsPromotional materials were available ≥75% of the time for most intervention locations. Fruit availability was similar in Nation A and Nation B intervention stores (79–100% compared with 70–100%), whereas fresh vegetable availability was higher in Nation B compared with Nation A (95–96% compared with 55–75%). Both control stores in Nation A and 1 control store in Nation B had moderate fruit and vegetable availability, ranging from 45% to 52%. No control stores in either Nation used intervention promotional materials.ConclusionsProcess evaluation data indicate that the study was implemented with moderate to high fidelity. The development and implementation of the tool can inform future healthy retail interventions that aim to improve rural and tribal food environments.