Pilot Evaluation Research Articles

Pilot evaluation of the diabetes prevention program (DPP) using the transcultural cardiometabolic-based chronic disease model for czechia (TCMBCD-CZ).

Pilot evaluation of the diabetes prevention program (DPP) using the transcultural cardiometabolic-based chronic disease model for czechia (TCMBCD-CZ).

Pilot Maneuvering Performance Analysis and Evaluation with Deep Learning

Quick access recorder (QAR) data have been used to evaluate pilot performance for decades. However, traditional evaluation methods suffer from the inability to consider multiple parameters simultaneously, and most of them need to select features manually in advance. To study the relationship between QAR data and pilot performance, this paper puts forward one-dimensional convolutional neural networks (1-D CNN) which consider QAR metrics in an integrated manner. This paper obtained indicators describing the operational status of an aircraft first. Then, the correlation between indicators and pilot performance (skill levels) was studied. Inspired by the fact that CNN can extract both local and global features, this paper has developed an approach to achieve the state-of-the-art result in pilot performance evaluation, which was tested on operating data of Boeing 737. The results prove that other methods do not work well, while the 1-D CNN improves the prediction accuracy of 5 pilot skill levels. Besides, when it is used on a binary classification problem, the result improves to 78.18%. Finally, the indicators were grouped into 5 common factors by factor analysis and fed into 1-D CNN in different combinations. Each common factor plays a different role in pilot performance evaluation, which can provide advice for the future.

Aircraft-assisted suicide: The rarity of attempts, ideation, or underreporting?

IntroductionAircraft-assisted suicide is a rare but serious event, with immediate consequences for the pilot, crew, and passengers. The overt linkage between mental illness and suicidal behaviour is well-known, however, the infrequency of these events in the context of aviation, coupled with poor record-keeping and reluctance to disclose, likely disguises the true extent of mental illness among pilots. One critical research gap in Canada has been the lack of investigation of crashes linked to suicide or a mental disorder. Research on aircraft-assisted suicide will address the key issues of pilots’ reluctance to disclose, report, and seek mental health services. Our study investigates the frequency of aircraft-assisted suicide in Canada, reviews current medical standards, and discusses preventative interventions to manage future risk. Materials and methodsOur study examined investigations and reports conducted by the Transport Safety Board to explore the frequency of aircraft-assisted suicide over a ten year period. ResultsAircraft-assisted suicides in Canada are rare, however, mentally ill pilots involved in fatal crashes are likely underestimated. Our study highlights key barriers in aviators’ disclosure of mental health symptoms, an ineffective screening process, and a consequence-based system that deters pilots from their duty to report. Discussionour investigative analysis addresses key limitations in screening of mentally ill pilots, explores current medical standards and aeromedical exams, infrequency of fitness assessments, and demonstrates the critical need for continuous evaluation of pilots in this safety-sensitive occupation. ConclusionThe current paper addresses the need for continuous evaluation of pilot’s mental health and a more rigorous screening process to accurately identify suicide risk in pilots and prevent aircraft-assisted suicide.

Meeting the Shared Goals of a Student-Selected Component: Pilot Evaluation of a Collaborative Systematic Review.

Research methodology is insufficiently featured in undergraduate medical curricula. Student-selected components are designed to offer some research opportunities but frequently fail to meet student or supervisor expectations, such as completion or publication. We hypothesized that a collaborative, educational approach to a systematic review (SR), whereby medical students worked together, may improve student experience and increase success. This study aimed to establish whether offering a small team of students the opportunity to take part in the screening phase of SRs led by an experienced postgraduate team could enhance the learning experience of students, overcome the barriers to successful research engagement, and deliver published output. Postgraduate researchers from the University of Cambridge led a team of 14 medical students to work on 2 neurosurgical SRs. One student was appointed as the lead for each SR. All students were provided with training on SR methodology and participated in title and abstract screening using Rayyan software. Students completed prepilot, midscreening, and postscreening questionnaires on their research background, perceptions, knowledge, confidence, and experience. Questions were scored on a Likert scale of 1 (strongly disagree) to 10 (strongly agree). Of the 14 students involved, 29% (n=4) reported that they had received sufficient training in research methodology at medical school. Positive trends in student knowledge, confidence, and experience of SR methodology were noted across the 3 questionnaire time points. Mean responses to "I am satisfied with the level of guidance I am receiving," "I am enjoying being involved in the SR process," and "I could not gain this understanding of research from passive learning e.g., textbook or lecture" were greater than 8.0 at all time points. Students reported "being involved in this research has made me more likely to do research in the future" (mean 8.57, SD 1.50) and that "this collaborative SR improved my research experience" (mean 8.50, SD 1.56). This collaborative approach appears to be a potentially useful method of providing students with research experience; however, it requires further evaluation.

Pilot evaluation of a virtual training program for child injury prevention.

Unintentional injuries are a leading cause of child death. The present study evaluated the effectiveness of a behavioral injury prevention program for children aged 3-18 years and their caregivers. To accommodate families during the Coronavirus-19 pandemic, training was modified to be delivered virtually. Forty-one children aged 3-18 years and 14 parents/caregivers of children aged 3-5 years attended one of several 4-hour online injury prevention training sessions directed toward residents of Washington state. Training was targeted to three different developmental stages (ages 3-5, 6-12 and 13-18 years). Study outcomes included knowledge about injury prevention strategies, perceived vulnerability for injury, self-efficacy to engage in safety behaviors and behavioral intentions to be safe. Following training, participants showed improved self-efficacy to stay safe, excellent knowledge about the learned material and increased behavioral intention to engage safely. There was minimal change in perceived vulnerability to injury among children; caregivers of young children felt their children were somewhat less vulnerable to injury following the training. Almost all participants said they would recommend the program to others. Results suggest that a virtual behavioral training program delivered remotely is feasible and may be effective to create behavior change and reduce child injury risk. Given its scalability and reach, such programs are recommended for further study, refinement and, if demonstrated effective in larger-scale controlled trials, dissemination to address the leading cause of child mortality in the United States, unintentional injury.

Experimental Evaluation of Pilot and Main Injection Strategies on Gasoline Compression Ignition Engine—Part 1: Combustion Characteristics

<div>Climate change and stringent emission regulations have become major challenges for the automotive sector, prompting researchers to investigate advanced combustion technologies. Gasoline compression ignition (GCI) technology has emerged as a potential solution, delivering higher brake thermal efficiency with ultra-low nitrogen oxides (NOx) and particulate emissions. Combustion stability and controls are some of the significant challenges associated with GCI. This study investigates the combustion characteristics of a two-cylinder diesel engine in GCI mode. GCI experiments were performed using a low-octane fuel prepared by blending 80% (v/v) gasoline and 20% (v/v) diesel (G80). Baseline experiments were conducted in conventional diesel combustion (CDC) mode. These experiments investigated the effects of double pilot injection, first pilot fuel ratio, and the start of main fuel injection timing (10–8°CA before top dead center, bTDC). The results indicated that the GCI mode produced significantly lower (~10%) in-cylinder pressure than the CDC mode. Higher pilot fuel proportions exhibited a lower heat release rate (HRR) at low loads. Retarded main injection showed a lower heat release in the premixed combustion phase than the advanced main injection case at all loads. In addition, retarded main injection timing showed retarded start of combustion (SoC) and end of combustion (EoC). GCI mode exhibited higher cyclic variations than baseline CDC mode, which need to be addressed.</div>

Protecting elderly residents in care facilities against influenza and COVID-19 - the InFLUenza Communication, Advice and REporting (FluCARE) application: Feasibility Study.

Early detection and response to influenza and COVID-19 outbreaks in aged care facilities (ACFs) is critical to minimising health impacts. The Sydney Local Health District (SLHD) Public Health Unit (PHU) has developed and implemented a novel web-based application (app) to assist ACFs in outbreak response with integrated functions for online line listings, detection algorithms and automatic notifications to responders. The goal of the InFLUenza outbreak Communication, Advice and Reporting (FluCARE) app is to reduce time delays to notifications, which we hope will reduce the spread, duration and health impacts of an influenza or COVID-19 outbreak, as well as ease workload burdens on ACF staff. The specific aims of the study were: 1.To evaluate the acceptability and user satisfaction in the implementation and use of FluCARE in helping ACFs recognise, notify and manage influenza and COVID-19 outbreaks in their facility; 2. To identify the safety of FluCARE and identify any potential adverse outcomes of using the app; and 3.To identify any perceived barriers or facilitators to the implementation and use of FluCARE from the ACF user perspective. The FluCARE app was piloted from September 2019 to December 2020 in SLHD. Associated implementation included promotion and engagement, user training, and operational policies. Participating ACF staff were invited to complete a post-training survey. Staff were also invited to complete a post pilot evaluation survey which included a user Mobile Application Rating Scale (uMARS) measuring app acceptance, utility, and barriers and facilitators to use. An issues log was also prospectively maintained to assess safety. Survey data were analysed descriptively or via content analysis where appropriate. Thirty-one users from 27 ACFs consented and completed the surveys. FluCARE was rated 3.91/5 overall on the uMARS. The study reported that 25 of the 31 users (80%) would definitely use FluCARE for future outbreaks, and all users agreed that the app was useful for identifying influenza and COVID-19 outbreaks at their facilities. There were no reported critical issues with incorrect or missed outbreak detection. User training, particularly online training modules, and technical support were identified as key facilitators to FluCARE use. FluCARE is an acceptable, useful and safe app to assist ACF staff with early detection and response to influenza and COVID-19 outbreaks. This study supports feasibility for ongoing implementation and efficacy evaluation, followed by scale-up into other health districts in New South Wales (NSW).

Experimental Evaluation of Pilot and Main Injection Strategies on Gasoline Compression Ignition Engine—Part 2: Performance and Emissions Characteristics

<div>Internal combustion (IC) engines play an important role in the global economy by powering various transport applications. However, it is a leading cause of urban air pollution; therefore, new combustion strategies are being developed to control emissions. One promising advanced low-temperature combustion (LTC) technology is gasoline compression ignition (GCI). This experimental study assesses the performance of a two-cylinder engine, emissions, and exhaust particulate characteristics using G80 (80% v/v gasoline and 20% v/v diesel) blend operating in GCI mode vis-à-vis baseline conventional diesel combustion (CDC) mode using diesel. The effects of double pilot injection, Pilot-1 proportion (10–30%), and main injection timing were investigated on the GCI combustion. Experiments were performed at different engine loads (3, 4, and 5 bar brake mean effective pressure [BMEP]) at a constant engine speed (2000 rpm). GCI combustion showed higher brake thermal efficiency (BTE) than CDC mode at medium loads. Hydrocarbon (HC) and carbon monoxide (CO) emissions increased in GCI mode, but oxides of nitrogen (NOx) were reduced than the baseline CDC mode. High pilot ratio and late main injection timing tests showed higher HC and CO emissions in the GCI mode at low engine loads. The GCI mode engine emitted higher nucleation mode particles and nanoparticles than baseline CDC mode at high engine loads. Using a triple injection strategy, GCI engines simultaneously reduced NOx and particulate matter (PM) emissions, especially at high loads. Controlling these emissions in baseline CDC mode engines is otherwise quite challenging.</div>

A Pilot Evaluation of Katatagan Online: Benefits and Challenges of an Online Resilience Program in the Philippines during the COVID-19 Pandemic*

A Pilot Evaluation of Katatagan Online: Benefits and Challenges of an Online Resilience Program in the Philippines during the COVID-19 Pandemic*

Microwave-Assisted Synthesis of 3-Hydroxy-2-oxindoles and Pilot Evaluation of Their Antiglaucomic Activity.

Glaucoma is a widespread neurodegenerative disease for which increased intraocular pressure (IOP) is a primary modifiable risk factor. Recently, we have observed that compounds with oxindole scaffolds are involved in the regulation of intraocular pressure and therefore have potential antiglaucomic activity. In this article, we present an efficient method for obtaining novel 2-oxindole derivatives via microwave-assisted (MW) decarboxylative condensation of substituted isatins with malonic and cyanoacetic acids. Various 3-hydroxy-2-oxindoles were synthesized using MW activation for 5-10 min with high yields (up to 98%). The influence of novel compounds applied in instillations on IOP was studied in vivo on normotensive rabbits. The lead compound was found to reduce the IOP by 5.6 Torr (ΔIOP for the widely used antiglaucomatousic drug timolol 3.5 Torr and for melatonin 2.7 Torr).

A system for preventing internal fistula needle dislodgement: Delphi study and pilot evaluation.

To establish a scoring system for risk assessment (SSRA) for internal fistula needle dislodgement (IND) in hemodialysis (HD) patients. The SSRA was constructed based on literature search, medical history review, expert consultations, expert meeting (Delphi study), and analytic hierarchy process. Then, a pilot test was conducted at our hospital between August 1, 2020, and July 30, 2021. Consecutive patients requiring HD were included and randomly assigned to experimental and control groups (1:1 ratio). Control group was treated with the routine procedures, while the experimental group was treated with strengthened nursing measures based on the individual risk assessed by SSRA. Finally, the incidence of IND was compared between the two groups. For the Delphi study, 16 experts in dialysis nursing in Zhejiang, Shanghai, Guangzhou, and Qinghai were included. The final draft of the SSRA included three first-level indices, 11 second-level indices, and 26 third-level indices. A total of 218 HD patients were included. The IND rate in the experimental group was significantly lower than that in the control group (p < .01). We established a scientific, reliable, and feasible SSRA for timely identification of HD patients with high risk of IND and the corresponding nursing procedures to prevent IND.

Evaluating primary care transformation: synthesis of findings from UK pilot project reviews.

Pilot 'new models' of primary care have been funded across the UK since 2015, through various national transformation funds. Reflections and syntheses of evaluation findings provide an additional layer of insight into 'what works' in transforming primary care. To identify good practice in policy design, implementation, and evaluation for primary care transformation. A thematic analysis of existing pilot evaluations in England, Wales, and Scotland. Ten studies presenting evaluations of three national pilot studies - the Vanguard programme in England, the Pacesetter programme in Wales, and the National Evaluation of New Models of Primary Care in Scotland - were thematically analysed, and findings synthesised in order to identify lessons learnt and good practice. Common themes emerged across studies in all three countries at project and policy level, which can support or inhibit new models of care. At project level, these included the following: working with all stakeholders, including communities and front-line staff; providing the time, space, and support necessary for the project to succeed; agreeing on clear objectives from the outset; and support for data collection, evaluation, and shared learning. At policy level, more fundamental challenges related to the parameters for pilot projects, in particular, the typically short-term nature of funding, with an expectation of results within 2-3 years. Changing expectations about outcome measures or project guidance part-way through project implementation was also identified as a key challenge. Primary care transformation requires coproduction and a rich, contextual understanding of local needs and complexities. However, a mismatch between policy objectives (care redesign to better meet patient needs) and policy parameters (short timeframes) is often a significant challenge to success.

Assessment of a primary care e-support package of automated case finding, simplified treatment algorithm and decision support to increase hepatitis B treatment uptake in primary care clinics in Australia (SIMPLY-B Study): protocol for a pilot evaluation

IntroductionDespite the availability of effective, subsidised hepatitis B treatment, linkage to care and treatment rates remain very low globally. In Australia, specially trained primary care physicians (general practitioner, GPs) can...

Emergency unit assessment of seven tertiary hospitals in Nepal using the WHO tool: a cross-sectional study

BackgroundIn 2021, the Nepal national emergency care system’s assessment (ECSA) identified 39 activities and 11 facility-specific goals to improve care. To support implementation of the ECSA facility-based goals, this pilot study used the World Health Organization’s (WHO) Hospital Emergency Unit Assessment Tool (HEAT) to evaluate key functions of emergency care at tertiary hospitals in Kathmandu, Nepal.MethodsThis cross-sectional study used the standardized HEAT assessment tool. Data on facility characteristics, human resources, clinical services, and signal functions were gathered via key informant interviews conducted by trained study personnel. Seven tertiary referral centers in the Kathmandu valley were selected for pilot evaluation including governmental, academic, and private hospitals. Descriptive statistics were generated, and comparative analyses were conducted.ResultsAll facilities had continuous emergency care services but differed in the extent of availability of each item surveyed. Academic institutions had the highest rating with greater availability of consulting services and capacity to perform specific signal functions including breathing interventions and sepsis care. Private institutions had the highest infrastructure availability and diagnostic testing capacity. Across all facilities, common barriers included lack of training of key emergency procedures, written protocols, point-of-care testing, and ancillary patient services.ConclusionThis pilot assessment demonstrates that the current emergency care capacity at representative tertiary referral hospitals in Kathmandu, Nepal is variable with some consistent barriers which preclude meeting the ECSA goals. The results can be used to inform emergency care development within Nepal and demonstrate that the WHO HEAT assessment is feasible and may be instructive in systematically advancing emergency care delivery at the national level if implemented more broadly.

Evaluating trauma-informed training for foster parents – A controlled pilot study of the resource parent curriculum in Sweden

Background and aimsTraumatic experiences and mental illness are frequent among children placed in out-of-home care. Foster parents report that trauma-informed psychoeducation increases their knowledge and parental efficacy, but the evidence-base of offered interventions is still scarce and weak. The present study is a pilot evaluation of a trauma-informed psychoeducation for foster parents: Resource Parent Curriculum (RPC) in Sweden.Participants and methodsThe participants were foster parents in Sweden, with at least one child (3–16 years old) placed with them. Using a quasi-experimental design, we investigated the effect of the psychoeducation on parenting efficacy, tolerance for the child's behavior and trauma-informed parenting, and on the foster parents’ perceptions of their children's behavior. Participants (N = 44) were divided into an experimental (n = 24) and a control (n = 20) group and answered questions on three occasions: before, immediately after, and two months after completed education. Mixed Model analysis was carried out on data from 21 participants who completed all measurement points. Results and conclusionThe psychoeducation had an effect, assessed immediately after training completion, on foster parents' trauma-informed parenting behaviors (p = 0.027) and parenting efficacy (p = 0.040), but these effects diminished rapidly. No effect on perceived child behavior was observed. Thus, RPC affects foster parents’ parenting attitudes positively, but may not be sufficient for this effect to be sustained over time and reliably translate into trauma-informed parental behaviors and related positive child outcomes.

Advancing trauma-informed care in intellectual and developmental disability services: A pilot study of a digital training with direct service providers.

As trauma-informed care advances in the service delivery system for people with intellectual and developmental disabilities, additional resources are needed to foster staff development. This article describes the development and pilot evaluation of a digital training on trauma-informed care among direct service providers (DSPs) in the disability service industry. Following an AB design, a mixed methods approach was used to analyse the responses of 24 DSPs to an online survey at baseline and at follow-up. The training was associated with increased staff knowledge in some domains and greater alignment with trauma-informed care. Staff expressed a strong likelihood of using trauma-informed care in practice and identified organisational assets and barriers to implementation. Digital trainings can facilitate staff development and the advancement of trauma-informed care. Although additional efforts are warranted, this study fills a gap in the literature regarding staff training and trauma-informed care.

A Pilot Evaluation of a School-Based Psychoeducational Program for Chinese and Latino/a Parents: Perceived Effectiveness and Acceptability

A Pilot Evaluation of a School-Based Psychoeducational Program for Chinese and Latino/a Parents: Perceived Effectiveness and Acceptability

Humanising care in a forensic mental health ward through creative writing workshops for staff and residents: a case study

Purpose Service users’ voice is at the forefront of movements within psychiatry that look to create more humanising care. Although genuine co-production of knowledge is limited by the power differential intrinsically functional to the health care setting, the arts have the potential to create collaborative environments and equalise relationships. The purpose of this case study is to describe and discuss the design and pilot evaluation of creative writing workshops in a forensic mental health ward as an innovative method for humanising care. Design/methodology/approach A creative writing intervention focussing on everyday experiences was implemented in a forensic mental health ward and involved four residents and four mental health professionals working together. Interviews were conducted with the four mental health professionals as part of a service evaluation. Transcripts were analysed using thematic analysis. Findings Two themes emerged from the analysis of interviews with mental health professionals: “a new way of learning about each other” and “imagining beyond the staff-resident relationship”. The authors discuss the intervention’s benefits in terms of its potential to foster mutuality and empathy beyond the illness narrative. Practical implications Creative writing can be used to engage patients and mental health professionals to jointly share everyday experiences and identities beyond illness. Originality/value The creative writing workshops present an innovative approach concerning the use of creative arts for humanising care through mutuality.

Android Based Educational Mobile Robot Design and Pilot Evaluations

Android Based Educational Mobile Robot Design and Pilot Evaluations

Development and evaluation of an online vocational program for veterans with legal convictions and psychiatric illness

PurposeWe describe the development and pilot evaluation of an online vocational rehabilitation program, the About Face Online System (AFOS), for veterans with a history of felony convictions and either mental illness and/or substance use disorders. MethodPhase One was the development and acceptability testing of the online system. Phase Two was a small, randomized trial comparing the likelihood of obtaining employment among people using the AFOS, compared to people receiving a self-directed hardcopy manual, after 6 months. ResultsIn Phase One, 17 veterans provided feedback as the system was being developed. The final system allows veterans to receive education on vocational reintegration skills, watch short videos describing the techniques, and communicate with a vocational staff member via chat features. Veterans found the AFOS to be as acceptable as a hardcopy manual that covered similar material. In Phase Two, 38 veterans with a history of felony convictions and either mental illness or substance use disorder were randomized to receive the AFOS or a hardcopy manual. After 6 months, people randomized to the AFOS were more likely to obtain employment than people randomized to the hardcopy manual. ConclusionAn online vocational program may help veterans who cannot attend traditional in-person vocational services to successfully obtain employment.