Pilot Evaluation Research Articles

Pilot evaluation of the electronic monitoring scheme in the UK

PurposeFollowing research into the application of Electronic Monitoring (EM), Criminal Justice Order (2016) no. 954 was published, which introduced EM for offenders leaving custody in England and Wales (Ministry of Justice, 2016). EM was later extended to include those subjected to release on temporary licence (ROTL). The purpose of this study is to be the first, to the best of the authors’ knowledge, to evaluate a pilot project using EM during the ROTL process. The outcome allowed for recommendations to be made regarding the continued use of EM within the open prison estate.Design/methodology/approachThis is a qualitative research project involving semi-structured interviews with staff and residents. Transcripts were analysed using thematic analysis which resulted in exploration of 4 themes and 11 sub-themes and recommendations for future research/practice.FindingsResults demonstrated that both staff and residents evaluated the use of EM as helpful with regard to evidencing compliance with ROTL conditions. In addition, staff also found it helpful for providing additional reassurance to victims and providing evidence for ROTL breaches.Practical implicationsTo the best of the authors’ knowledge, this was the first qualitative evaluation of EM relating to the ROTL process. The evaluation improves understanding of the value of EM for policymakers and the Ministry of Justice, especially in terms of the ROTL process. The recommendations made in this paper evidence the value of EM use in the future.Originality/valueThis evaluation supports continued use of EM and its integration into policy and procedures for residents subject to temporary licence. This paper concluded that consistent and reliable use of EM may contribute to victim reassurance and reduce recidivism of residents during ROTL, subsequently increasing the public’s perception of safety.

Aircraft pilot healthcare avoidance due to fear for aeromedical certificate loss and implications for neurology care of the pilot patient (P4-7.004)

<h3>Objective:</h3> The learner will describe: - Healthcare avoidance and three factors that influence pilot healthcare seeking behavior and disclosure - Implications of pilot healthcare avoidance in the care of the pilot patient with a neurological complaint - Methods to mitigate the impact of pilot healthcare avoidance <h3>Background:</h3> Aircraft pilots are required to meet certain medical standards in order to maintain an active flying status. If a pilot discloses a new symptom or condition during routine aeromedical screening, they run the risk of temporality or permanently losing their ability to fly. This can result in occupational, social and professional repercussions to the pilot. For this reason, it has been proposed that pilots face a barrier to seeking medical care that results in delayed presentation to care and healthcare avoidance. Select interventions for neurological diseases are limited by the duration of symptoms and a delay in care can result in poor health outcomes. <h3>Design/Methods:</h3> A cross sectional survey of 3,650 pilots in the United States showed that 56.1% of pilots reported a history of healthcare avoidance due to fear for aeromedical certificate loss. A subanalysis of military pilots, showed that 72% of US active duty military pilots had a history of healthcare avoidance due to fear for loss of flying status. <h3>Results:</h3> Pilots may delay presentation to care and/or participate in healthcare avoidance due to fear for aeromedical certificate loss. Select neurological interventions are limited by duration of symptoms (i.e. thrombolysis, etc). It is imperative for neurologists to be aware this phenomena. To achieve the same outcome, evaluation and intervention may be required more rapidly compared to non-pilot patients. This presentation will review select mitigation strategies to address pilot healthcare avoidance. <h3>Conclusions:</h3> A proportion of pilots participate in healthcare avoidance. Evaluation and intervention of pilots with a neurological complaints may be required more rapidly compared to non-pilot patients. <b>Disclosure:</b> The institution of Dr. Hoffman has received research support from United States Air Force.

Pilot Implementation and Evaluation of an Outpatient Teleneurology Curriculum for Medical Students (S10.007)

<h3>Objective:</h3> To assess the feasibility and outcomes for a novel teleneurology educational curriculum <h3>Background:</h3> Stemming from the COVID-19 pandemic, medical students rotating on neurology electives were asked to participate in telehealth encounters with limited formal teaching and evaluation on the principles and practice of teleneurology. <h3>Design/Methods:</h3> We developed a 2-week outpatient teleneurology curriculum consisting of virtual asynchronous video modules and virtual synchronous patient interactions designed to address AAMC telehealth competencies. It was delivered as a supplement to an established outpatient neurology elective for 4^th year medical students from July 2021-September 2022 at a US medical school. Participation was optional. Assessments included pre and post student self-rated confidence in 6 telehealth competencies on a 4-point scale. Students participated in a summative virtual visit with a neurological patient under direct observation of an attending neurologist well-versed in telehealth. Both the observing neurologist and patient evaluated the student in the telehealth competencies. <h3>Results:</h3> Twenty-six 4^th year medical students participated in the pilot. Each student spent 1 hour viewing asynchronous video modules, and had 454 ± 200.5 (mean+/−SD) minutes of virtual patient contact over 15 ± 8.2 virtual visits. After completing the curriculum, students were 92–100% moderately or very confident regarding their capabilities across telehealth competencies, representing an improvement from 12–96% compared to pre-curriculum (average increase 0.56–1.84 on the 4–point scale; p&lt;0.005 for all competencies). Examination and regulatory competencies demonstrated the greatest improvement. Competencies were rated as effective or very effective for 88–100% of students by patients and 92–100% of students by faculty during the summative visit. <h3>Conclusions:</h3> This pilot teleneurology curriculum demonstrated that students not only increased in self-rated confidence in performing telehealth competencies, but also demonstrated meeting these competencies in the opinion of both physician and patient observers. Further research into effective methods for integrating telehealth competencies into the neurology and broader medical school curriculum is warranted. <b>Disclosure:</b> Dr. Ko has received personal compensation in the range of $500-$4,999 for serving as an Editor, Associate Editor, or Editorial Advisory Board Member for AAN. The institution of Dr. Ko has received research support from HRSA. Dr. Ko has received research support from IU Health. Dr. Moss has received personal compensation in the range of $10,000-$49,999 for serving as a Consultant for Twenty Twenty Therapeutics. Dr. Moss has received personal compensation in the range of $100,000-$499,999 for serving as a Consultant for Verana Health. Dr. Moss has received personal compensation in the range of $500-$4,999 for serving as an Editor, Associate Editor, or Editorial Advisory Board Member for Medlink Inc. Dr. Moss has received personal compensation in the range of $10,000-$49,999 for serving as an Expert Witness for Legal Firms. The institution of Dr. Moss has received research support from NIH. The institution of Dr. Moss has received research support from Department of Defense. The institution of Dr. Moss has received research support from Research to Prevent Blindness. Dr. Moss has received personal compensation in the range of $0-$499 for serving as a grant review panel with NASA. Dr. Moss has received personal compensation in the range of $0-$499 for serving as a grant review panel with National Institutes of Health. Dr. Moss has a non-compensated relationship as a Board of Directors with North American Neuro-ophthalmology Society that is relevant to AAN interests or activities. Dr. Mackay has received personal compensation in the range of $10,000-$49,999 for serving as an Expert Witness for various law firms. Dr. Ko has nothing to disclose. Dr. Chartier has received personal compensation in the range of $50,000-$99,999 for serving as a Instructional Design Consultant, IU School of Medicine PRIME Grant with Health Resources &amp; Services Administration. Dr. Reese has nothing to disclose. Dr. Wallach has nothing to disclose. The institution of Dr. Allen has received research support from AMA Accelerating Change in Medical Educaiton Program. The institution of Dr. Allen has received research support from HRSA Medical Education Program Grant.

Unpacking the Cinderella black box of complex intervention development through the Partners at Care Transitions (PACT) programme of research.

Complex intervention development has been described as the 'Cinderella' black box in health services research. Greater transparency in the intervention development process is urgently needed to help reduce research waste. We applied a new consensus-based framework for complex intervention development to our programme of research, in which we developed an intervention to improve the safety and experience of care transitions for older people. Through this process, we aimed to reflect on the framework's utility for intervention development and identify any important gaps within it to support its continued development. The framework was a useful tool for transparent reporting of the process of complex intervention development. We identified potential 'action' gaps in the framework including 'consolidation of evidence' and 'development of principles' that could bracket and steer decision-making in the process. We consider that the level of transparency demonstrated in this report, aided through use of the framework, is essential in the quest for reducing research waste. We have involved our dedicated patient and public involvement group in all work packages of this programme of research. Specifically, they attended and contributed to co-design workshops and contributed to finalizing the intervention for the pilot evaluation. Staff also participated by attending co-design workshops, helping us to prioritize content ideas for the intervention and supporting the development of intervention components outside of the workshops.

Building capacity of health promoters on cancer primary and secondary prevention: a pilot evaluation of the Cancer Prevention Europe multilingual online program

Building capacity of health promoters on cancer primary and secondary prevention: a pilot evaluation of the Cancer Prevention Europe multilingual online program

Elementium: design and pilot evaluation of a serious game for familiarizing players with basic chemistry

Serious games (SGs) about Chemistry have the potential to cope with challenges, such as students’ low performance and lack of motivation for the subject. However, the majority of existing SGs for Chemistry have the form of educational applications infused with some elements of entertaining games. The aim of the study presented was to design and evaluate a new SG with rich game mechanics for Chemistry. The game is called Elementium and revolves around basic topics of Chemistry, such as chemical elements and compound terminology, creation and everyday usage of such elements. The main goal of the game is to familiarize junior high school students with the aforementioned subjects. The design of Elementium was carried out implementing the dimensions described in the Four-Dimensional framework, as proposed by de Freitas and Jarvis in 2006. After the development process, Elementium was evaluated by people in the field of education that are currently teaching or have taught Chemistry in the past. The participants play-tested the game at leisure in their homes and evaluated it based on the key criteria for SGs design proposed by Sanchez in 2011, as well as other quality indicators established in the literature. Elementium was positively evaluated by Chemistry teachers in terms of its acceptance, usability, didactic utility, and game environment. The positive results concluded from this evaluation show that Elementium is fulfilling its main purpose and can be used as a supplementary tool in the teaching process. However, its true didactical effectiveness has to be confirmed through a study with high school students.

SNapp, a Tailored Smartphone App Intervention to Promote Walking in Adults of Low Socioeconomic Position: Development and Qualitative Pilot Study.

Adults of low socioeconomic position (SEP) are generally less physically active than those who are more socioeconomically advantaged, which increases their cardiovascular disease incidence risk. Moreover, individuals of low SEP are often less easily reached with physical activity (PA) interventions than individuals of higher SEP. Smartphone apps have been presented as a promising platform for delivering PA interventions to difficult-to-reach individuals of low SEP. Although PA apps are widely available, they are rarely based on health behavior theories and most predominantly offer generic PA advice. Consequently, it is unlikely that available apps are the most effective PA intervention tools. To respond to these areas for improvement, we developed SNapp, an app-based intervention encouraging adults of low SEP to increase PA by providing tailored coaching messages targeting walking behavior. This study aimed to describe SNapp's stepwise development and pilot evaluation process. We applied a stepwise approach: analyzing the health problem, developing a program framework, developing tailoring assessments, writing tailored messages, automating the tailoring process, and implementing and evaluating the program in a qualitative pilot study (11 participants). SNapp consisted of several elements. First, an app was developed to collect step count and geolocation data using smartphone sensor functionalities. In addition, a survey measure was created to assess users' behavior change technique (BCT) preferences. These 3 data types were used to tailor SNapp's coaching messages to stimulate walking. This allows SNapp to offer feedback on performance levels, contextually tailored prompts when users are near green spaces, and coaching content that aligns with individual BCT preferences. Finally, a server-based Python program that interacts with databases containing user data and tailored messages was built using Microsoft Azure to select and automatically send messages to users through Telegram messenger. Pilot study findings indicated that SNapp was rated positively, with participants reporting that its design, technical functioning, and message content were acceptable. Participants suggested additional functionalities that are worth considering for future updates. SNapp is an app-based intervention that aims to promote walking in adults of low SEP by offering tailored coaching messages. Its development is theory based, and it is among the first to incorporate contextualized feedback and content tailored to individual BCT preferences. The effectiveness of SNapp will be evaluated in a 12-month real-life parallel cluster-randomized controlled trial.

A pilot evaluation of the role of a children's wellbeing practitioner (CWP) in a child and adolescent mental health service (CAMHS).

In 2017, the Children and Young People's Improving Access to Psychological Therapies (CYP-IAPT) project was extended to deliver low-intensity Cognitive Behavioural Therapy (CBT), delivered by Children's Wellbeing Practitioners (CWPs), but to date evaluation is sparse. To evaluate low-intensity interventions delivered by trainee CWPs for the treatment of anxiety and depression in a child and adolescent mental health service (CAMHS). The evaluation adopted a quantitative, within-subjects, cross-sectional design. The outcome measures of 98 service users aged 8-17years were included in the evaluation. Service users were children and young people accessing CAMHS in the North East of England. Outcome measures included the Revised Children's Anxiety and Depression Scale (RCADS-47) and Goal Based Outcomes (GBOs). Descriptive data relating to the types of interventions used and outcomes following CWP involvement were also explored. Analysis of pre and post intervention data highlighted significant reduction in symptomatology across all RCADS subscales and composite total scales, and significant goal progress as measures by GBO's. Effect sizes ranged from moderate to large (d = 0.75 - 0.90) across all subscales of the RCADS. Large effect sizes were found for depression, total anxiety and total RCADS scores (d = 0.86, d = 1.12, d = 1.14), and GBOs (d = -1.33). Findings support the potential value of low intensity CBT interventions delivered by CWPs in reducing anxiety and depression in this population. Recommendations for the development of the CWP role and CWP services are discussed.

Mixed-methods evaluation of point-of-care hepatitis C virus RNA testing in a Scottish prison

ObjectivesHepatitis C virus (HCV) poses a global public health threat. Prisons are a focus of prevention efforts due to high infection burdens. Expedition of treatment for incarcerated people is critical,...

Can Attitudes Serve as Proxies for Behavioral Outcomes of Dating Violence Prevention Programs? Broader Lessons From a Pilot Evaluation of the Relationship Education Project

Teen dating violence (TDV) is a prevalent problem in the United States. Although research indicates that prevention programs have favorable effects on TDV knowledge/attitudes, there is limited evidence of meaningful effects on behavior. This is important, as researchers often measure the former as a proxy for the latter. The present study uses pre-posttest data from students participating in the Relationship Education Project, a TDV prevention program implemented in 19 middle and high schools in South Carolina, to examine associations between changes in TDV attitudes and TDV behavior. Findings indicate favorable changes in attitudes toward controlling and supportive dating behaviors were associated with lower incidents of some TDV behaviors. Implications for measuring TDV program effects and preventing TDV by fostering attitude change are discussed.

Pilot Evaluation of Generation Rx Ambassadors Virtual Training to Prepare Students for Medication Safety Outreach

Objective. To describe the creation of a virtual training program (Generation Rx Ambassadors) and evaluate a pilot offering's impact on knowledge and perceived abilities in delivering medication safety outreach through the Generation Rx program.Methods. Generation Rx (GenRx) is a prevention education program used by student pharmacists to teach safe medication practices in the community. An asynchronous virtual course, called Generation Rx Ambassadors (Ambassadors), was developed to train facilitators on best practices for GenRx delivery. The training was piloted in a mixed student cohort and evaluated using a preprogram/postprogram survey assessing participants' objective knowledge gains and self-perceived abilities to appropriately deliver GenRx education.Results. Fifty-two health sciences undergraduate and graduate students as well as Doctor of Pharmacy (PharmD) students completed the pilot offering of Ambassadors. Regardless of degree status or discipline, participants demonstrated significant knowledge gains for all outcomes except defining medication misuse behaviors (for which there was initial strong mastery). Prior to Ambassadors training, many participants indicated a perceived ability to effectively deliver GenRx education; however, corresponding objective knowledge assessment did not support this belief. Training through the Ambassadors program appropriately aligned participants' perceived abilities with actual content knowledge for most program learning outcomes.Conclusion. These pilot findings suggest that Ambassadors is an effective training tool on best practices for GenRx delivery. More generally, this work reiterates a need to formally train student pharmacists ahead of community outreach activities, particularly in the prevention education arena. Future evaluation will focus on replicating this study with an expanded cohort size and assessing participants' ability to deliver GenRx education in community-based settings.

The impact of clinical training changes on self-rated competency and confidence in neuropsychology: A survey of UEA-trained clinical psychologists in East Anglia

A Competency Framework, produced by the British Psychological Society Division of Neuropsychology, specifies the underpinning neuropsychological knowledge and skills required for different levels of practice. In 2016, the Doctoral Programme in Clinical Psychology at the University of East Anglia (UEA) introduced changes to align its neuropsychology teaching to the Competency Framework. This report illustrates a pilot evaluation of the impact of such changes on the self-rated neuropsychological competency and confidence of UEA-trained clinical psychologists in East Anglia using a bespoke online survey. Based on 76 respondents, the results highlighted, promising effects of the changes, with post–2016 participants showing higher levels of self-rated competency and confidence in neuropsychology than pre-2016 participants. However, the discrepancy in sample size between pre- and post–2016 groups and a number of other caveats and limitations should be considered. Additional iterations of the survey, involving future cohorts following qualification, are needed to confirm these preliminary findings.

Novel intervention to promote COVID-19 protective behaviours among Black and South Asian communities in the UK: protocol for a mixed-methods pilot evaluation

IntroductionCulturally appropriate interventions to promote COVID-19 health protective measures among Black and South Asian communities in the UK are needed. We aim to carry out a preliminary evaluation of an...

Alumni evaluation on university of Santo Tomas College of Rehabilitation Sciences physical therapy curriculum and program intended learning outcomes: a pilot descriptive quantitative study

Introduction: The purpose of this study was to determine the priority index of each PILO and to describe the perspective of the UST-CRS PT Alumni towards the new curriculum. Methods: This descriptive quantitative, cross sectional study involved obtaining the perspective of the UST-CRS PT Alumni regarding the UST-CRS PILOs and curriculum through a selfmade questionnaire that underwent content validity. Qualitative questions were also included. Descriptive statistics were used to rank the PILOs, while content analysis was used to interpret the quantitative data. Results: 18 UST-CRS PT Alumni with a mean age of 26.36 ± 16.17, responded to this pilot evaluation. Demonstrating social and professional responsibility and ethical behaviors (PILO 11) was ranked as the highest in terms of necessary skill level and importance to PT practice [SL = 4.89; Imp = 4.94] while Community-based activities as Thomasian agents of social transformation (PILO 13) was ranked as lowest in both aspects [SL = 3.78; Imp = 4.33]. Based on the priority index, PILO 11 was deemed as the highest in priority by the UST-CRS PT alumni (PI = 4.92) while PILO 13 was ranked as lowest in priority (PI = 4.06). Discussion: Based on the evaluation of UST-CRS PT alumni, the new UST-CRS BSPT curriculum and PILOs satisfy the necessary components and competencies expected of an effective undergraduate program. Nevertheless, there is still room for improvement to ensure continuous translation of knowledge into practice. Increased time frame for comprehension, enhanced interprofessional collaboration, and inclusion of soft skills were some of the suggested improvements by the alumni.

A pilot evaluation of social needs among gynecologic oncology patients in inpatient versus outpatient settings

The WHO defines social determinants of health (SDoH) as the conditions in which we are born, grow, work, and live as well as other large systems that positively or negatively affect our health. Many healthcare systems currently lack the resources and strategies required to accurately assess and address SDoH. Action must be taken because studies have found that chronic diseases, including cancer, are affected by SDoH. The aim of this study is to identify the incidence of social needs in an inpatient gynecologic oncology population and its relation to patient demographics and clinical diagnostic data to guide and inform future intervention. Patients agreeing to participate in the study completed a needs assessment survey during their inpatient stay at the hospital between November 2020 to March 2021. The survey contained seven questions, six of which were questions screening for social needs including food and housing security, transportation means, financial stability, health literacy, and social support. Responses were considered positive if any degree of need was reported. Demographic and cancer diagnosis data were then collected and included zip code, race, cancer stage and age at diagnosis, treatment history, and number of hospital admissions and length of stay over the past 12 months. The most substantial reported needs across all gynecologic malignancies were social support (65%), health literacy (37%), and financial need (22%). Less need was reported in the categories of food (11%), housing (7%), and transportation (4%). SDoH have been studied in the outpatient gynecologic population and the needs seen in this study are similar to the needs of that population. However, there are likely different challenges and frequencies of unmet need in the different types of gynecologic cancers that may affect the stage at which their cancer is diagnosed as well as the number of hospital admissions related to their cancer care.

The transformative effect of prison-based theological education as perceived by current and former students: a pilot evaluation

This pilot evaluation explored the strengths and weaknesses of a prison-based theological education program and identified elements of the program valued by participants, based on the theory that providing inmates with education while incarcerated facilitates change and transforms lives. Participants included currently and formerly incarcerated studies who completed quantitative and qualitative surveys (N = 50) and who were interviewed in focus groups (N = 15). Researchers used a thematic analysis approach to interpret the data to reveal three major themes: (1) prosocial associates; (2) prosocial cognitions; and (3) prosocial activities. Exploring both the quantitative and qualitative experiences of participants is especially important for understanding the lived experiences of individuals participating in faith-based programs Initial findings indicate that The Urban Ministry Institute (TUMI) faith based educational program was positively associated with participants’ prosocial thinking and behavior.

Tailoring the Implementation Strategy of Strength at Home: An Initial Examination of Clinician and Hospital Outcomes

ABSTRACT The Department of Veterans Affairs (VA) recently implemented the Strength at Home (SAH) program to prevent and end use of IPV in Veterans. SAH is an evidence-based, trauma-informed, cognitive-behavioral intervention for Veterans who use, or are at risk for using, IPV. A previous pilot evaluation of implementation outcomes at 10 VA hospitals indicated slow hospital and clinician adoption rates. The implementation strategy was then revised to address several barriers to timely implementation including securing institutional support, pre-training preparation, and relationship building. The present study used program evaluation metrics from 27 VA hospitals to examine whether the change in implementation strategy improved adoption of the SAH intervention. Results indicated significantly improved hospital and clinician adoption rates and hospital-time-to adoption, but not clinician time-to-adoption.

Targeted Intervention for Elementary Students With Internalizing Behaviors: A Pilot Evaluation

The Calm Cat Program was developed in response to the need for intervention approaches that target internalizing symptoms, are developmentally appropriate for early elementary students, and are feasible for school-based implementation by staff without specialized training. The Calm Cat Program is a brief Tier 2 intervention combining behavioral skills training and mentor-based coaching. In this initial study, the Calm Cat Program was evaluated in a cluster-randomized controlled trial of 72 student participants in nine elementary schools. Over a 5-week period, school counselors implemented small-group skills training sessions, and classroom teachers provided daily coaching on targeted relaxation skills. Overall, program participation was associated with small- to medium-sized gains in relaxation skill knowledge and reductions in self-reported anxiety symptoms. In addition, both staff implementers and student participants reported generally positive perceptions of the program’s usability. Additional research is needed to ensure the program’s efficiency and effectiveness as an early intervention approach within multitiered frameworks. Impact Statement School-based interventions are needed to support young students at risk for developing emotional disorders. The Calm Cat Program is an intervention that combines behavioral skills training and mentor-based coaching. In this pilot study, the Calm Cat Program demonstrated small- to medium-sized effects in increasing students’ knowledge of relaxation skills and decreasing their self-reported anxiety symptoms.

Detection of visuomotor dysfunction in mild traumatic brain injury using binocular retinal polarization scanning

ABSTRACT Objective The head and intraocular trauma tool (HITT) is a portable, binocular retinal polarization scanner (RPS) that detects ocular fixation with high precision to assess visuomotor function. We conducted a pilot evaluation of a prototype binocular RPS device to evaluate alterations in fixation stability, binocularity (convergence), and saccadic latency after mild traumatic brain injury (mTBI). Methods Two groups were studied prospectively: (1) single observation study of mTBI patients in a hospital ER (n = 7) and age-matched controls (n = 43); (2) high-school athletes preseason (n = 28), after sports-related mTBI (n = 3), and at season end (n = 5). Subjects were asked to fixate on an internal target and track randomly presented peripheral and central targets as fixation was assessed using binocular RPS. Results There were clinically and statistically significant alterations in the hospital ER group after mTBI, including a decrease in fixation stability (54.6% in patents vs 90.2% in controls, p = 0.014) and binocularity (28.7% in patients vs 86.6% in controls; p = 0.004). Similar trends, not statistically significant, were observed in saccadic latency in the hospital ER group as well as in the injured high school athletes. Conclusion The HITT device shows promise as an objective, noninvasive method for assessment of the impact of mTBI on visuomotor function. Additional studies with larger patient populations are required to evaluate efficacy for clinical use.

A Web-Based Gender-Sensitive Educational Simulation on Vocational Rehabilitation for Service Providers Working With Youth With Disabilities: Pilot Evaluation.

Although there is a need for gender-specific health care, especially within the context of vocational rehabilitation for youth with disabilities, clinicians, trainees, and community service providers commonly report lacking training in gender-sensitive approaches. Therefore, an educational tool designed for clinicians working with youth, that addresses how to approach such issues, could help clinicians to augment the care they provide. The objective of our study was to conduct a pilot evaluation of an educational simulation for health care and service providers focusing on gender-sensitive approaches within the context of supporting youth with disabilities in vocational rehabilitation. We conducted a survey from May to September 2021 to assess the relevance of the simulation content, preliminary perceived impact on gender-sensitive knowledge and confidence, and open-ended feedback of a web-based gender-sensitive educational simulation. A total of 12 health care providers from a variety of professions who had experience working with youth in the context of vocational rehabilitation participated in the survey (11 women and 1 man). Most participants reported that the content of the simulation was relevant and comprehensive. The majority of participants reported that the simulation helped to increase their perceived knowledge or understanding of the topic, changed their perceived understanding of their intervention or approach, and informed their perceived confidence. Our qualitative findings from the open-ended questions highlighted three main themes: (1) relevance of the simulation content, (2) perceived impact for clinical practice (ie, gender-sensitive language and communication and building rapport with patients), and (3) perceived impact on organizational processes (ie, practices, policy, and privacy). Our educational simulation shows preliminary potential as an educational tool for service providers working with youth who have a disability within the context of vocational rehabilitation. Further research is needed to assess the impact of the tool with larger samples.