Program Evaluation Research Articles

A Fuzzy Neural Network Approach for Evaluation of Wetland Restoration Programmes

A Fuzzy Neural Network Approach for Evaluation of Wetland Restoration Programmes

Progress Toward Tuberculosis Elimination and Tuberculosis Program Performance - National Tuberculosis Indicators Project, 2016-2022.

Elimination of tuberculosis (TB) is defined as reducing TB disease incidence in the United States to less than 1 case per million persons per year. In 2022, TB incidence in the United States was 2.5 TB cases per 100,000 persons. CDC's TB program developed a set of national TB indicators to evaluate progress toward TB elimination through monitoring performance of state and city TB program activities. Examining TB indicator data enables state- and city-level TB programs to identify areas for program evaluation and improvement activities. These data also help CDC identify states and cities that might benefit from technical assistance. The 5-year period for which the most recent data were available for each of five indicators: 1) overall TB incidence (2018-2022), 2) TB incidence among non-U.S.-born persons (2018-2022), 3) percentage of persons with drug susceptibility results reported (2018-2022), 4) percentage of contacts to sputum acid-fast bacillus (AFB) smear-positive TB patients with newly diagnosed latent TB infection (LTBI) who completed treatment (2017-2021), and 5) percentage of patients with completion of TB therapy within 12 months (2016-2020). The National TB Indicators Project (NTIP) is a web-based performance monitoring tool that uses national TB surveillance data reported through the National TB Surveillance System and the Aggregate Reports for TB Program Evaluation. NTIP was developed to facilitate the use of existing data to help TB program staff members prioritize activities, monitor progress, and focus program improvement efforts. The following five indicators were selected for this report because of their importance in Federal TB funding allocation and in accelerating the decline in TB cases: 1) overall TB incidence in the United States, 2) TB incidence among non-U.S.-born persons, 3) percentage of persons with drug susceptibility results reported, 4) percentage of contacts to sputum AFB smear-positive TB cases who completed treatment for LTBI, and 5) percentage of patients with completion of TB therapy within 12 months. For this report, 52 TB programs (50 states, the District of Columbia, and New York City) were categorized into terciles based on the 5-year average number of TB cases reported to National TB Surveillance System. This grouping allows comparison of TB programs that have similar numbers of TB cases and allocates a similar number of TB programs to each category. The following formula was used to calculate the relative change by TB program for each indicator: [(% from year 5 - % from year 1 ÷ % from year 1) × 100]. During the 5-year period for which the most recent data were available, most TB programs had improvements in reducing overall TB incidence (71.2%) and increasing the percentage of contacts receiving a diagnosis of LTBI who completed LTBI treatment (55.8%); the majority of programs (51.0%) also had improvements in reducing incidence among non-U.S.-born persons. The average percentage of persons with drug susceptibility results reported in most jurisdictions (28 of 52, [53.9%]) met or exceeded the 5-year national average of 97% (2018-2022). The percentage of contacts to sputum acid-fast bacillus (AFB) smear-positive TB patients with newly diagnosed latent TB infection (LTBI) who completed treatment increased in 29 of 52 (55.8%) jurisdictions from 2017 to 2021, signifying that, for most jurisdictions, steps have been taken to enhance performance in this area. The average percentage of patients with completion of TB therapy within 12 months was at or above the national average of 89.7% in approximately two-thirds (32 of 52 [61.5%]) of jurisdictions. This report is the first to describe a 5-year relative change for TB program performance. These results suggest that TB programs are making improvements in activities that help identify persons with TB and LTBI and ensure patients complete treatment in a timely manner. Use of NTIP data from individual TB programs enables a more detailed examination of trends in program performance and identification of areas for program improvement. Assessing indicator trends by TB program provides an opportunity to gain a better understanding of program performance in comparison to other programs. It can also facilitate communication between programs regarding successes and challenges in program improvement. This information is valuable for TB programs to allocate resources effectively and provide additional context on TB control for public health policymakers.

Variability in public health programming and priorities to address health inequities across public health units in Ontario, Canada.

In 2018, Ontario Public Health Standards were updated to include the foundational Health Equity Standard to guide planning, implementation, and evaluation of public health programs and services. Public health units (PHUs), the regional public health bodies, are now required to address health equity through four requirements: (a) Assessing and Reporting; (b) Modifying and Orienting Public Health Interventions; (c) Engaging in Multi-sectoral Collaboration; and (d) Health Equity Analysis, Policy Development, and Advancing Healthy Public Policies. This qualitative descriptive study explored how the 27 participating PHUs (out of 34) serving urban (N = 10), mixed urban-rural (N = 15), and rural (N = 9) populations addressed the Health Equity Standard. Using document analysis, we inductively and deductively coded the content of 68 PHU Annual Service Plan and Budget Submissions from a 3-year period (2018-2020) received from the 27 PHUs. Emergent categories were organized into the four requirements and one additional emergent theme: Organizational Implementation of Health Equity. The approaches of embedding health equity into PHUs' activities varied across groups. Urban PHUs presented more diverse strategies, including working with a larger number of organizations, and participating in academic research projects. We found more process standardization and greater discussion of capacity building in urban and mixed urban-rural PHUs. Rural PHUs strategically addressed the needs of their diverse populations through relationship building with Indigenous communities. Findings suggest broad implementation of health equity approaches in public health independent of PHUs' geographic size and population dispersion, though strategies and key challenges differ across units.

Evaluation of the Expert Patient PANLAR self-management program in rheumatoid arthritis. A pilot study in Argentina, Colombia and Panamá

Education is a cornerstone of the comprehensive management of patients living with rheumatic and musculoskeletal diseases (RMSDs). It allows them to optimize their self-care for health maintenance. The objective of this study was to assess the effectiveness of the PANLAR Patient Expert (PE) program in optimizing self-care skills for physical activity, healthy eating, communication with professionals, therapeutic adherence and decision making.

Introducing double fortified salt in social safety net programmes in Madhya Pradesh and Gujarat in India: Success factors, challengesand lessons learned.

Double fortified salt (DFS; with iron and iodine) was introduced in social safety net programmes (SSNPs) in Madhya Pradesh (MP) and Gujarat states in 2018. Nutrition International (NI) provided critical support for the intervention. An impact evaluation in MP found high DFS uptake, exceeding 90%. Conduct a process evaluation of the DFS programmes in MP and Gujarat states to identify success factors, challenges, and recommend considerations for scale-up. Twenty-eight qualitative interviews were conducted with NI staff, national and state level government officials, and DFS producers in 2022. Enablingenvironmental factors included national-level support for food fortification, consensus that anaemia was essential to address, and institutional trust in NI for technical assistance. In programme implementation, the primary challenges were reports of black specks in DFS and the darkening of food cooked with DFS. NI supported the government in improving handling practices, ensuring a regular and stable supply, introducing quality monitoring effortsand launching targeted behaviour change communication (BCC) campaigns regarding the value of DFS. Long-term implementation of the programmes is a weak point, as DFS production is more expensive than iodised salt, there is no existing market outside of institutional demand, and BCC must be long-term, high-quality, and requires resourcing for continued high uptake among SSNP beneficiaries. Strong government buy-in and technical support along the supply chain to address quality issues and beneficiary acceptance were key factors for the successful introduction of DFS. Comparative studies of DFS programmes should be conducted to improve confidence in the success factors that lead to high DFS uptake.

Process evaluation of a data-driven quality improvement program within a cluster randomised controlled trial to improve coronary heart disease management in Australian primary care.

This study evaluates primary care practices' engagement with various features of a quality improvement (QI) intervention for patients with coronary heart disease (CHD) in four Australian states. Twenty-seven practices participated in the QI intervention from November 2019 -November 2020. A combination of surveys, semi-structured interviews and other materials within the QUality improvement in primary care to prevent hospitalisations and improve Effectiveness and efficiency of care for people Living with heart disease (QUEL) study were used in the process evaluation. Data were summarised using descriptive statistical and thematic analyses for 26 practices. Sixty-four practice team members and Primary Health Networks staff provided feedback, and nine of the 63 participants participated in the interviews. Seventy-eight percent (40/54) were either general practitioners or practice managers. Although 69% of the practices self-reported improvement in their management of heart disease, engagement with the intervention varied. Forty-two percent (11/26) of the practices attended five or more learning workshops, 69% (18/26) used Plan-Do-Study-Act cycles, and the median (Interquartile intervals) visits per practice to the online SharePoint site were 170 (146-252) visits. Qualitative data identified learning workshops and monthly feedback reports as the key features of the intervention. Practice engagement in a multi-featured data-driven QI intervention was common, with learning workshops and monthly feedback reports identified as the most useful features. A better understanding of these features will help influence future implementation of similar interventions. Australian New Zealand Clinical Trials Registry (ANZCTR) number ACTRN12619001790134.

Implementasi Evaluasi Program Pendidikan yang Holistik dan Berkelanjutan untuk Memastikan Kualitas Pendidikan yang Optimal

This study aims to identify weaknesses in the education program that has been carried out, formulate concrete improvement recommendations, and implement these corrective measures to improve the quality of education produced. The research method in the preparation of this article is to use data obtained by researchers through journal references, e-books, and other information media that support the title that the researcher raises or that is relevant to the problem raised by the researcher. The results show that conducting a thorough evaluation will help educational institutions to identify the strengths and weaknesses of existing educational programs, so that continuous improvement and improvement can be made. The results of this study also highlight that holistic evaluation of educational programs involves various important aspects such as curriculum, teaching methods, teaching staff, learning, facilities, and student support.

Awareness and implementation confidence of free higher education program under UNIFAST among HEIs in Sulu, Philippines

Accessible higher education is a critical determinant of a nation's competitiveness in the global knowledge economy. By investing in human capital through free tertiary education, countries can cultivate a skilled workforce capable of driving innovation, attracting foreign investment, and remain to be competitive on the international stage. This quantitative study analyzed the perceptions of students (n=200) about the implementation of Unified Financial Assistance System for Tertiary Education (UNIFAST) in Sulu, Philippines. The students were purposively sampled from four (4) universities in the province. A standardized Likert-scale was used to elicit the perceptions of students based on three (3) implementation metric (i) institutions’ awareness of UNIFAST, (ii) application and disbursement process, and (iii) evaluation of UNIFAST outcomes. Findings indicated that the higher education institutions (HEIs) in Sulu often implemented the provisions of the law. Additionally, inferential analysis revealed that student’s demographic profile (i.e., gender, parental education attainment, family income) could influence their general evaluation of UNIFAST implementation. Notably, this could be attributed to their perception of the program as a substantial source of assistance in pursuing higher education. Likewise, the assessment of UNIFAST implementation by students may be influenced by emotional elements, such as feelings of relief and contentment. The program may receive higher ratings from students because of the emotional relief it offers, especially for individuals who are experiencing financial limitations. Future studies might consider developing a more rigorous analysis relating human emotions scaling up their overall evaluation of the UNIFAST program.

Evaluation of renewable energy subsidy programs in Croatia during a 5-year period based on a LCoH analysis

Evaluation of renewable energy subsidy programs in Croatia during a 5-year period based on a LCoH analysis

Performance of Pit Latrines and Their Herd Protection Against Diarrhea: A Longitudinal Cohort Study in Rural Ethiopia.

In sanitation policies, "improved sanitation" is often broadly described as a goal with little rationale for the minimum standard required. We conducted a secondary analysis of data collected as part of a cluster randomized controlled trial in rural Ethiopia. We compared the performance of well-constructed and poorly constructed pit latrines in reducing child diarrhea. In addition, we explored whether having a well-constructed household latrine provides indirect protection to neighbors if cluster-level coverage reaches a certain threshold. We followed up children aged younger than 5 years (U5C) of 906 households in rural areas of the Gurage zone, Ethiopia, for 10 months after community-led total sanitation interventions. A study-improved latrine was defined as having all the following: pit of ≥2 m depth, slab of any material, drop-hole cover, wall, roof, door, and handwashing facilities (water and soap observed). U5C in households with a study-improved latrine had 54% lower odds of contracting diarrhea than those living in households with a latrine missing 1 or more of the characteristics (adjusted odds ratio [aOR]=0.46; 95% confidence interval [CI]=0.27, 0.81; P=.006). Analyses were adjusted for child age and sex, presence of improved water for drinking, and self-reported handwashing at 4 critical times. The odds of having diarrhea among those with an improved latrine based on the World Health Organization/UNICEF Joint Monitoring Program (JMP) definition (i.e., pit latrines with slabs) were not substantially different from those with a JMP-unimproved latrine (aOR=0.99; 95% CI=0.56, 1.79; P=.99). Of U5C living in households without a latrine or with a study-unimproved latrine, those in the high-coverage villages were less likely to contract diarrhea than those in low-coverage villages (aOR=0.55; 95% CI=0.35, 0.86; P=.008). We recommend that academic studies and routine program monitoring and evaluation should measure more latrine characteristics and evaluate multiple latrine categories instead of making binary comparisons only.

Longitudinal evolution of the HIV effective reproduction number following sequential expansion of treatment as prevention and pre-exposure prophylaxis in British Columbia, Canada: a population-level programme evaluation

Treatment as prevention and pre-exposure prophylaxis (PrEP) are key strategies in the control of HIV/AIDS. We aimed to characterise the longitudinal effects of antiretroviral therapy (ART), followed by treatment as prevention and the addition of PrEP, on the HIV effective reproduction number (Re) in British Columbia, Canada. This population-level programme evaluation used data from the Drug Treatment Program of the British Columbia Centre for Excellence in HIV/AIDS (Vancouver, British Columbia, Canada). We also used estimates of HIV incidence and prevalence from the Public Health Agency of Canada, data on the number of new HIV diagnoses per year from the British Columbia Centre for Disease Control, and mortality data from the British Columbia Vital Statistics Agency. Data were obtained from 1985 until 2022, depending on the database source. Outcomes were the annual HIV prevalence, HIV incidence, number of new HIV diagnoses, number of people living with HIV on ART, HIV/AIDS-related and all-cause mortality rates, the HIV incidence-to-all-cause-mortality ratio, and Re. We calculated the modified effective reproduction number (Rme) using two thresholds of viral suppression and compared these values with Re. We found a 95% decline in HIV/AIDS-related mortality and a 91% decrease in HIV incidence over the study period. The Re progressively declined from 1996 to 2022; however, from 1996 to 2017, Rme remained stable (>1) when calculated for people living with HIV with unsuppressed viraemia, suggesting that treatment as prevention reduces HIV incidence by decreasing the pool of individuals who are potentially able to transmit the virus. From 2018 to 2022, a decline in the estimated Re and Rme (<1) was observed regardless of whether we considered all people living with HIV or only those who were virologically unsuppressed. This finding suggests that PrEP decreases HIV incidence by reducing the number of susceptible individuals in the community, independently of viral suppression. Our results show the synergy between generalised treatment as prevention and targeted PrEP in terms of decreasing HIV incidence. These findings support the incorporation of longitudinal monitoring of Re at a programmatic level to identify opportunities for the optimisation of treatment-as-prevention and PrEP programmes. British Columbia Ministry of Health, Health Canada, Public Health Agency of Canada, Vancouver Coastal Health, Vancouver General Hospital Foundation, Genome British Columbia, and the Canadian Institutes of Health Research.

Training Health Professional Students as Social Risk Advocates

Recognizing the intersection of cultural competency and social determinants of health is a pivotal aspect of enhancing health outcomes. In this retrospective cohort study, we sought to assess the influence of a 2-year leadership program on participants’ knowledge and self-confidence in utilizing social risk-targeted care to advocate for individual health and well-being. From 2018 to 2022, 318 health profession students completed the comprehensive 2-year program, and completed the program evaluation, which gauged the program’s impact on their knowledge and confidence to utilize social risk advocacy for those they serve. The data analysis revealed a statistically significant positive change between the pre-test and post-test phases regarding students’ self-reported comprehension of how an individual’s culture or background can impact their overall health and healthcare choices. There was a notable improvement in self-efficacy related to catering to the unique needs of individuals in rural and underserved settings as well as an increased intent to practice in underserved communities. The findings underscore the affirmative influence of affording students the opportunity to engage in tailored didactic training and community-based learning designed to cultivate the self-confidence necessary to advocate for health equity within their communities.

Virtual leadership program for adolescents with muscular dystrophy: a process evaluation

ABSTRACT Children with muscular dystrophy go through the challenge of moving into adolescence compounded with the challenge of living with a debilitating muscle disease. This paper describes the process evaluation of a group leadership program for adolescents with muscular dystrophy. A five-day online program was conducted for 14 participants, 12 males, and 2 females, between 13 and 18 years, beneficiaries of Mobility in Dystrophy (MIND) trust, Kerala, India. The sessions, which lasted around one and a half hours each, focused on self-discovery through a participatory strength-based approach. The participants’ feedback was thematically analyzed. The process evaluation parameters, fidelity, dose delivered and received, reach, and context were found to be effective. The 100% attendance of the participants and their perceived improvement in self-confidence, self-awareness, friends circle, skills-set, and leadership were identified as positive outcomes. Psychosocial intervention programs through the online platform, with structured follow-ups for adolescents with life-limiting conditions would be beneficial.

Evaluating competency-based medical education: a systematized review of current practices

BackgroundFew published articles provide a comprehensive overview of the available evidence on the topic of evaluating competency-based medical education (CBME) curricula. The purpose of this review is therefore to synthesize the available evidence on the evaluation practices for competency-based curricula employed in schools and programs for undergraduate and postgraduate health professionals.MethodThis systematized review was conducted following the systematic reviews approach with minor modifications to synthesize the findings of published studies that examined the evaluation of CBME undergraduate and postgraduate programs for health professionals.ResultsThirty-eight articles met the inclusion criteria and reported evaluation practices in CBME curricula from various countries and regions worldwide, such as Canada, China, Turkey, and West Africa. 57% of the evaluated programs were at the postgraduate level, and 71% were in the field of medicine. The results revealed variation in reporting evaluation practices, with numerous studies failing to clarify evaluations’ objectives, approaches, tools, and standards as well as how evaluations were reported and communicated. It was noted that questionnaires were the primary tool employed for evaluating programs, often combined with interviews or focus groups. Furthermore, the utilized evaluation standards considered the well-known competencies framework, specialized association guidelines, and accreditation criteria.ConclusionThis review calls attention to the importance of ensuring that reports of evaluation experiences include certain essential elements of evaluation to better inform theory and practice.

Role of Arts and Cultural Events in Community Development and Social Cohesion

Purpose: This study sought to investigate the role of arts and cultural events in community development and social cohesion. Methodology: The study adopted a desktop research methodology. Desk research refers to secondary data or that which can be collected without fieldwork. Desk research is basically involved in collecting data from existing resources hence it is often considered a low cost technique as compared to field research, as the main cost is involved in executive’s time, telephone charges and directories. Thus, the study relied on already published studies, reports and statistics. This secondary data was easily accessed through the online journals and library. Findings: The findings reveal that there exists a contextual and methodological gap relating to the role of arts and cultural events in community development and social cohesion. Preliminary empirical review revealed that such events acted as catalysts for economic and social revitalization, enhancing local business and infrastructure through increased foot traffic and investment. They significantly boosted social cohesion by providing a platform for diverse groups to engage and share cultural experiences, thus strengthening community ties and civic engagement. Additionally, participation in these events was linked to improved mental health and personal well-being, as they offered emotional and psychological benefits that extended from communal to individual levels. The findings highlighted the necessity for ongoing support and investment in the arts, underscoring their integral role in fostering cohesive, vibrant, and resilient communities. Unique Contribution to Theory, Practice and Policy: Social Capital Theory, Cultural Development Theory and Urban Regeneration Theory may be used to anchor future studies on the role of arts and cultural events in community development and social cohesion. The study provided comprehensive recommendations across theoretical, practical, and policy realms. It advocated for the integration of cultural activities into theories of social capital and community dynamics, emphasizing their dual role in fostering both inclusivity and deeper social bonds. Practically, it offered guidance on making cultural events more accessible and engaging for diverse communities, while on the policy level, it pushed for increased governmental investment and the incorporation of arts into broader development strategies. The study also suggested innovative funding models, continuous program evaluation, and the use of cultural indicators to track and enhance the impact of arts on communities. Additionally, it underscored the importance of promoting and advocating for the benefits of cultural events to secure sustained support and recognition.

Preliminary Program Evaluation of Pocket PE 3-5™, A User-Friendly Digital Application for Teacher Skills Training and Physical Education Activities for Third- to Fifth-Grade Elementary Students.

In the United States, many classroom teachers also teach physical education (PE). However, there is a dearth of evidence- and standard-based PE programs designed to support classroom teachers to deliver PE effectively in schools. The purpose of this study was to establish proof-of-concept for the Pocket PE 3-5 digital app in school settings with 10 third- to fifth-grade classroom teachers. We assessed fidelity of program implementation, measured via observations of PE quality. Students used wrist-worn heart rate monitors during Pocket PE 3-5 lessons to measure time spent in moderate to vigorous physical activity. Program feasibility was primarily assessed through teacher-reported surveys of usability, satisfaction, and acceptability and exit interviews. Mean PE observation scores were 18.6 (SD = 1.5) on a scale of 5 to 20. On average, students spent 56.7% (SD = 13.1%) of class time engaging in moderate to vigorous physical activity. Mean survey scores, reported on a 5-point scale, were 4.5 (SD = 0.6) for acceptability, 4.8 (SD = 0.4) for usability, and 4.7 (SD = 0.7) for satisfaction. Teachers liked how easy the app was to use but mentioned some technological challenges. This program evaluation study established the proof-of-concept for the Pocket PE 3-5 elementary school PE program.

3D scanning techniques in power engineering

Information about component geometry is a key parameter for assessing residual life and monitoring degradation processes during the life cycle of a technology. High-precision optical measurement systems are complex metrology devices that enable the collection of complex data on the physical properties of components and their rapid evaluation in CAD-based programs. These solutions offer an analysis of changes in component characteristics over time and comparing them with as-built documentation. The quality of production can be evaluated by comparing the condition of the equipment with the product documentation or monitoring the influence of service conditions on the degradation of the equipment and the trend of future development of defects. All this in digital form of data, which enables new progressive approaches to repair and maintenance programs of monitored equipment. The use of advanced metrology and diagnostic systems and the procedures they offer can reduce the time required for measurement by conventional methods and multiply the data yield from metrology, which in conjunction with modern IT technologies can detect new degradation mechanisms and increase safety service and extend projected lifetime. Up-to-date technology data can significantly save on maintenance costs or even eliminate maintenance procedures. It also provides important data for the setup of LTO.

Evaluation of a training program for the preparation of the plan in the light of some tactical maps to improve the level of achievement for the players of the actual combat competition "Sanda" in kung fu

Evaluation of a training program for the preparation of the plan in the light of some tactical maps to improve the level of achievement for the players of the actual combat competition "Sanda" in kung fu

Evaluation of a summer program for minority high school students in the clinical cancer center: The Future Gen Cancer Scholars program.

e13703 Background: Individuals from minoritized communities receive less cancer screening, have higher stage at cancer diagnosis, and experience higher death rates. Helping minority high school students find a pathway to enter college and continue with advanced education and training and become leaders in cancer treatment, research and prevention may help reduce these inequities. Many public high schools in urban centers struggle in STEM education. The Rhode Island Hospital / Legorreta Cancer Center at Brown University partnered with the Papitto Opportunity Connection in Rhode Island to create the Future Gen Cancer Scholars program. Methods: High school students were invited to apply from Providence and surrounding communities. Accepted applicants became paid hospital employees and received training in professional conduct, protected health information and other skills necessary to shadow physicians in inpatient and outpatient settings. The summer curriculum included physician shadowing, radiology, pathology, student run tumor boards, seminars and community outreach. Pre/post-surveys were collected where students rated their experiences and beliefs regarding cancer careers on a 5-point Likert scale. Open-ended questions were added to evaluate interest in pursuing a career in oncology. Results: 20 high school students participated in the program’s first cohort. 70% self-identified as Hispanic/Latinx and 30% as African American, 85% were female, 90% attended a public school. Pre- and post-surveys were completed by 17 students. The 5-point Likert scale showed improvement in an understanding of oncology careers (pre, 3.9; post, 4.5), interest in pursuing a related career (pre, 3.1; post, 3.8), and recognition of available educational resources within their communities (pre, 3.9; post 4.3). Confidence in overcoming educational access barriers slightly decreased (pre-4.1; post-3.8) due to the increased awareness of the length, cost and process of medical training. Most students described the Future Gen Program as helping them identify career goals and a path forward. Conclusions: The Future Gen program helped solidify minority high school students’ desire to become leaders in cancer care and may provide a path forward to achieve this goal. We will track students’ educational and research achievements over time to measure the program’s impact. The establishment of a successful local model can provide a framework for a nationwide program.

Evaluation of clinical adherence measures for oral oncolytics: A systematic review.

e23130 Background: Despite the critical importance of adherence monitoring for oral oncolytics, there are no standard measures for clinical practice. Methods: We conducted a systematic review using 4 databases aiming to characterize validated adherence monitoring tools utilized in either pre-implementation or evaluation of clinical programs. Various Medical Subject Headings (MeSH) and other search terms related to cancer, oral oncolytics, adherence, metrics, and outcomes were included. Measures used only for research (outside of clinical use) were excluded. Two independent reviewers screened articles with a third reviewer resolving discrepancies. Data extraction and quality assessments concluded the review. Results: Out of 751 screened articles, 73 proceeded to full-text review, with 6 selected for data extraction and quality assessment (Table 1). Two studies focused on the Morisky Medication Adherence Scale-8 (MMAS-8) tool, while others examined Michigan Oncology Quality Consortium Patient Reported Outcome Measure (MOQC PROM), 6-Item Girerd Scale, Medication Adherence Self-Efficacy Scale (MASES), and EXPeriencia con y ADherencia a AntiNEoplasicos Orales (EXPAD-ANEO). Among the five tools, MASES featured the most questions (24). All tools were implemented by healthcare professionals. Girerd and MASES were used specifically in hematologic and solid tumor populations respectively, whereas the remaining tools were applied in both cancer types. MMAS-8 and MASES were employed to evaluate current clinical programs, while MOQC PROM, Girerd, and EXPAD-ANEO were used during pre-implementation for future programs. Common biases from studies included limited generalizability, patient self-reported adherence credibility, and variability in patient baseline characteristics. Conclusions: Our findings highlight the paucity of validated adherence monitoring tools in clinical practice. The five tools discussed above exhibit potential in measuring adherence in a clinical setting; however, small sample size and short duration limit generalizability. Further investigation of new and existing tools in broader settings is needed. [Table: see text]