Program Evaluation Research Articles

Health impact evaluation of Aspirational Districts Program in India: Evidence from national family health survey

Health impact evaluation of Aspirational Districts Program in India: Evidence from national family health survey

Evaluation of a Student Pharmacist-Driven Fall-Prevention Program for Older People.

There is limited research on the impact of fall prevention education for older community-living people led by student pharmacists, which includes a medication review to identify Fall Risk-Increasing Drugs (FRIDs). Study objectives were to first assess the knowledge and behavioral intentions of older people after attending a student pharmacist-led fall-prevention program (FPP) and secondly to quantify the number of FRIDs identified during a medication review. Between October 2022 and April 2023, four independent-living facilities and two senior centers served as programming locations. Events began with a fall prevention-focused presentation provided by student pharmacists. Attendees voluntarily filled out surveys to assess their knowledge and behavioral intentions regarding fall prevention. Optional medication reviews were offered. Additional survey questions were asked of medication review participants. If FRIDs were identified, the individual was provided documentation to share with their prescriber. Fall prevention bingo was offered at select events to review educational content and engage those waiting for a medication review. Eighty-six older people attended the presentations; 45 people completed medication reviews across six sites. Survey information was available for 65 presentation attendees and 29 medication review participants. After programming, 64 out of 65 participants stated they felt comfortable speaking to their pharmacist or provider about falls and their medications. Most survey respondents correctly selected which medications increase fall risk. Twenty-two of 29 medication review participants were taking at least one FRID. The FPP described showed positive results through a post-survey evaluation. Participants demonstrated knowledge of fall hazards including medications and a willingness to discuss falls and FRIDs with health professionals. These factors may lead to concrete interventions to avoid falls and their associated health consequences for older people.

Impact of integrated child development scheme on nutritional and health status of children

The Indian government’s centerpiece initiative, the Integrated Child Development Scheme (ICDS) project, aims to improve the overall growth, wellness, and nutrition of children under six years old and pregnant and breastfeeding mothers’ nutritional and physical well-being. KanyaKumari (KK) district, located in the southern state of Tamil Nadu, has also benefited from this program. Using a questionnaire survey method, valid data were collected from 120 participants, and interviews were subsequently conducted with 52 individuals to gain deeper insights into the research topic. SPSS statistical software was utilized. The program under assessment, the ICDS, targets children under six and pregnant and lactating mothers, offering services like nutrition, healthcare, and early childhood education to improve their health and Nutritional Status (NS). The indicators being assessed include nutritional and Health Status (HS) (e.g., malnutrition, immunization rates) to decrease malnutrition and improve overall health outcomes. The findings of this study indicate that the prevalence of child malnutrition has decreased, suggesting that the ICDS has been effective in improving the NHC. The novelty of this research lies in its specific focus on the KK district, its evaluation of a government program’s impact, and its emphasis on child welfare and development. The study’s insights on integrated child development programs can inform policymakers, healthcare providers, and community groups globally, aiding efforts to improve child health and nutrition implications. The ICDS has had a positive impact on the NHC in the KK district. However, continuous efforts are required to overcome challenges and ensure the sustained success of the program in the district.

Evaluation of the Antenatal Care Service Program at the Tojo Una-Una District Health Office

Evaluation of the Antenatal Care Service Program at the Tojo Una-Una District Health Office

Universal versus Targeted Stipends: How to Reduce Inequity While Avoiding Stigma in Medical Education

Medical education pathway programs address disparity in the medical workforce, particularly in rural areas, but inequity between program participants detracts from the goal. Universal, rather than targeted, stipends overcome this inequity. We report an evaluation of a universal stipend program for undergraduate students in a medical education pathway program. The stipend covers costs associated with preparing to take the MCAT exam. Findings reveal that students who are less advantaged, have lower income, and whose parents have less education, received more benefits from the stipend than those from advantaged backgrounds. The universal stipend design avoids stigmatizing recipients while it helps grow the medical education pathway.

Academic accountability to local communities and society through Programme Science: a case study from the HPV self-sampling programme HOPE in Peru.

Health challenges in the 21st century underscore the need for adaptable and innovative approaches in public health. Academic institutions can and should contribute much more effectively to generate and translate scientific knowledge that will result in better programmes to improve societal health. Academic accountability to local communities and society requires universities to actively engage with local communities, understanding the context, their needs, and leveraging their knowledge and local experience. The Programme Science initiative provides a framework to optimize the scale, quality and impact of public health programmes, by integrating diverse approaches during the iterative cycle of research and practice within the strategic planning, programme implementation and programme management and evaluation. We illustrate how the Programme Science framework could be a useful tool for academic institutions to accomplish accountability to local communities and society through the experience of Project HOPE in Peru. Project HOPE applied the Programme Science framework to introduce HPV self-sampling into a women's health programme in Peru. Collaboration with local authorities and community members was pivotal in all phases of the project, ensuring interventions aligned with community needs and addressing social determinants of health. The HOPE Ladies-community women trained and empowered to promote and provide the HPV kits-crafted the messages used through the study and developed strategies to reach individuals and provided support to women's journey through health centres. By engaging communities in co-creating knowledge and addressing health inequities, academic institutions can generate contextually relevant and socially just scientific knowledge. The active participation of community women in Project HOPE was instrumental in improving service utilization and addressing barriers to self-sampling. The Programme Science approach offers a pathway for academic institutions to enhance their accountability to communities and society at large. By embedding researchers within public health programmes and prioritizing community engagement, academic institutions can ensure that research findings directly inform policy improvements and programmatic decisions. However, achieving this requires a realignment of research agendas and recognition of the value of community engagement. Establishing Programme Science networks involving academia, government and funding entities can further reinforce academic accountability and enhance the impact of public health programmes.

Charitable Food & Healthcare Industry Partnership Efforts Against Food Insecurity: A Mixed Methods Programmatic Evaluation

Charitable Food & Healthcare Industry Partnership Efforts Against Food Insecurity: A Mixed Methods Programmatic Evaluation

Spare or transform? Agency frames in transition intermediaries

Climate emergency is widely acknowledged. However, our institutions are struggling to find new intervention types to accelerate the transition. This paper analyses this struggle by combining agency theories and discursive approaches to study transition intermediaries, i.e, organizations seeking to foster the transition activities of others. The internal meaning structures of intermediaries are described as interlocking shared action frames, i.e., beliefs and meanings underpining their activities. These frames are characterized through the definition of pairs of contrasting frame elements along eleven framing dimensions. This conceptualisation allows for a semi-quantitative mapping of internal structures. The method is developped and illustrated with the in-depth case study of a Swiss regional utility department running an energy efficiency programme. Analysing a series of exploratory workshops, we find that established frames revolve around technology-oriented, managerial approachs to the transition, ultimately narrowing the range of imaginable interventions. While these are well-studied shortcomings of energy efficiency centred approaches, further observations suggest that these frames underpin the perception of intervention impacts, helping keep staff and recipients involved. To strike a balance between energy saving targets and transformative ambitions, this paper suggests revising programme evaluation logics and reframing technological solutions as responses, rather than substitutes, to practice changes.

Evaluating Virtual Simulation to Augment Undergraduate Nurses' Clinical Practice.

Due to the lack of clinical placements during the pandemic, virtual simulation was used to augment student practice experiences. Using Kirkpatrick's evaluation model, a program evaluation study using a mixed-methods design was implemented to assess student and faculty satisfaction and usefulness of virtual simulation, the effectiveness of meeting learning needs, and the effects of the virtual simulation resource on the development of clinical judgment (n = 70). Virtual simulation was rated as moderately useful with an overall mean of 1.7 (SD = 0.66, range 1 to 3). Only 21% to 49% of the students found online simulation either met or well met the various areas of learning needs. Qualitative data highlighted the benefits of this strategy as well as implementation factors that affected students' experience. Virtual simulation can be used in clinical courses to augment learning when implemented in a way that addresses students' needs. [J Nurs Educ. 2024;63(7):470-477.].

Assessing the success of a research leadership programme for senior nurses and midwives: A mixed methods programme evaluation.

In 2018 the National Institute of Health and Care Research, United Kingdom, launched a 3-year Senior Nurse and Midwife Research Leader Programme to support nurse and midwifery research leaders to develop research capacity and capability within NHS organisations. We report the results of a service evaluation of the programme strengths, areas for improvement and achievement of programme aims. Partially mixed, concurrent mixed methods programme evaluation, including: (a) meeting evaluation (survey), (b) annual evaluation (survey) and (c) qualitative stakeholder interviews. Survey results were quantitatively analysed using descriptive statistics. Interviews were audio-recorded, transcribed, deductively coded using elements within the logic model and analysed using the seven-stage framework analysis method. Satisfaction with the programme was high (75%). The main perceived benefit of the programme was being part of a network. Challenges included accessing learning resources, lack of opportunity to network and lack of clarity about the programme aims. Meetings were evaluated as relevant and helpful (mean 93%), thought-provoking (92%), inspiring (91%), at the appropriate level (91%) and aligned with the programme aims (90%). All meetings were ranked as highly beneficial by attendees (92%). Stakeholder feedback on the programme success reflected the importance of leadership, the programme design and content, 'connection and community' and communication with and about the cohort. Overall, the anticipated programme aims were met, evaluating well from both the perspective of those on the programme and the wider stakeholder group. There has been a lack of investment in schemes to support research leadership development for nurses/midwives. A novel programme to support nursing/midwifery research leadership was positively evaluated. The programme is a useful model to support future capacity and capability building for nurses/midwives. The work is reported with reference to the SQUIRE 2 and SRQR checklists. No patient or public contribution.

S87 - Naloxone Distribution in the Emergency Department: Program Evaluation of the University of Washington Harborview Medical Center Emergency Department’s Response to Washington State Bill 5195

S87 - Naloxone Distribution in the Emergency Department: Program Evaluation of the University of Washington Harborview Medical Center Emergency Department’s Response to Washington State Bill 5195

Educating Our Future Medical Leaders: An Innovative Longitudinal Course Across Surgical and Medical Specialties in Graduate Education.

Increasing healthcare system complexity, multidisciplinary care delivery, and the need to deliver high-quality, cost-effective care drive a critical need for leadership development. Currently, few examples of multidisciplinary leadership development exist in the medical education literature. The Accreditation Council for Graduate Medical Education (ACGME) has identified leadership domains as essential milestones in residency education, encompassing areas such as interpersonal communication, quality improvement, and systems-based practice. Presently, published GME leadership curricula vary widely in content, delivery, and duration and rarely include multispecialty cohorts. The study authors designed and implemented a longitudinal leadership curriculum for a multispecialty cohort of senior residents and fellows from multiple hospitals within a large integrated GME program. Between July 2022-June 2023, authors delivered 12 monthly sessions on core leadership concepts. Sessions delivered relevant work-based content via large-group didactics with embedded opportunities for small-group interactive experiential and reflective practice, critical thinking, and application. Thirty GME trainees participated in the longitudinal curriculum. Interval pre-/post-session assessments demonstrated significant improvement in composite scores for 6 of 9 sessions assessed. Participants rated each module's overall importance, applicability, and acceptability highly on a summative program evaluation. This longitudinal leadership curriculum adheres to best leadership development practices, demonstrates improvement in knowledge and self-reported attitudes and behaviors related to cognitive, character, and emotional leadership domains, and develops a psychologically safe community of practice for GME participants.

The urgency of sexual education in early childhood: A portrait of children's curiosity towards their authority

This study aims to explore the urgency of sexual education in early childhood that arises from children's curiosity about their authority. The informants in this qualitative research are five teachers and five parents from 5 different early childhood education units in Banjarmasin, South Kalimantan, Indonesia. The data were purposively selected based on the criteria of parents with girls or boys aged 5-6 years, heterogeneous background cluster, and integrated Islamic preschool. Data analysis using Miles and Huberman includes the process of data reduction, display, and verification with Jean Piaget's cognitive development theory and its relevance to Sigmund Freud's psychosexual. The results showed that sexual education for early childhood is urgent because children have a high curiosity about their authority. Children are formed from various stages in their psychosexual process, which corresponds to the level of their thinking ability. The sexual knowledge will determine the direction of the child's personality and behavior in the future. Parents and teachers can establish partnerships to create a basic sexual education program for children while developing socialization skills, independence, self-confidence, and positive self-concept and fostering children's religious and moral values. Although this study is still limited to a small scale, it can be an initial illustration for other regions in designing sexual education programs for children, and further program evaluation can be carried out.

Tantangan dan Peluang: Inovasi dalam Kurikulum Merdeka bagi Guru Madrasah Ibtidaiyah di Trangkil

The curriculum merdeka has been implemented simultaneously in the 2023/2024 academic year. At the Elementary School and Madrasah Ibtidaiyah levels, it has been implemented in grades I and IV. This service aims to provide a deeper understanding of the implementation of the independent curriculum regarding initial assessment, differentiated learning, preparation of teaching modules and preparation of P5P2RA modules. The implementation methods used are observation, coordination with partners, outreach, implementation of activities and program evaluation. The intended target is MI teachers in Trangkil District. The results obtained from this service are that teachers are able to understand in more depth how to implement the independent curriculum concept according to the characteristics and needs of students. Apart from that, teachers know the differentiated learning process in accordance with the concept of teaching at the right level.

English Proficiency Requirement for Improving Global Real Estate Business Program

This paper looks at both the felt (present situation) and perceived needs (target situation) English communication needs of Korean university students enrolled in the Global Real Estate Business program which uses English only as medium of instruction. Data was gathered using 8-item questionnaire composed of scales, checklists, and open-ended questions. Statistical and interpretive approaches were used to analyze the profile of the respondents, identify the both the present situation and target situation English communication needs of the students to inform possible program evaluation. Based on the study conducted, it was found that of the four communication skills in English, the respondents consider ‘listening’ as the most used, most practiced, most important, but most difficult. This study is important for the Global Real Estate Business Program teachers to consider, so that they can device ways on how listening comprehension can be improved. Also, the list of Global real estate business related skills and vocabulary focus will inform the teachers of which to emphasize and focus so that their classes will be able to better address what actual communication needs their learners feel are most important. In the future, it will continue to be necessary to manage practical global real estate business programs while continuously improving basic English skills, focusing on listening, to enable students to perform classes taught only in English.

Implementation and Evaluation of an Emergency Response Training Program for Newly Graduated Nurses: A Scoping Review

Implementation and Evaluation of an Emergency Response Training Program for Newly Graduated Nurses: A Scoping Review

Management Strategies of Village-Owned Enterprises in Tanjungharjo Village, Bojonegoro

One of the efforts that the Indonesian government can undertake to boost the local economy is by encouraging Village-Owned Enterprises, known as “Badan Usaha Milik Desa” or BUM Desa, to become more active. In the case of Tanjungharjo Village, there is a BUM Desa named Tanjungkarya. However, during its implementation, various obstacles were encountered, such as a lack of financial resources, human resources, infrastructure, and effective programme management. This research aimed to describe the Management Strategies of the Village-Owned Enterprise (BUM Desa) for developing the community's economy in Tanjungharjo Village, Kapas Sub-District, Bojonegoro Regency. The study employed a qualitative approach with a descriptive method, and informant selection is based on purposive sampling. The informants consist of the Village Head of Tanjungharjo, the Secretary of Tanjungharjo Village, the Chairman of BUM Desa Tanjung Karya, the Secretary of BUM Desa Tanjung Karya, the Treasurer of BUM Desa Tanjung Karya, and members of the Tanjungharjo community. Data was collected through observation, interviews, and documentary analysis. The data was then analysed through data reduction, data presentation, and drawing conclusions. The research focused on six criteria based on Koteen's strategy, which are 1) organisational strategy, 2) resource strategy, and 3) programme strategy. The research findings indicate that the management strategies of the Village-Owned Enterprise (BUM Desa) to enhance the local economy in Tanjungharjo Village encompass three main aspects. First, in the organizational strategy aspect, there was a formulation of a vision and mission involving various stakeholders, and the implemented programmes align with the vision and mission set by BUM Desa Tanjung Karya. Second, regarding the resource-supporting strategy, there were still several hindrances that impede the optimisation of this strategy. Third, regarding the programme strategy, this pertained to the evaluation and implementation of programmes. Based on the programmes conducted by BUM Desa Tanjung Karya, they had contributed to the Village Revenue (PAD) for the Tanjungharjo Village Annual Village Budget (APB Desa). Thus, the management strategies of BUM Desa had not been fully executed optimally due to the presence of these obstacles.

Evaluation of the policy program for strengthening local food commodities for sustainable food security in papua

Achieving sustainable food security in Papua remains a significant challenge due to the region's heavy reliance on imported food. The policy program aimed at bolstering local food commodities is designed to promote self-sufficiency and ensure long-term food sustainability. This study evaluates the policy program focused on strengthening local food commodities in Papua, specifically targeting sago, sweet potatoes, and maize. The objective is to assess the program's effectiveness in boosting local food production and its overall contribution to sustainable food security. The research methodology integrates both qualitative and quantitative approaches, incorporating secondary data analysis from government reports, field surveys of local farmers, and in-depth interviews with key stakeholders to gain a holistic perspective. The data analysis techniques included thematic analysis for qualitative data, ensuring detailed insights, and statistical methods for quantitative data to provide robust findings. The results indicate that the policy program has increased local food commodity production by 30% over the past five years. However, significant challenges remain, including inadequate infrastructure, limited market access, and insufficient support services for farmers, which hinder the full optimization of the program's benefits. The policy initiative has positively impacted food production and sustainable food security in Papua. For long-term success, it is crucial to improve infrastructure, expand market access, and provide continuous support and training for local farmers. This will ensure the gains achieved by the policy program are maintained and further developed, leading to a more resilient local food system in Papua

MAXIMIZING THE COLLECTION AND DISTRIBUTION OF ZAKAT AND INFAQ (A CASE STUDY ON LAZ ZAKAT SUKSES)

Introduction: Indonesia possesses a significant potential for Zakah, yet the collected amount currently only reaches around 4.3%. This requires a diligent and dedicated effort to continuously enhance the growth of the collection, one of which is through the management strategy of Zakat Institutions. This research focuses on LAZ Zakat Sukses, the Best City-level LAZ at the National level with outstanding performance. Methods: This study aims to ascertain the internal and external factors held by the institution and determine the most appropriate strategy to maximize its performance achievements. Employing a qualitative descriptive research method involving internal and external analysis, this research utilizes matrices such as IFE, EFE, SWOT, IE, BCG, and QSPM. Results: The findings of this research indicate that the most suitable strategy for this Institution based on its current fundamental conditions is Market Development. Market development is a strategy aimed at expanding the organization's reach by entering new markets or segments with existing products or services. Conclusion and suggestion: Particularly expanding into new territories, is a promising direction for Zakat Sukses. Key points and actions to consider when implementing this strategy are Geographical Expansion, Strategic Partnerships, Strengthen Volunteer Network, Synergy and Collaborative Programs, Digital Platform Expansion, Fundraising and Program Distribution, Monitoring and Evaluation, Communication and Outreach, Risk Management, Sustainability. Successful market development and expansion require careful planning, strong execution, and adaptability to changing circumstances.

Menguak Tantangan dan Persiapan Konselor dalam Rangka Menuju Indonesia Emas 2045

This research highlights the preparations and challenges counselors face in achieving the Vision of Golden Indonesia 2045. The focus on the basic skills required by counselors to provide effective services. Qualitative research methods and literature studies were used to explore counselors' perspectives and experiences regarding preparations and challenges towards Golden Indonesia 2045. The findings emphasize importance of quality education and training for counselors, as well as the integration of technology in counseling services. Future recommendations include enhancing collaboration between the government and educational institutions, strengthening supervision, and program evaluation to improve the quality of guidance and counseling services in Indonesia.