Indicators Of Program Effectiveness Research Articles

Effectiveness of targeted intervention program under the national AIDS control program among Hijra and transgender population: Evidence from Integrated Biological and Behavioral Surveillance, 2014-15.

The hijra and transgender (H/TG) population in India is vulnerable to HIV/AIDS. India had instituted a targeted intervention (TI) program to reduce this vulnerability. We aimed to measure the effectiveness of the TI program for H/TG. The National Integrated Behavioral and Biological Survey (IBBS) was carried out in 2014-15. H/TG data from IBBS was analyzed. Bivariate and multivariate logistic regression were used to calculate the unadjusted and adjusted odds ratios with 95% confidence interval. Condom use during the last sexual intercourse, and the consistent condom use in the last onemonth were considered as indicators of program effectiveness. The Propensity Score Matching (PSM) method was used to assess the effectiveness. We found that the participants who had received condoms from peer educator/outreach worker were 1.74 and 1.40 times more likely to use condoms in the last sexual intercourse (aOR: 1.74, CI: 1.35 - 2.26) and consistent condom use in the last onemonth (aOR: 1.40, CI: 1.12 - 1.74) respectively compared to the participants who did not receive the condom. The matched-samples estimate (i.e., average treatment effect on treated) for the condom use during the last sexual intercourse increased by 13.0%, i.e., 0.13 (CI; 0.08 - 0.18) and consistent condom use in the last onemonth increased by 5.0%, i.e., 0.05 (CI; 0.00 - 0.10) among those who had received condoms from the peer educator/outreach worker compared with those who had not received condom, respectively. The TI program intervention for H/TG was effective in reducing HIV risk behavior as evidenced by increase in use of condom during last sexual intercourse, and consistent condom use in the last onemonth.

Cattle Fattening Program: The Effectiveness of Zakat Community Development

Despite many studies on productive Zakat, the focus on the effectiveness of mustahiq empowerment programs has been limited. This study looks at how effective the Zakat community development-based cattle fattening program is towards the empowerment of Zakat recipients. The study measures four indicators of program effectiveness: program target accuracy, program socialization, program objectives, and program monitoring. Data collection techniques include interviews, observation, and documentation. The study found that the program was good at targeting the right people, but it wasn't socialized enough. The program also fell short of its objectives because the recipients weren't making enough money to become donors themselves yet. However, the program was well-monitored, with regular check-ins to make sure it was on track. The study suggests that clearer standards are needed to increase the benefits received by Zakat recipients This study has practical implications for productive Zakat distribution policies, as clear benchmarks are required for implementing programs that increase Zakat recipients' benefits.

EFFECTIVENESS OF THE EXPANSION PROGRAM OF EMPLOYMENT OPPORTUNITY FOR UNEMPLOYMENT PREVENTION OF SUKABUMI DISTRICT

The purpose of this study to determine the effectiveness of the expansion of employment opportunities program against unemployment reduction in Sukabumi. The method used is qualitative method with descriptive approach. Data collection using observation techniques, interviews, and documentation. Data analysis using Flow model Method and Data Validation using triangulation technique. This study uses the theory of program effectiveness from Sutrisno with 5 indicators of program effectiveness, namely program understanding, target accuracy, timeliness, achievement of goals, and taking real research results show the effectiveness of the expansion of Employment Opportunities Program Against Unemployment in Sukabumi runs well where the dimension of understanding the independent labor program. Program runs skill training through the P2KSS program so as to support the achievement of targets. On the dimension of the accuracy of the target where the independent labor program according to the target where targeting housewives. In imensi keteapatan socialization time will be quite effective independent work program because it has done socialization as much as 2 times face to face. In the dimension of the program where the independent labor program spreads widely to all levels of society. And in the dimension of real decision where Disnakertrans provide facilities and assistance to the community and also training has been implemented.

Efektivitas program cake kebun dalam rangka pencegahan stunting di Kecamatan Tellulimpoe.

This study to determine the effectiveness of the cake kebun program in the context of preventing stunting in Tellulimpoe District. This research is a qualitative descriptive study with the aim of describing or thoroughly describing the effectiveness of the cake kebun program in the context of preventing stunting in Tellulimpoe District. Data was collected through observation, interviews and documentation. This research was conducted with research informants: 1) Head of Lappae Health Center, 2)Cake Kebun Innovator 3) Kalobba Village Head 4)Cake Kebun Team 5) Stunting Parents of Toddler. The results of this study indicate that 4 (four) indicators of program effectiveness which are the focus of research on the cake kebun program in the context of stunting prevention are quite effective. However, in its implementation there are various obstacles such as the problem of human resources that are still lacking, people who do not understand the need to prevent stunting from an early age, there are still toddlers who do not like cake kebun and there are still people who have not succeeded in cultivating Moringa because it failed to grow. Efforts made to overcome these problems include continuous socialization and promotion of the cake kebun program. conduct cooking demonstrations to several Integrated Healthcare Centre officers who are expected to be resource persons, socialize the benefits of Moringa leaves so that people have awareness to cultivate Moringa plants and continue to formulate cake kebun with variants favored by toddlers.
 Keywords: Effectiveness, Cake kebun, Stunting
 

The Effectiveness of the Family of Hope Program (PKH) in Lamu Village, Batudaa Pantai District, Gorontalo District

The purpose of this study was to determine the effectiveness of the Family Hope Program (PKH) in Lamu Village, Batudaa Pantai District, Gorontalo Regency. The method used in this study was qualitative. The results showed that the effectiveness of the Family Hope Program in Lamu Village by using four indicators of program effectiveness, namely the accuracy of program targets, program socialization, program objectives, and program monitoring. There are two indicators that are fulfilled, namely program socialization and program monitoring. This is evident from the activeness of PKH facilitators in conducting program socialization and monitoring both directly and indirectly. Two other indicators that have not yet been achieved are the accuracy of the targets and objectives of the program because there are still some residents who are able to participate in receiving PKH assistance and the utilization of aid funds is still not in line with the objectives expected by the government.

INCREASING THE POWER OF INTERGENERATIONAL NETWORKS: ADVANCING A NEW EVALUATION TOOL

According to a 2018 national survey of intergenerational (IG) care providers, practitioners identified as their number one concern a need for evidence-informed evaluation tools to demonstrate their impact on older and younger participants. The Best Practices Checklist is a 14-item (yes/no) measure grounded in evidence of effective intergenerational strategies. Trained evaluators complete the checklist based on their observations of facilitators’ behaviors during IG activities. Exploratory factor analysis (promax rotation) of the Checklist for 132 IG activities offers insight to factor structure and item construction. An adequate two-factor structure was achieved; seven Checklist items were retained with factor loadings greater than .39. Seven items were deleted due to non-variance, high missing data, or double loading across factors. Factors reflect dimensions of: (a) person-centered strategies (e.g. selecting activities based on participants’ interests) and (b) creating a positive physical environment (e.g., grouping participants into intergenerational pairs or small groups). Findings indicate that a Best Practices Checklist with fewer items may offer a suitable tool for assessing the utilization of Best Practices during IG activities. Given the demand for IG evaluation tools, the 7-item BP Checklist can be a brief, easy-to-use measure that documents IG facilitators’ implementation of evidence-informed practices. Its use could be especially helpful if connected to varied indicators of program effectiveness and participant outcomes.

Questioning the Use of Outcome Measures to Evaluate Principal Preparation Programs

ABSTRACTPolicymakers are proposing the use of outcome measures as indicators of effective principal preparation programs. The three most common metrics recommended are: (1) graduates’ effectiveness in improving student achievement test scores, (2) graduate job placement rates, and (3) principal job retention once employed. This article explores the use of these three measures as indicators of program effectiveness by reviewing existing empirical research, employing program evaluation methodology to review potential approaches, and applying program evaluation standards to the evaluation effort. We conclude that the effort to evaluate principal preparation programs using these outcome measures is far less accurate than policymakers assume.

Influence of a School District’s Advancement via Individual Determination (AVID) Program on Self-Efficacy and Other Indicators of Student Achievement

This article examines a school district’s Advancement via Individual Determination (AVID) program using perceived self-efficacy in academic achievement and self-regulated learning, GPA and attendance as indicators of program effectiveness. Results suggest that AVID participation was positively and significantly correlated with attendance in the full sample and among Latino/students, and was a strong predictor of self-efficacy and GPA among African Americans. Findings suggest that AVID may be useful to educational leaders in thier efforts to reduce achievement gaps among ethnic minorities.

Is It Useful to Measure Efficiency Indices of a Deceased-Donor Kidney Transplant Program in One Intensive Care Unit?

BackgroundBefore 2010, donor detection rate and donor conversion rate at our tertiary level care institution were low. To assess the effectiveness of the implemented organizational changes, an analysis of organizational indicators with the use of the DOPKI (Improving the Knowledge and Practices in Organ Donation) project was conducted. MethodsThree groups of DOPKI indicators were used: indicators of the potential for deceased organ donation, indicators on areas for improvement in the deceased donation process, and indicators of program effectiveness. We compared the 3-year period before instituting organizational measures with the 3-year period after the changes. ResultsSignificant differences in almost all DOPKI indicators were found. Most importantly, the number of actual donors has increased significantly, pointing to the effectiveness of the organizational measures that we put in place in 2010. In addition, the study highlights the value of the use of DOPKI indicators in one intensive care unit to improve the transplant program on a hospital level. ConclusionsWe conclude by arguing that despite the lack of a uniform national database, DOPKI indicators could still be useful for improving the quality of donor programs.

The Best Test of Ph.D. Student Success

In their Education Forum “Performance-based data in the study of STEM Ph.D. education” (16 July, p. [282][1]), D. F. Feldon, M. A. Maher, and B. E. Timmerman suggest that graduate education could be improved by the implementation of performance-based assessments. They do not acknowledge that a performance-based system already exists in graduate work: quality (not quantity) of publications. Feldon, Maher, and Timmerman downplay publication as an indicator of student performance because of the involvement of mentors and peers, but input from multiple parties is a necessary and productive aspect of collaborative research. Collaboration benefits individual success and leads to innovation. Failing to recognize published work as a predictor of effectiveness as a researcher trivializes employers' ability to distinguish poor research from quality research, and by extension, the graduate student's ability to conduct research and collaborate effectively. Adding standardized testing to the graduate curriculum neither benefits research nor serves as an accurate indicator of an individual's problem-solving ability. Recently, Hazari et al. ([ 1 ][2]) found that being “learning-oriented” rather than “performance-oriented” predicted success at the graduate level. This research implies that—if assessments were added to the curriculum (a move I discourage)—assessments of student interest in learning would be a better indicator of program effectiveness than the performance-based assessments advocated by Feldon, Maher, and Timmerman. 1. [↵][3]1. Z. Hazari, 2. G. Potvin, 3. R. Tai, 4. J. Almarode , Phys. Rev. Spec. Top. Phys. Educ. Res. 6, 010107 (2010). [OpenUrl][4][CrossRef][5] [1]: /lookup/doi/10.1126/science.1191269 [2]: #ref-1 [3]: #xref-ref-1-1 View reference 1 in text [4]: {openurl}?query=rft.jtitle%253DPhys.%2BRev.%2BSpec.%2BTop.%2BPhys.%2BEduc.%2BRes.%26rft.volume%253D6%26rft.spage%253D010107%26rft_id%253Dinfo%253Adoi%252F10.1103%252FPhysRevSTPER.6.010107%26rft.genre%253Darticle%26rft_val_fmt%253Dinfo%253Aofi%252Ffmt%253Akev%253Amtx%253Ajournal%26ctx_ver%253DZ39.88-2004%26url_ver%253DZ39.88-2004%26url_ctx_fmt%253Dinfo%253Aofi%252Ffmt%253Akev%253Amtx%253Actx [5]: /lookup/external-ref?access_num=10.1103/PhysRevSTPER.6.010107&link_type=DOI

Transforming Grades into Meaningful MPA Program Outcomes: Lessons from Benchmarking Learning Objectives in the Public Budgeting and Finance Course

MPA programs have experienced increasing pressure from external stakeholders to produce indicators of program effectiveness. Producing these measures, however, can be both difficult and expensive. This article presents a low-cost method of transforming grades into meaningful MPA program outcomes. The method consists of (1) defining learning objectives, (2) structuring assessment instruments according to these learning objectives, and (3) using basic statistical procedures to determine whether a benchmark has been reached for each learning objective. The method presented in this article allows individual faculty to align course content with program mission, refine the specifics of program objectives, and measure the achievement of both. Hence the method is a good means of not only outcome assessment but also of faculty and curriculum development. Course specific indicators provide timely information on performance and can produce positive effects that spill over into the internship, capstone, and eventual realworld job experiences of students and alumni.

Evaluation of adult literacy education in the United States: A review of methodological issues

This is a critical review of methodological issues in the evaluation of adult literacy education programs in the United States. It addresses the key research questions: What are the appropriate methods for evaluating these programs under given circumstances. It identifies 15 evaluation studies that are representative of a range of adult literacy contexts at various evaluation levels; and reviews each study regarding evaluation designs, data sources, learner assessment tools, and indicators of program effectiveness. It summarizes methodological lessons learned regarding the evaluation of adult literacy education and identifies areas for further research.

An Evaluation of a Bullying Prevention Program for Elementary Schools

This research evaluates an anti-bullying program, Dare to Care: Bully Proofing Your School. Students in Grades 4-6 (N = 197, 77 boys, 120 girls) from four Calgary elementary schools completed the Colorado School Climate Survey (Garrity, Jens, Porter, Sager, & Short-Camilli, 2000) and the Provictim Scale - Short Version (Rigby & Slee, 1991). The first research component was a pretest - 3-month posttest comparison between a school that was about to implement the program and one that was not planning to do so. At pretest, students in the no-program school gave more positive reports on many variables than the school about to implement the program, making the intended across-school statistical comparison unfeasible. Within the 3-month program school, however, the frequency of bullying witnessed by the students significantly decreased, but remained stable in the no-program comparison school. Further, attitudes towards victims significantly worsened in the no-program school, but remained stable in the program school. The second research component compared three schools that had implemented the anti-bullying program for various lengths of time. Students in the schools with the longer program duration reported more positive attitudes towards victims than students in the school with shorter program duration; however, other indicators of program effectiveness were not significantly different. The results raise questions about evaluating anti-bullying programs.

Childhood tuberculosis in Alabama

An 11-year review of childhood tuberculosis in Alabama was made in order to define indicators of program effectiveness in interrupting community transmission. Minority (nonwhite) children, 96% of whom were black, had the highest risk of disease (odds ratio, 5.5; 95% confidence interval, 3.9, 7.7). Of 171 cases, 71% (n = 122) occurred in blacks and 2% (n = 3) occurred in Asian-Pacific islanders. Age 0 to 4 years (107 of 171) compared with age 5 to 14 years (64 of 171) was an additional risk factor for the development of tuberculosis (odds ratio, 3.4; 95% confidence interval 2.5, 4.7)), whereas gender was not. Males accounted for 49% of cases (83 of 171). During the period 1983 to 1993 there was no trend of increasing or decreasing numbers among child cases (trend test P = 0.94) despite significant changes by year. The purified protein derivative test had a 9% (8 of 89) false negative rate and was significantly more likely to be negative in children younger than 1 year (4 of 12 vs. 4 of 77; P = 0.01). During the 2-year interval 1992 to 1993, 19% of cases were thought to be preventable. We believe that the PPD skin test is useful and an improved contact investigation is essential to preventing childhood tuberculosis. Miniepidemics of transmission of tuberculosis from adults to a large group of children partially explain the observed disease pattern.

Laboratory Science Programs and Certification Examination Performance

Clinical laboratory science education programs are diverse and complex in design, making them difficult to evaluate individually or as a group. Successful completion of an accredited program establishes eligibility for the American Society of Clinical Pathologists’ Board of Registry certification examination, leading to lifelong certification. Examination performance is a key indicator of program effectiveness. This study focuses on university-based clinical laboratory science programs and seeks to identify the curricular and administrative factors associated with successful examination performance. Results may enable educators, administrators, and accreditors to improve program planning and evaluation for better student performance on the exam.

Truths and answers

problems associated with the analysis of gain scores, residual scores, and repeated measures for individuals is clear and logical. However, his choice of ACT's COMP Objective Test to illustrate his argument is misleading. ACT formally notified Pike and his colleagues of the inappropriate analysis of data based on this test in Fall 1989 (Steele, 1989c). At that time some of the same problems he discusses in his article were pointed out as leading him to incorrect results and unwarranted generalizations. Unworthy uses of tests should not be used to judge the technical merits of those tests. The Standards for Educational and Psychological Testing (AERA, APA, and NCME, 1985) make clear that validity is not a characteristic of an instrument per se but "refers to the appropriateness, meaningf ulness, and usefulness of the specific inferences made from test scores" (p. 9). Pike claims inaccurately that, "Gain scores are reported by the College Outcome Measures Program (COMP) staff as indicators of student learning and program effectiveness" (p. 72). In fact, ACT has always recommended mean score gains, not individual gain scores, as indicators of program effectiveness. In addition, ACT has always clearly stated that the COMP Objective Test should not be used in making judgments about individual students but should be analyzed with the group as the unit of analysis as an indicator of program quality and effectiveness (Steele, 1989b). The merit of the COMP Objective Test can be judged against accepted technical standards, based on its intended uses. The worth of the Objective Test depends on actual uses that do not undermine the construct validity of the instrument and represent well-designed evaluation efforts (Scriven, 1981). Pike describes results from his unworthy use of the test to question its technical merit. In contrast to the somewhat meaningless results based on his use and

An Evaluation of Family Preservation Services: Fitting Agency Services to Family Needs

Intensive family preservation programs provide comprehensive services to families at risk that are intended to strengthen families and prevent the out-of-home placement of children. These programs have been operating for the past two decades and have reported placement prevention rates of between 75 percent and 90 percent. Evaluations of these programs often examine placement rates as the sole outcome criterion; other indicators of program effectiveness have not been adequately evaluated. Evaluations also have not sufficiently examined the elements of intensive services that contribute to family preservation. This evaluation of a family preservation program in northern California examines the progress and outcomes of 367 cases served during a three-year period. Detailed analysis examines the specific service elements of the program, the match of services to families' needs, and the resulting gains made by parents in a variety of skill areas.

Background, College Experiences, and the ACT-COMP Exam: Using Construct Validity to Evaluate Assessment Instruments

This article presents one criterion for judging the appropriateness of standardized tests as assessment instruments. To be valid indicators of program effectiveness, test scores should discriminate between indicators associated with educational quality and variables beyond the control of education. Research on the appropriateness of one standardized test for program evaluation at the University of Tennessee, Knoxville, provides mixed results. Whilie the test primarily measures individual differences, it is also sensitive to the effects of higher education.

On-the-Job learning

I n the 1980s, youth unemployment and discontent with schooling persist as problems facing educators. Numerous programs and recommendations to create school-based, work-experience programs have attempted to address these problems. The report of the Panel on Youth of the President's Science Advisory Committee advocated a closer union of school and community by creating more opportunities for youth to participate in the life of the community. The report of the Carnegie Council on Policy Studies in Higher Education cited a number of reform proposals calling for less schooling and more work experiences for youth. The Youth Employment Demonstration Projects Act of 1977 encouraged local education agencies to place school-age, low-income youth in jobs. These programs hoped to impact upon the future employability of youth, to make schooling more relevant and interesting to them, and thereby to ease the transition from school to work. While adult employment status is the decisive measurement of program success, such a long-term outcome is expensive to document and difficult to assess. Other indicators of program effectiveness are needed for immediate evaluations of current and proposed programs to provide federal, state, and local policy makers with guidelines for decision making. Analytic principles from the curriculum field can serve as one source for indicators of current program effectiveness. These principles of curricular form and content embody both empirical and theoretical knowledge of human learning. Although they have usually been applied to classroom instructional programs, they can provide criteria for evaluating the quality of work experience programs. In order to analyze such programs for policy purposes, one needs to assess the quality of the day-to-day activities that youth encounter, because it is the cumulative effect of these activities over time that offers hope of easing unemployment and reducing inequality. Program planners and proposal reviewers could make use of these principles to evaluate the probable effectiveness of programs in the planning stages. As programs are implemented, these principles can help local program personnel make further choices when faced with reality constraints. A work-experience curriculum is a set of learning activities centered around the work experience. Part of the task of this study is to generate activity categories that describe what youth do in the programs. This definition stresses that the activities should have some relationship to learning. In The Boundless Resource, W. Wirtz emphasized that the learning should have an application beyond particular job tasks, to life in general:

Reaching Rural Adolescents with Programs in Sexuality

In an effort to meet the special challenge of reaching rural youth the Montachusett Opportunity Councils Family Planning Program has been operating a demonstration project that provides sex education and family planning services to adolescents in the rural areas of northern Worcester County in central Massachusetts. The program was started in 1972 with Office of Economic Opportunity funding. It has been providing young people with a variety of services that include the provision of sex education classes and counseling both in and out of schools. Family planning services including counseling and referrals for problem pregnancies are made readily available. Special health related programs on such topics as breast cancer venereal disease and sex education have been presented to the community. The ultimate indicator of program effectiveness is clearly the participation and involvement of young people. Trust had to develop between young people and the counselor/educator. For this to happen it was necessary in this program for the counselor to become available to school-age youngsters by offering before-school pregnancy testing at home after-school meetings in youth centers and evening programs involving teens. Continuity in this type of program is crucial for changing staff upsets the building process. The approaches for bringing human sexuality programs to the schools must be varied and flexible. Additionally parents should be sought as allies for their support can provide the kind of credibility and acceptance in a community that would be hard to achieve through any other source.