Goal-free Evaluation Research Articles

Addressing causality: participatory evaluation on improvisational drama workshops for people with dementia and their carers

ABSTRACT Despite advancements in arts and health research, the processes through which arts activities contribute to wellbeing and care remain ambiguous. This study aims to shed new light on causal links surrounding the impact of improvisational drama workshops on people with dementia and their carers at care facilities, using both participatory and goal-free evaluation. The article outlines challenges and strategies in addressing causality in the arts, followed by methodology and research context. Findings are discussed framed by key considerations for arts impact: negative impacts, uniqueness of the arts, artistic quality, and long-term outcomes. We conclude that a two-layered causal process, micro and macro, contributes to meaningful impact. This perspective emphasizes learning from negative impacts, integrating artistic elements with other relevant factors through trial and error, and reassessing shared goals during implementation. Sustained efforts in this endeavor can lead to significant long-term outcomes, extending beyond individual behavioral changes to community growth.

Evaluasi Program Literasi Membaca Sekolah Dasar di SD Negeri 1 Kedungjati Menggunakan Model Goal Free Evaluation

Purpose – Based on a survey conducted by the Program for International Student Assessment (PISA) released in 2019, Indonesia is ranked 62nd out of 70 countries, placing it among the bottom 10 countries with low literacy levels. In response, the Indonesian government promoted the School Literacy Movement (GLS), a comprehensive initiative aimed at transforming schools into learning organizations where all members are literate for life, with the involvement of the community. The purpose of this study was to evaluate the reading literacy movement program at SD Negeri 1 Kedungjat.Method – This research employs a descriptive qualitative design. The study employs the Goal-Free Evaluation model, which enables researchers to evaluate the program without concentrating on its specific goals. Data collection techniques include document studies, observations, and interviews. Data analysis techniques used in this research follow the Miles and Huberman approach, which involves data collection, data reduction, data presentation, and conclusion drawing, with the data presented in descriptive text form.Findings – According to the study findings, the reading literacy movement involves instilling a 15-minute reading habit before commencing lessons. Supporting factors within this movement include a diverse range of reading materials, a conducive environment, and well-equipped libraries. The research indicates that the implementation of the reading literacy movement has been successful and has yielded positive outcomes, despite not being uniformly distributed across all classes. Research Implications – This study outlines the beneficial effects of the school literacy movement on students' reading interest, leading to an increased enthusiasm for reading. Furthermore, it demonstrates that the literacy movement enhances students' comprehension levels.

Scriven's Goal-Free Evaluation

Scriven's Goal-Free Evaluation

Pengembangan Strategi Pemasaran Syariah Daging dan Ikan Halal melalui Digital Marketing :Studi Kasus Pada PT Daya Desa Asasta

The research is aimed at developing marketing strategies for halal meat and fish through digital marketing at PT Daya Desa Asasta. Digital marketing, or digital marketing, is a set of strategies to market goods or services through digital or online media, such as the Internet, social media, search engines, email, mobile applications, and other online platforms. This research assesses what has been implemented and which digital marketing strategies have had the most or the least impact. Through this research, more objective evaluations can be obtained, which can serve as the basis for making recommendations for improvements or decision-making related to marketing through digital marketing.This type of research is qualitative, using the research evaluation method and the goal-free evaluation model by Michael Scriven. Data collection is carried out with interviews with 2 subjects involved in the company's Power Village Asasta, observation, and document study. Data analysis with Miles & Huberman thematic analysis techniques (1994). Further, the monitoring of research credibility was carried out through steps of triangulation of data from Patton (1990). The results of the research were evaluation results, namely (a) 3 digital marketing strategies used: Tokopedia, Instagram, and Whatsapp (b) 1 digital marketing strategy and 1 recommended product processing.Keywords: Digital Marketing, Sharia Marketing, Meat ,and Fish

Development of Professional Human Resources through Education Program Mobile Teacher in South Sulawesi

This study aims to find an overview of the implementation of the teacher mobilization education program in South Sulawesi in terms of the principles of human resource development and continuous professional development of teachers. The type of research used is descriptive qualitative research with the Goal Free Evaluation Model (Scriven) method. This research was conducted in South Sulawesi Province to implement the 2020-2023 teacher education program, which the Ministry of Education and Culture organized through the assistance of the South Sulawesi Teacher Mobilization Center (BBGP). Collecting research data using a questionnaire (questionnaire), observation (observation), interviews, and document study. Data analysis includes reduction, display, and conclusion drawing/verification. The results of the study show that the journey of the Teacher Mobilization Education program in South Sulawesi from 2020 to 2023 has reached the 7th (seventh) batch. The target of implementing the PGP program teachers from batch 1 to batch 7 has reached 24 districts and cities in South Sulawesi, involving 2,400 participants. In the implementation of the teacher mobilization education program in South Sulawesi, it was revealed that the 12 principles of Human Resource Development and 16 principles of Continuing Professional Development of teachers received very high responses, namely at intervals of 80% -100% or were in a very appropriate category with the Teacher Mobilization Education program in South Sulawesi or it can be said that 12 principles of natural resource development and 16 principles of PKB teachers also exist in the implementation of the Teacher Mobilization Education program in South Sulawesi.

Evaluasi Program Penguatan Pendidikan Karakter (PPK) Berdasar Model Goal Free Pada Sekolah Dasar

Character education is essential for the life of a nation. The condition of the nation's character is alarming, marked by the number of bullying in schools, promiscuity, and increasing drug cases infecting school-age children. This can threaten the integrity of the Unitary State of the Republic of Indonesia. Therefore a special strategy is needed to shape the character of the nation's young generation. Character education is carried out in schools by being integrated into various activities at school. The implementation of the PPK program needs to be evaluated to find out all the things that happened during program implementation. The evaluation research conducted is program evaluation research. The evaluation model used is a goal-free evaluation model. Michael Scrieven developed the goal-free evaluation model. This evaluation model determines the planning, implementation, analysis, and follow-up of the character education strengthening program at Gugus Teuku Umar Salatiga. The planning stage of the character education supporting program at Gugus Teuku Umar has been carried out well. The character education strengthening program has been implemented in every activity in the school. The character education strengthening program implemented at Gugus Teuku Umar has a positive impact on student behavior and student achievement.1. The planning of the character education program at Gugus Teuku Umar from the planning stage has been carried out well. 2. The character education program has been implemented well but not yet to be optimal. 3. The stages of practical examination (check) have been carried out so that the implementation of the PPK program can influence the character education program to positively impact students both on behavior and attitudes as well as learning achievement. 4. 5. There has been a follow-up to implementing the PPK program in schools. This was done based on the results of the analysis. Programs with positive impacts will undoubtedly continue their implementation. Programs with more negative side effects will be updated or replaced with other programs.

Evaluation of teacher performance in post-certification classroom action research at the vocational school

The purpose of this study was to assess teacher performance in classroom action research at SMK N 2 Sungai Penuh after certification using the goal free evaluation model. Teacher performance in classroom action research aims to improve the quality of Indonesian education, one of which is through educator-certified teachers who have professional competence by conducting classroom action research. Evaluation of attachment to the positive, negative, and side (neutral) impacts of the post-certification program. The research subjects were teachers who were certified educators and taught for about ten years, totaling 56 people. He research method is qualitative. Data collection techniques using questionnaires, interviews, documentation and observation. The results of the research show that the certification program in improving the welfare of economic teachers has been successful but not in improving teacher performance in classroom action research. The negative impacts that arise must be considered and corrected so as not to disrupt the stability of an already good program.

Evaluation of the Scout Extracurricular Program to Improve the Character of Elementary School Students

The low character possessed by students causes a decline in ethics and morals among students. So efforts are needed to be able to improve the character possessed by students. The purpose of this study was to evaluate the achievement of the goals of the cub scout extracurricular program. This research is a qualitative descriptive study, and its evaluation uses the goal-free evaluation model. The research subjects were school principals, cub masters, scout trainers, and 58 extracurricular participants. Observations, interviews, and documentation studies are the data collection techniques used in this study. Data analysis techniques were carried out in four stages, starting from 1) data collection, 2) data reduction, 3) data presentation, and 4) conclusion. The data validity in this study used technique and source triangulation. The results showed that the scout extracurricular improved students' character because character education was implemented in the content. Still, the purpose of the scout extracurricular program had not been achieved 100%. So it is hoped that these extracurricular activities will be carried out more intensively to have a positive impact, especially in shaping and developing student character.

The The Impact of the Heutagogy Approach on Responsibilities for Online Learning in Statistics Courses

This study aims to determine: (1) learning responsibilities and; (2) positive, negative and accompaniment impacts that occur after learning statistics using the heutagogy approach. This study uses an impact evaluation method with a goal free evaluation model. The population of this study was 104 students who took the Statistics course in the Odd Semester 2020. The sample was selected using a systematic technique as many as 82 students. The research data were collected from grades and assignments documents, interviews and learning responsibility questionnaires. The quality of the instrument was controlled using item validity and reliability with a halving technique. The validity of the qualitative data was controlled by means of document triangulation and interviews. The results showed: (1) the highest learning responsibility was in the learning effort, followed by discipline, independence, motivation and honesty; (2) the positive impact is felt by students in the upper group because they are more successful in learning anytime and anywhere, the negative impact is felt by the lower group because it opens up opportunities to look for examples of friends' answers. The impact of the accompaniment is that there is cooperation in the face of difficulties

Legal Capacity of Non-COVID Patients in Human Rights Enforcement in Indonesia

The Covid-19 pandemic has brought many changes in people's living order in Indonesia. In this case, the health sector and hospitals as facilities and infrastructure of health facilities organizers have many challenges so as not to become the main victims in the spread of this pandemic. However, one of the less fortunate cases was the death of pregnant women due to the hospital's negligence in handling the first childbirth during the Covid-19 pandemic. This study aims to further examine the extent to which it is regulated in the legal system in Indonesia, the main responsible strategies and institutions, as well as other aspects that can be found in the confusion of the problem. Researchers used the Goal-Free Evaluation Framework as an independent form of the goals to be achieved in the Human Rights Act and looked at the other side to be found during the evaluation of the issue of Human Rights violations. The result is that human rights have been regulated from the acceptance of health services by the public and employment laws of the medical team and hospital strategies listed in the Service Operational Standards but have not been fully implemented. Furthermore, it is the responsibility of the local government in minimizing the occurrence of human rights violations as the institution that is most attached to the community despite the national Human Rights Commission in charge of further reviewing the issue, especially after the findings are found and other factors arising from the case.

Professionalism of Civics Teachers Facing Educational Challenges in the Era of the Covid-19 Pandemic

The COVID-19 pandemic is clearly a threat to human life in various parts of the world. Government with community support is considered important to make policies to prevent the spread of COVID-19 in the community. Especially in the world of education, teachers as professional staff are still required in carrying out teaching and learning activities, therefore this research aims to explore and identify the professional competence of Civics teachers in general, and describe how Civics teachers continue to carry out the teaching -learning process and carry out their duties simultaneously to get information on the constraints and professionalism of Civics teachers in the presence of a COVID-19 pandemic. This study was included in the Evaluation study and the model chosen was the Goal-Free Evaluation Model using a qualitative approach which was library research used to obtain information on the constraints and consequences of the COVID-19 pandemic towards teaching and learning activities that enforced from home. The results of this study are that there are several obstacles that threaten the level of professionalism of Civics teachers to decline because they are required to master technology in such a way as to support the learning process that is in accordance with the material and applicable rules.

Leadership development outcomes research and the need for a time-sensitive approach

ABSTRACT Many leadership development studies consider developing leadership as a dynamic process that takes time. However, few evaluative inquiries examine the effects of time on leadership development outcomes. As the concept of time has begun to receive the attention it deserves in leadership research, we present a case for including temporal dimensions in leadership development outcomes research. We review conceptual evaluation frameworks and published empirical evaluations in order to highlight the fact that scholars have paid scant attention to time-related considerations in programme evaluation. By using a goal-free evaluation of healthcare leadership development programme as a case example, we illustrate six types of outcomes such as a symbol, rejuvenation, discovery, change, engagement and transformation and reveal their different temporal dimensions. Based on the findings, we argue that, for evaluations to be rigorous and more meaningful to key stakeholders, adopting a time-sensitive approach may be critical.

What, How, and Why? A Comparative Analysis of 12 Goal-Free Evaluations


 
 
 
 Background: Goal-free evaluation (GFE) is any evaluation in which the evaluator conducts the evaluation without reference to predetermined goals or objectives. 
 
 Purpose: The purpose of this study is to examine GFE in actual practice focusing on what GFE is, how it is conducted, and why the evaluators use it.
 
 Setting: Not applicable.
 
 Intervention: Not applicable.
 
 Research Design: Document analysis.
 
 
 Data Collection and Analysis: The researcher collected data from a non-random sample of 12 cases of GFE found in published and non-published papers, reports, and guidebooks. The researcher analyzed the documents using quantitative and qualitative content analysis.
 
 Findings: The findings suggest that goal-free evaluators consider GFE an outcome evaluation that supplements GBE. These goal-free evaluators typically used an ex post facto evaluation design, non-random sampling of stakeholders, and semi-structured interviewing to collect data. The evaluators described using GFE to improve the evaluand, to find side-effects, and to evaluate highly complex evaluands.
 
 
 
 

Evaluation of the implementation of workshop and laboratory management on vocational high school

This research aims to reveal: the development of workshop and laboratory management implementation, also the suitability of facilities and infrastructure on Vocational High School in Banggai District, which refers to the indicator of good workshop and laboratory, according to the Directorate of Vocational Education. This research is evaluation research, which employs a goal free evaluation model and descriptive quantitative approach. The research sample involved in this study was 187 teachers and students. The data analysis technique used in this research was the average score and skewness. The result of this research shows that: (1) The workshop development is appropriate enough and good, yet it still needs further improvement with students to score at 81.19 and -0.229 also the teachers at 197.78 and -0.433. (2) The laboratory development is appropriate enough, and it still needs further improvement with students to score at 96.64 and 0.393, also the teachers at 209.03 and 0.36. (3) The suitability of the workshop’s facilities and infrastructure is appropriate enough, and it still needs further improvement with the score at 250.205 and 0.549, and also the laboratory is appropriate enough and good, yet it still needs further improvement with the score at 252.80 and -1.694.

Evaluasi Program Penguatan Pendidikan Karakter Terintegrasi Mata Pelajaran Matematika di SMP Negeri

This study aims to determine the implementation, influence, and factors affecting the implementation of the program in SMP Negeri 2 Waingapu. This research type is evaluative research by using a qualitative method. The evaluation program model used is a goal-free evaluation model. Interviews, observations, and document studies are techniques used for data collection. Data validity test is done with triangulation, technique and data source triangulation. The results showed that 1) the implementation of character education program in SMP Negeri 2 Waingapu has not been optimal yet, either in terms of planning, implementation or evaluation; 2) the effect of the program on integrating character values in Mathematics is positive on student achievement and behavior but also negative on teacher workload; 3) factors which affect the program are: facilities and infrastructures, information access, teachers, students.

Evaluation of beauty training programs in regional work training center of East Jakarta using the goal free evaluation model

This study aims to determine the impact of the beauty training program in PPKD of East Jakarta on students. The impact can be seen based on three criteria, namely positive impacts according to program objectives, positive impacts outside the program objectives (side effects), and negative impacts outside the program objectives. The research method used in this study is an evaluative study using the Goal Free Evaluation model. The research subjects consisted of: managers, instructors, and beauty training participants in PPKD of East Jakarta . Data was collected using observation, interviews, and documentation. The results showed that (1) the positive impact according to the program objectives was felt by almost all training participants, namely they could increase their knowledge and skills in the field of beauty and were ready to enter the workforce, (2) a positive impact outside the program objectives freelance work as a makeup artist, having confidence in work, and daring to open a business in the field of beauty, and (3) negative impacts outside the program's objectives felt by a small number of training participants who were less serious and less focused on training that they could not accept the material taught so that they are not ready to enter the workforce.

Evaluasi Program Regrouping Sekolah Dasar Negeri

This research is an evaluation that aimed to know the process of implementation policy, factors that effected regrouping school program, the effects of regrouping, and how the effectiveness and efficiency of the regrouping program in SD Negeri Tukang 01 and 02, Pabelan, Semarang. This evaluation research used goal-free evaluation with the subject is SD Negeri Tukang 01 and 02 Pabelan. The collecting data used interview, observation, and documentation, then the data analysis was data reduction, data presentation, and drawing the conclusion. The result of this research showed that SD Negeri Tukang 01 and 02 already grouped for 4 years before the Regent's letter published. Then, the students, teachers, government’s rule, and school condition be the factors affected the regrouping program. This regrouping program has several impacts, they answered the teacher need and/or there was a teacher mutation. Then for students, there weren’t much effect because the students already friends, and then increasing the school’s facility. Besides that, regrouping program might increase school quality and the society would not be confused to choose the school for their child. But then, the alumni of these school can be difficult to get legalize for their certificate. This regrouping program is effective and efficient enough to do because the teacher problem can be solved, then the school facility can be maximized and about the budgeting organize by the main school.

IMPACT OF CHARACTER EDUCATION IMPLEMENTATION: A GOAL-FREE EVALUATION

Many studies reported the importance of character education for students to support their future success. Currently, the countries have strengthened the implementation of character education in their educational system, including Indonesia. Related to the previous statements, this research aimed to describe the impact of character education implementation as well as challenges and strategies of teachers in implementing the character education. This research was an evaluation research type using a goal-free evaluation model (impact evaluation) with a qualitative approach. The participants of the research were principals, teachers, students, parents, and community members from three provinces in Indonesia; East Kalimantan, Special Region of Yogyakarta, and West Nusa Tenggara. Data were collected through Focus Group Discussion (FGD) and also in-depth interviews. The data were then analysed using a model of Bogdan and Biklen to find out the refinement among themes and generate a detailed understanding. The findings showed that character education had a positive impact on increasing the students’ character values including religiosity, personality, social attitude, and competitive attitude. Role-modelling by teachers and other members of the school community and parents, character-oriented activities, and moral and material support from educational stakeholders are key factors in character education implementation. However, some improvements need to be made, such as improving the teacher training and workshops and giving financial support (funding) for character education implementation. Keywords: character education, character value, goal-free evaluation, impact evaluation.

ANALISIS KOMPETENSI MENGAJAR GURU SERTIFIKASI (PROFESIONAL) SEBAGAI DASAR PENINGKATAN KOMPETENSI MENGAJAR GURU IPA PADA SMP NEGERI DI KABUPATEN ACEH BESAR

The purpose of this study is to describe the performance of professional teachers (post-certification) after obtaining a certificate of professional educators as well as allowances. The main competencies of professional teachers can be assessed by 6 capabilities, including the ability to implement the lesson, create modules and instructional media, preparation of RPP, personal and social competence, liveliness in academic organization and academic achievement development capability. This study is a model study of the Goal-Free Evaluation Model. The study population is all teachers of SMP who have passed the certification in Aceh Besar District. Sampling is done purposive sampling to teachers of science lessons in Secondary Schools in Aceh Besar District. Headmaster Principals are also involved to assess teachers' performance on the aspects of instructional administration. Data were collected using questionnaire, then analyzed using quantitative and qualitative descriptive technique. The results showed from 6 Aspects of assessment, four aspects of them are learning ability, modules and learning media, preparation of RPP, personal and social competence have shown high performance. However two others namely liveliness in professional organizations and the development of academic achievement, still in low performance. Hopefully these results can be input for the Office of Education of Aceh Besar Regency as a basic material for improving the quality of education in terms of improving the performance of Professional Teachers in Aceh Besar Regency.

「ゴール・フリー評価」(goal-free evaluation)の方法論的検討 : カリキュラム評価の質的な客観性を確保する視点を中心に

「ゴール・フリー評価」(goal-free evaluation)の方法論的検討 : カリキュラム評価の質的な客観性を確保する視点を中心に