Context, Input, Process, Product Research Articles

Enhancing Quality of Guidance and Counseling in Vocational Schools: Testing the Effectiveness of Evaluation Instruments Based on the CIPP Model

<p dir="ltr"><span>This study assesses the CIPP (Context, Input, Process, Product) model's effectiveness in evaluating guidance and counseling programs within the Merdeka curriculum of Vocational High Schools. Collaborating with three experts—guidance and counseling specialists, educational technology experts, and practitioner teachers—the research employs assessment tests and pre-test/post-test questionnaires for 10 Guidance and Counseling Teachers at Vocational High School 3 Banjarmasin. Evaluation results, covering general, specific, and material aspects, show a high level of agreement among the three evaluators. General evaluation exhibits high reliability (ICC = 0.750), and thorough and material evaluations demonstrate high reliability with ICC values of 0.794 each. The trial of 10 Guidance and Counseling Teachers reveals a significant improvement in their evaluation skills after implementing the CIPP model. Average post-test results are notably higher than pre-test, highlighting the positive impact of the CIPP evaluation model on enhancing these skills. The research concludes that the CIPP evaluation model is reliable and consistent in measuring guidance and counseling program effectiveness in the Merdeka curriculum of Vocational High Schools. Empirical and theoretical support establishes a strong foundation for considering future implementation of the CIPP model in educational program evaluations. This model's application is anticipated to elevate the quality and relevance of educational programs, particularly in the context of guidance and counseling in Vocational High Schools, with potential practical and managerial benefits.</span></p><div><span><br /></span></div>

Validity and Reliability of Child-Friendly School Policy Evaluation Instruments in Primary Schools: Confirmatory Factor Analysis

<p style="text-align:justify">Evaluation of child-friendly school (CFS) policies is essential to determine the achievements of school efforts in reducing violence cases. This research aims to proving the reliability and validity of CFS policy evaluation instruments in elementary schools with different locations. This investigation uses the Context Input Process Product (CIPP) evaluation model to confirm the factor structure or dimensions of several observed variables (items) to evaluate the reliability and validity of the CFS policy evaluation tool in elementary schools. The validity and reliability of previously created instruments are evaluated quantitatively, but this study utilises different subjects and study sites. There were 320 respondents, with 145 school principals and 175 teachers taken randomly. Confirmatory factors analysis (CFA) results show goodness of fit (GOF), and the model is acceptable. The CFS evaluation instrument can be accepted after eliminating several question items and modifying them. All items of the teal instrument meet the goodness of fit criteria in terms of chi-square and root mean square error of approximation (RMSEA). The instrument for evaluating CFS policies in primary schools using the CIPP model has met a valid and reliable psychometric property test so that it can be applied.</p>

Context input process product evaluation of hybrid learning practices in Indonesian universities

<span lang="EN-US">The transformation of post-pandemic learning at Indonesian universities is becoming increasingly diverse. Several universities use hybrid learning models to implement hybrid learning practices. The purpose of this study is to assess the hybrid learning process at two Indonesian universities. The context input process product (CIPP) evaluation model is used in this study as part of a mixed method. Quantitative methods are used to get an overview of student and lecturer responses, whereas qualitative methods are used to dig deeper into data about hybrid learning practices. This study included 341 students and 22 lecturers from both universities. Techniques for collecting data include questionnaires, interviews, observation, and documentation studies. The data was analyzed using learning theories. The study’s findings indicate that hybrid learning practices are performing well. The readiness of university infrastructure, as well as the readiness of students and lecturers, determines the success of hybrid learning implementation. In practice, however, some lecturers tend to use face-to-face or online learning practices exclusively to fill gaps in the hybrid learning process. This study suggests that universities investigate an effective model for implementing hybrid learning.</span>

Evaluasi Efektivitas Manajemen Pembiayaan Pendidikan Menggunakan Model CIPP di Sekolah Menengah Atas Swasta

Education is one of the main pillars in sustainable national development. Effective financial management in schools is crucial to ensuring the quality of education, especially in private schools that often face challenges in managing resources. This study aims to evaluate the effectiveness of educational financial management at SMA PGRI Rancaekek using the Context, Input, Process, Product (CIPP) model. The research methodology is descriptive quantitative, with data collected through observations, questionnaires, and interviews with 50 purposively selected respondents. The findings reveal that the "Process" category achieved the highest score (82.10%), while the "Context" category had the lowest score (74.43%). These results indicate that although the financial management implementation is functioning well, external support and policy frameworks still need improvement. This research contributes to the educational management literature by offering new insights into the application of the CIPP model in private schools. The implications of this study include recommendations for enhancing policies and financial management practices in other private schools, which could ultimately strengthen the overall quality of education.

CIPP모형에 기반한 교육복지정책의 성과평가

Objectives This study aims to assess the effectiveness of educational welfare projects and suggest strategies for enhancing educational welfare policies.
 Methods The study employed the CIPP (Context, Input, Process, Product) evaluation model to evaluate the op-erational procedures and outcomes of educational welfare projects.
 Results The evaluation covered various aspects, including local government support, schools, student involve-ment, public relations, networks, material and human resources, program planning and implementation, intra- and inter-school collaboration, program content, case management, network effectiveness, student progress, and overall satisfaction.
 Conclusions The study's findings offer a comprehensive insight into the performance and potential areas for en-hancement in educational welfare projects. The conclusions and recommendations provide essential insights for developing educational welfare policies.

Evaluation Of The Process Of Implementing Pjok Learning In Agribusiness SMK In Bengkulu City Using The Cipp Model

This study aims to evaluate the learning process of physical education in SMK Agribusiness Bengkulu City, which includes: (1) Context: the relevance of physical education learning materials with KTSP; (2) Input: teacher background and physical education facilities and infrastructure; (3) Process: implementation of physical education learning; and (4) Product: Students' learning achievement. This research method is an evaluation research using the CIPP (Context, Input, Process, Product) model developed by Stufflebeam (1985) using a qualitative descriptive approach. The research subjects included 1 physical education teacher and 75 students. This research was conducted at SMK Agribusiness Bengkulu City. Data collection was done by documentation, observation, and interview. Qualitative data were analyzed with descriptive techniques. The validity of the research instrument was carried out using excel. The results showed:(1) based on the results of the Context evaluation, the learning materials used are relevant to KTSP, but there are several policies from teachers related to school limitations; (2) the results of the input evaluation show that the teaching teacher's educational background is Bachelor of Education (S1) majoring in Sports Education with 4 years of teaching experience, while the suitability of PE facilities and infrastructure shows a level of suitability of 69.23% including the good category; (3) the results of the process evaluation which includes the implementation of physical education learning in the good category; (4) product evaluation, namely student learning achievement in the good category.

Evaluation of training workshop curriculums for gifted and talented students

One of the critical points that can determine the future of a country is the education of the gifted and specially talented children there. Many civilizations from past to present have attached importance to this education. The aim of this study is to evaluate the educational workshop curriculums applied for gifted children according to the Context-Input-Process-Product (CIPP) model. For this purpose, a research was carried out with six teachers, a psychologist, an education coordinator and two administrators working as practitioners in the workshop training curriculums for the gifted students implemented in the 1st semester of the 2019-2020 academic year. In the study, semi-structured interviews according to CIPP steps were collected by interviewing the participants one-to-one for 8 weeks within a 16-week training curriculum. According to the findings obtained; The quality of education given to gifted children should be increased. In addition, it was seen that it was necessary to systematically examine the opinions expressed by the curriculum practitioners and to make the necessary changes to the curriculum in a planned manner. In the light of these findings, about workshop training curriculums; increasing the adequacy of the physical environment, disseminating studies on creative thinking skills, opening different trainings for all areas of development and ensuring that children can participate in the areas they want have been achieved. The strengths and weaknesses of the implemented curriculum will be revealed, allowing its practitioners to create a more efficient training system.

Optimizing marketing learning evaluation: Gamification with CIPP model at SMKN 1 Bandung

In this digital era, education is experiencing rapid growth, especially in the diversity of evaluations given to students, one of which is through gamification. This article explores optimizing learning evaluation through gamification in the CIPP (Context, Input, Process, Product) evaluation model in marketing education at SMKN 1 Bandung. The method used is descriptive quantitative research. Data collection is done through questionnaires and interviews. The data sources and subjects in this study are educators in the marketing subject at SMKN 1 Bandung and students majoring in Online Business and Marketing at SMKN 1 Bandung, with the object being the evaluation of marketing learning with the implementation of gamification in the CIPP model. The results of this study indicate that the learning evaluation process with gamification is well-received by students at SMKN 1 Bandung. Applying gamification in learning evaluation using the CIPP model enhances students' learning outcomes and creates a responsive, adaptive, and collaborative learning environment.

Literature Review Evaluation of Fieldwork Practice Programs in Vocational High Schools in Indonesia

In an effort to maintain and improve the quality of Vocational High School (SMK) graduates and reduce misses from the demands of the industrial world and technological advances, the government has tried to implement various policies both in terms of quantity and quality. The activities of students in an effort to increase skill competence are through Field Work Practice (PKL) activities that involve the world of work directly. But in fact, according to nationwide data from the Central Statistics Agency (BPS), in February 2023, unemployment for vocational school graduates reached 9.6%, which is the largest of the overall levels of education in Indonesia. This literature review provides a summary of the results of the PKL program evaluation by applying the Context, Input, Process, Product (CIPP) evaluation model. The results of this study prove that the program is running in accordance with the objectives with good output. However, there needs to be careful preparation and seriousness from schools and learners.

Optimization Of CIPP Evaluation Model as An Escalation of Educational-Industrial Collaboration Program

The importance of industrial and vocational collaboration in producing competent graduates is evident. However, there are still issues with the collaboration between industry and educational institutions, including the lack of appropriateness in the collaboration, the mismatch between student competencies in vocations and industry requirements, and inadequate alignment of graduate outcomes with industry needs. This research aims to explore the differing perspectives of universities, vocational schools, and industries in West Sumatra, Bandung, and Malang on the formation of CIPP components. Additionally, it seeks to reveal the direct and indirect influences between CIPP components—context, input, process, and product—to enhance the quality of cooperation and collaboration between industry and universities in Indonesia. The research employs a mixed-method approach, combining quantitative and qualitative methods. The samples include vocational schools, involving teachers and leaders, and universities, involving lecturers and leaders in West Sumatra, Bandung, and Malang. The research instruments consist of a questionnaire and an interview guide. Both qualitative and quantitative data analysis techniques are applied, including descriptive analysis, difference tests using two-way ANOVA, and factor analysis tests using the SMART PLS application. Based on the findings, it is concluded that the evaluation results encompass the Context, Input, Process, Product (CIPP) variables in an ideal vocational school-university-industry collaboration model. The results indicate a direct and indirect positive influence between CIPP components. However, the evaluation results also highlight existing problems, necessitating improvements. This research contributes by providing recommendations for the collaboration program to enhance input capacity and generate relevant outcomes. In terms of input, the value is classified as very good, emphasizing the need for improvement in the dimensions of the context components, especially the competency environment, stakeholders, and policies that support optimal cooperation. Recommendations in the product section aim to increase student competency achievement.

A Decision-oriented Approach to Evaluating a Leadership Curriculum in Fellowship.

Graduate Medical Education (GME) emphasizes the role of the annual program evaluation to identify opportunities, create action plans, and track improvements longitudinally. There is a lack of a systematic approach to the evaluation of educational curricula. Comprehensive curriculum evaluation can inform the educators about specific modifications to achieve high standards, desired outcomes, and the anticipated objectives. To evaluate a leadership in quality improvement program in a pulmonary/critical care fellowship training program using the context, input, process, product (CIPP) model. The CIPP model, given its focus on evaluating different aspects of a program, provides concrete and targeted feedback to guide improvement decisions. Evaluation questions addressing the four focused areas were created, pilot tested, and revised. The questions were framed toward optimization of alignment (e.g., program activities with stated objectives, program goals with theoretical perspective, program curriculum with trainee needs) and gaining information about the efficacy of the program in achieving the desired outcomes. To enhance the validity of the results, we triangulated the data-gathering approach by administering surveys and conducting interviews and focus groups by random selection from the eligible participants. Qualitative data were transcribed, coded, and categorized into themes aligning with the four aspects of the CIPP model. We interviewed 9 participants and conducted three focus groups with 20 participants. The surveys provided vital quantitative information that was cross-verified with the qualitative data; 23 of the 25 (92%) participants completed the survey. The results of qualitative thematic analysis were organized in the CIPP format. The context evaluation of the program revealed that the fellows and faculty were unfamiliar with the guiding principles of the course. The input evaluation highlighted the competing interests that hampered the engagement of the fellows during the evening weekly report-outs. The process evaluation revealed clustering of didactic sessions at the start of the course. The product evaluation stressed the difficulty in completing the quality improvement projects in the allotted timeframe. Conducting a robust evaluation of an educational curriculum provides insights into gaps in the various stages of the program. Time and resources needed for conducting evaluation by using the CIPP model should be considered.

Evaluating the educational program of bachelor of science in healthcare management using CIPP model: A case study at Yazd University of Medical Sciences

Background: It is necessary to evaluate the program to measure and maintain its quality during implementation. This study aimed to evaluate the Bachelor of Healthcare Management educational program at Yazd University of Medical Sciences using the CIPP (Context, Input, Process, Product) evaluation model. Methods: This descriptive-cross-sectional study was conducted at Yazd University of Medical Sciences in 2023, with the participation of 8 faculty members, 95 students, and 327 graduates. Three questionnaires, encompassing four dimensions and nine domains, were used as data collection tools. The data were analyzed using the SPSS software (version 27), employing the ANOVA test and descriptive statistics. Results: In terms of context, input, process, and product, the overall scores for the educational program of the course were 3.03, 2.96, 3.06, and 2.99, respectively. Concerning the overall score across all dimensions, faculty members scored higher than students, and a statistically significant difference was observed between the overall scores of faculty members and students. A significant correlation was found among the dimensions investigated. In general, this training course was evaluated at a relatively favorable level. Conclusion: Given the course’s low score in the ‘appropriateness of curricula with approved topics’ section, it is feasible to increase the program’s overall desirability by implementing some modifications in the course topics and accentuating the students’ skill development.

Extensiveness of Securing Education for Visually Challenged Pupils Project on Improving Pedagogical Skills among Teachers for Visual Learning in Classrooms at Moivaro and Arusha Primary Schools, Tanzania

This study evaluated the extensiveness of the Securing Education for Visual Challenged Pupils Project on improving teachers’ pedagogical skills to help pupils with visual disturbances in classrooms in Moivaro and Arusha Primary schools in Tanzania. The summative evaluation study employed a convergent design under a mixed-method research approach guided by the Context Input Process Product evaluation model. The target population of the study was 1045. The probability and non-probability techniques were employed to select 131 respondents. Interview and observation guides were used to collect qualitative data, whereas questionnaires were used to collect quantitative data. The validation of data collection instruments was ensured by research experts. The reliability of qualitative data collection was established through triangulation. Quantitative data were analysed descriptively with the aid of SPSS version 22 by using means, frequencies, and percentages. Quantitative data was analysed thematically. The study found that securing education projects to a high extent improved pedagogical skills among teachers at Moivaro and Arusha primary schools. The study concluded that the project had successively achieved its goal of improving teachers' pedagogical skills. The study recommended that teachers should get regular, continuous professional development courses to improve their pedagogical skills in supporting pupils with visual challenges.

Study Analysis: Learning Pattern of Blind Children Using Aid Applications for Science Learning

Use of technology for learning for blind children. One of the main gaps is the availability and accessibility of this technology in the school environment. Not all schools have adequate infrastructure or financial support to implement technology effectively. This research uses a descriptive qualitative approach with triangulation techniques in data collection to provide an in-depth description of the learning process evaluation for blind students at SLB 1 Makassar. The data collection technique involved four blind students and four teachers who were also blind, selected through purposive sampling. The Context, Input, Process, Product (CIPP) approach developed by Stufflebeam was used as the framework. This research focuses specifically on evaluating the learning process. Unique dynamics in the blind class at SLB 1 Makassar, where teachers and students face blind disabilities. The presence of teachers who are also blind, especially those with total blindness, creates a learning environment full of empathy and mutual understanding. The Be My Eyes, Voice Dream Reader, and Blind Square applications contribute significantly to the inclusive education of blind children at SLB 1 Makassar. With the help of this application, it is possible to increase the independence of blind children in learning, especially science learning.

Evaluation Study of Distance Learning Program for Indonesian Migrant Children Using Context, Input, Process, Product (CIPP) Method in Indonesian School of Kota Kinabalu

The Distance Open Learning (TJJ) program is an education program that offers ease of learning by utilizing information and communication technology (ICT). This TJJ program aims to expand and facilitate access to education for children of Indonesian migrant workers (PMI) in Sabah who are constrained and unable to get education through regular program Indonesian School of Kota Kinabalu. This research aims to evaluate the implementation of the TJJ Program at Indonesian School of Kota Kinabalu (SIKK) using the CIPP (Context, Input, Process, Product) research model. This research uses qualitative and quantitative approaches with an evaluation study method. Respondents in this research amounted to 113 students. The results of the evaluation of the SMA TJJ SIKK program based on the evaluation of a) Context, has the ability to implement programs with goals in line with the vision and mission of the school, but still needs improvement so that the program targets can be achieved as a whole b) Input, needs attention to learning models, costs and other supporters to be better and more appropriate, c) Process, needs improvement in terms of learning technology, interactive materials and communication media used, d) Product, the results of the program are in accordance with the objectives to be achieved, namely increasing the ability and opportunity to access education for PMI children.

Evaluation of the Anti-Corruption Education Policy within the Civil Servant Apparatus (ASN) in the Central Java Province

This study aims to assess the alignment and precision of policy formulation, the quality of policy implementation, the policy's suitability, and the effectiveness of the anti-corruption education program for civil servants (ASN) established through Governor Regulation No. 10/2019 in Central Java. This research employed a qualitative research design with a descriptive approach. The subjects of the study consisted of 23 participants, including five structural and functional officials from the Central Java Regional Training and Education Center (BPSDMD), six trainers from BPSDMD, two anti-corruption instructors from the Inspectorate of Central Java Province, and ten training participants at BPSDMD in Central Java. The data for this study comprised primary data obtained from interviews and secondary data including journals, books, and articles. The evaluation uses the Context, Input, Process, Product (CIPP) evaluation model. Data collection techniques involved in-depth interviews and documentation, collecting data such as interview transcripts and documents related to anti-corruption education from BPSDMD in Central Java. The research findings indicate that there is alignment and precision in the formulation of the anti-corruption education policy for civil servants as stipulated in Governor Regulation No. 10/2019, and the policy has achieved its intended goals. The anti-corruption education policy has demonstrated quality, and there is congruence between the policy and its implementation environment. The anti-corruption program for civil servants in Central Java has been effective. Recommendations for improvement include the need for annual program updates to maximize evaluation improvements, more extensive anti-corruption education, the establishment of Integrity Seeds within each local government organization, and the necessity for more intensive collaboration between BPSDMD, the Inspectorate, the Central Java Anti-Corruption Educator Community, and the Corruption Eradication Commission (KPK).

Program Evaluation of the Student Sports Education Center (PPLP) for West Sumatra Province Football

The problem in this study is the weak support and attention to coaching the West Sumatra PPLP football branch, still less than expected is still not optimal. So that the expected achievements and coaching of PPLP football have not been achieved. The purpose of this study was to evaluate the coaching and training program of PPLP for West Sumatra football. The method in this study uses a qualitative descriptive approach using the CIPP (Context, Input, Process, Product) method. This research data was obtained through observation, interviews and documentation. The results of the study were found in terms of context that the coaching process and also the training program process that had been implemented were in accordance with what was expected to have run with the vision and mission. In terms of input, it is still not maximal, it can be seen that the athlete rerukmen still does not involve psychologists and sports doctors, facilities and infrastructure are still not optimal, and the funds / budget allocated have run according to the rules but are still not optimal. Process Aspect in program implementation Evaluation and minotoring activities are running and carried out well, the implementation of the training program has gone well as expected, Communication / socialization of the program with athletes is quite maximal. In terms of Product achievement target West Sumatra Football The achievement of West Sumatra pplp athletes in the sport of football has reached the target and is optimal in coaching efforts and also the breeding of athletes can be seen the achievements that have been achieved by west Sumatra pplp football athletes.

PROGRAM EVALUATION IN OPEN AND DISTANCE LEARNING: THE CASE OF OPEN EDUCATION SYSTEM CALL CENTER SERVICES ASSOCIATE DEGREE PROGRAM

In this study, it is aimed to evaluate Anadolu University Open Education Faculty Call Center Services Associate Degree Program, which is carried out through open and distance education, according to learner views within the framework of Stufflebeam’s Context, Input, Process, Product (CIPP) Evaluation Model and to make suggestions for the development of the program. In the study in which Exploratory Sequential design, one of the mixed method research designs, was used; “Anadolu University Call Center Services Associate Degree Program Evaluation Questionnaire” was prepared to collect quantitative data. The questionnaire was applied online to learners who graduated from Anadolu University Open Education Faculty Call Center Services Associate Degree Program. Semi-structured interview questions were used to collect qualitative data. In the interpretation of quantitative data, percentage and frequency tables, mean and standard deviation values were used to compare and interpret the average score that can be obtained in the four dimensions (Context, Input, Process and Product) in the measurement tool and the average scores of the participants in these dimensions. In addition, the mean score values obtained in the sub-dimensions were analyzed and interpreted in terms of gender, age, marital status and employment status variables. Descriptive analysis method was used to analyze the qualitative data. The results revealed that the program objectives were determined in accordance with the expectations of the learners, learning resources were designed in accordance with the objectives, learning activities were carried out in accordance with the expectations of the participants and learning outcomes were achieved in the program.

Vitamin A Program for Giving Toddlers in Posyandu Neighborhoods Ledeng with CIPP Model

This study aims to evaluate the facilities of the Posyandu (Integrated Health Service Post) in the vitamin A supplementation program for toddlers at Posyandu Ledeng. The vitamin A supplementation program at Posyandu Ledeng was evaluated using the CIPP (Context, Input, Process, Product) model to assess the program's context, resources utilized, program implementation, and achieved outcomes. The evaluation results showed that although the vitamin A supplementation program was implemented successfully, there are still deficiencies in the available facilities. The measuring equipment for body weight and height and the storage facilities for vitamin A are inadequate, and there is a need to replenish the vitamin A stock. These facility shortcomings can impact the program's effectiveness and the quality of healthcare services at Posyandu Ledeng. Therefore, it is necessary to update and improve the facilities and inventory management to enhance the effectiveness of this program, ensuring its sustainability and success in providing vitamin A supplementation to toddlers at Posyandu Ledeng.

Evaluation of the Stunting Program at the Margototo Health Center, Lampung East District

Stunting is a condition of failure to thrive in children under five due to chronic malnutrition, especially in the first 1,000 days of life. Stunting can affect brain growth and development. Children with stunting have a greater risk of suffering from chronic diseases in adulthood. This study aims to analyze the evaluation of the implementation of the stunting program at the Margototo Health Center, East Lampung Regency. This research is a program evaluation research using a mixed method (Mix Method) with a sequential explanatory design where quantitative data analysis is carried out at the initial stage, then qualitative data analysis is carried out. The program evaluation method uses the context-input-process-product (CIPP) evaluation model. Results study shows that in terms of context, the stunting program has been implemented according to the planned objectives and is right on target. In the input aspect, namely the lack of human resources in assisting, the lack of a budget that supports program implementation. In the process aspect of program implementation, there were no significant obstacles, and the process of implementing the stunting program went according to plan. In the product/output aspect, the stunting program has reached the expected target indicators, and recording and reporting have been going well. And the results of the implementation of the stunting program are shown by the results of mothers' knowledge about stunting and the attitudes of mothers who have stunted toddlers towards stunting events.