Product Evaluation Model Research Articles

EVALUATING ENGLISH PRE-SERVICE TEACHER PROFESSIONAL EDUCATION PROGRAM IMPLEMENTATION

The English Pre-Service Teacher Professional Education Program is a breakthrough established by the Indonesian government to produce certified professional English teachers who are trained to teach at the elementary, secondary, and preschool levels. This study aims to evaluate the implementation of the English Pre-Service Teacher Professional Education Program (PPG) at Sanata Dharma University using a Context, Input, Process, Product (CIPP) evaluation model. By evaluating and identifying the advantages and disadvantages of the current English Pre-Service Teacher Professional Education Program, this study would provide a framework that would improve the standard of English Pre-Service Teacher Professional Education Program implementation at Sanata Dharma University. This study employed mixed methods. The study participants were 30 English pre-service teachers enrolled in the English Pre-Service Teacher Professional Education Program in the English Department at Sanata Dharma University. A focus-group interview, an open-ended questionnaire, and a CIPP survey were used to collect data for this study which was conducted during the implementation of the English Pre-Service Teacher Professional Education Program. It is expected that utilizing the CIPP Model as a decision-making tool can help Sanata Dharma University improve the efficacy of the English Pre-Service PPG implementation.

Evaluation of a basic-clinical integrated pharmacology case-based learning program from a student perspective using the CIPP model.

This study aimed to systematically evaluate the effectiveness of case-based learning (CBL) within a basic-clinical integrated educational program using the Context, Input, Process, and Product (CIPP) evaluation model. The CBL program was integrated into the Pharmacology-Clinical Case Practice component of the pharmacology course, a mandatory course for first-year medical students. To evaluate the program, a CIPP model-based questionnaire was developed, assessing needs, goals, resources, educational management, and outcomes. To ensure the reliability and validity of the variables, factor analysis was performed, reducing an initial set of 28 items to 18 final observation variables distributed across four factors. The survey, designed to measure learner satisfaction, was administered to 37 students who participated in the Pharmacology-Clinical Case Practice course during the first semester of 2022. Participants rated their satisfaction with the CBL program based on the CIPP model (on a 5-point scale), giving an average score of 4.17. This suggests that learners who followed the CBL program combining basic and clinical components generally found the program operationally effective with positive outcomes. The teaching model and evaluation model applied in this study can be utilized in various majors when operating CBL classes that link basic and clinical education in medical schools in the future.

Enhancing Practical Skills in Computer Networking: Evaluating the Unique Impact of Simulation Tools, Particularly Cisco Packet Tracer, in Resource-Constrained Higher Education Settings

This study examines the effectiveness of networking simulation tools, particularly Cisco Packet Tracer, in enhancing the learning experiences of exit-level students at a higher education institution based in the Eastern Cape of South Africa. Utilizing the Context, Input, Process, and Product (CIPP) evaluation model, the research assesses these tools’ impact, effectiveness, and sustainability in a resource-constrained, rural-based higher education context. The findings indicate that simulation tools significantly improve students’ practical skills, understanding of theoretical concepts, and preparedness for professional work in computer networking. Despite challenges such as software crashes and compatibility issues, the benefits of using simulation tools, including cost-effectiveness and convenience, are evident. The study concludes that, while simulation tools are valuable, continuous improvements and support are necessary to maximize their educational potential.

Evaluating contexts for implementing a competency‐based curriculum in south and eastern Africa: A meta‐narrative review

AbstractMany countries have looked at schools as spaces that can impart requisite skills for future jobs through competency‐based education (CBE). Yet, there is limited comparative research evidence showing countries' implementation progress. The research design adopted for this study is a meta‐narrative. Stufflebeam's (2000) context, input, process and product evaluation model is used to reflect on the education systems of two countries, Rwanda and Zimbabwe, and the enactment of their competency‐based curricula. Data from the literature was analysed using a combination of thematic, content and narrative approaches. The findings of the study established four epistemic areas that influenced the growth of the CBE movement—competency‐based training, progressivism, competency assessment programmes and the 21st‐century CBE movement. Further results showed that the extent of support for education, literacy levels and proficiency in the language of instruction were some of the context‐determinant factors influencing CBE implementation. Despite some success stories, challenges in the areas of assessment, teaching and ICT integration were reported. The study made two recommendations. Firstly, countries can enhance effective implementation through the provision of guiding frameworks for continuous professional development to empower teachers on the knowledge and skills for a CBE. Secondly, there is a need to re‐examine the CBE approach to country‐specific contexts to assess relevance to prevailing national needs.

Integrating GRA with intuitionistic fuzzy VIKOR model to explore attractive design solution of wickerwork cultural and creative products

ABSTRACT With the popularisation of the concept of sustainable traditional wickerwork, wickerwork cultural and creative products have become the most popular craft production. Kansei consensus on the design of wickerwork lamps has become a key factor influencing the communication between manufacturers and customers. Therefore, the purpose of this paper is to develop a product evaluation model for wickerwork cultural and creative products that meet the emotional satisfaction of users. Firstly, this paper could build a three-level evaluation grid diagram driven by user attractiveness through EGM, and extracts key dimensions in the perceptual vocabulary using FA. Secondly, evaluation indicators are constructed and grey relation analysis (GRA) is used to synthetically assess the priority order of evaluation indicators based on the obtained weight values. Finally, in order to effectively deal with uncertain product evaluation information, the intuitionistic fuzzy VIKOR method was used to evaluate representative product design solutions, and the most perceptually attractive product design solution was preferentially selected. This study selected wickerwork lamps as the design case of cultural and creative products, the results of the study enable designers to accurately grasp customers’ emotional perceptions of wickerwork products and obtain the best wickerwork production design solution.

A case study on evaluation of the context, input, process, product (CIPP) implementation in the child-friendly school program

This study evaluates the effectiveness of the Child-Friendly School (CFS) program at Al Mumtaz Integrated Islamic Elementary School in Pontianak using the CIPP (Context, Input, Process, Product) Evaluation Model. Through field research and purposive sampling, it delves the experiences and perceptions of principals, vice-principals, students, teachers, and parents on the program's impact. The school has successfully implemented the CFS program, noted for its qualified teachers with professional educational backgrounds and a focus on religious knowledge. The context evaluation revealed that the program aligns with child-friendly school policies, receiving a very positive evaluation and documented by official decrees. Input evaluation indicates Al Mumtaz meets all criteria including qualified staff, infrastructure, educator training, and engagement from students and parents. Process evaluation highlights the school’s effectiveness in facilitating positive educational dynamics, with non-violent disciplining, affection towards students, democratic educational practices, and teachers as role models. Finally, product evaluation shows significant achievements in fostering students' holistic development across various dimensions such as honesty, tolerance, communicative skills, democracy, social concern, responsibility, environmental care, and academics. The suggestion for this school involves establishing an organizational framework within the child-friendly school initiative to facilitate the efficient allocation of responsibilities and to confirm that the program’s monitoring and evaluation procedures are conducted in a more organized and methodical manner.

Evaluation of the Implementation of the Tahfiz Al-Quran 30 Juz Program (Context, Inputs, Processes, and Products) at the Islamic Centre North Sumatra

The Context, Input, Process, Product (CIPP) evaluation model is important because it provides a comprehensive framework for thoroughly assessing the context, inputs, processes, and products of a program. This descriptive qualitative research aims to evaluate the implementation of the tahfiz 30 juz Al-Quran program at the North Sumatra Islamic Center using the CIPP (Context, Input, Process, Product) evaluation model. Data collection was obtained through interviews, observations, and documentation. Data sources were obtained from tahfiz teachers, students, ma'had mudir, alumni, and the surrounding community and analyzed using the Miles-Huberman technique. The results of the study show that from the CIPP evaluation of the implementation of the tahfiz Al-Qur'an program at the Islamic Center of North Sumatra are: 1) Context, this program is supported by the government, schools, and the community, and is a need and part of the school's vision, mission, and goals, 2) Input, This program has competent teachers with the right teacher-student ratio (1:15) and good implementation procedures, including exam schedules, syllabus, and appropriate lesson plans, 3) The tahfiz learning process is according to plan, teachers master the material, varied methods and deposit assessment is carried out without mushaf, and 4) The product, the competence of tahfiz students is good, with the ability to read the Qur'an fluently and understand tajwid, and have noble morals that are reflected in daily behavior. It is clear that the tahfiz Al-Quran program at the North Sumatra Islamic Center runs well and effectively, is supported by various parties, has proper implementation procedures, and produces students who are competent in tahfiz and have noble character.

School Learning Practice Program in Improving Pedagogical Competence of Preservice Teachers

This study examines the evaluation of the learning practice program at school, specifically the practical field experience program organized by the Education Laboratory of the Tarbiyah and Teacher Training Faculty, UIN Sunan Kalijaga Yogyakarta. This program seeks to develop the pedagogical ability of preservice teachers through hands-on experience in the field. This research employed a mixed method, also known as evaluation research. The researchers employed the Context, Input, Process, and Product (CIPP) evaluation model to assess the program's effectiveness. The findings reveal that the practical field experience program improves preservice teachers' pedagogical competence. However, it still requires improvement and development in various areas, including choosing preferred schools/madrasas, implementation time, and the number of teaching practices. The findings of this study show that program participants who adhere to the program receive more expertise in real-world classroom learning practices. In conclusion, this study demonstrates that the practical field experience program at the FITK UIN Sunan Kalijaga Yogyakarta helps develop the pedagogical competence of preservice teachers. However, it requires further improvement and development to improve program quality.

Evaluating the Regional Contracted Teachers Appointment Program at the Junior High School Level in Tambrauw Regency, Southwest Papua Province : Context of Education in Remote Areas

This study aims to assess the achievements and impacts of the program regarding the appointment of contract teachers at the junior high school (SMP) level in Tambrauw Regency, Southwest Papua Province. This research used an evaluation method with the Context, Input, Process, and Product (CIPP) Evaluation Model developed by Stufflebeam. Respondents consist of representatives from the Department of Education, School Principals, and Teachers. Data collection methods include interviews, observations, and document studies. The collected data are then analyzed qualitatively and presented verbally. The utilization of triangulation and qualitative analysis methods in this study enhances the credibility of the data and the validity of the resulting findings. The analysis results indicate that: Firstly, in terms of context, the implementation of this program still aligns with the existing needs. Secondly, in terms of input, the program can proceed due to the availability of adequate financial support and resources. Thirdly, during the implementation process, external interventions influence the achievement of program objectives. Lastly, in terms of product, this program successfully achieves its predetermined goals and positively impacts the improvement of educational quality. In conclusion, the program regarding the appointment of contract teachers in junior high schools in Tambrauw Regency has a significant impact on enhancing the quality of education. This assessment is crucial for refining and optimizing existing programs. This study provides a valuable contribution to the program evaluation literature, particularly in the context of education in remote areas.

Examining the Quality of Learning Environment of Sandwich Programmes in Ghana: A Case of Institute of Education

This paper reports on a study that examined the quality of the learning environment of sandwich programmes in Ghana. The study used a sequential explanatory mixed method design and focused on tutors and 400 students of the programme. The Total Quality Management Theory, Expectation Confirmation/Disconfirmation Theory, Context, Input, Process, and Product Evaluation Model underpined the study. A disproportional stratified selection method was used to select 1,000 students and 50 tutors from each of the four teaching centres. While a purposive sampling method was employed to select 12 students and eight tutors involved in sandwich programmes for follow-up interviews. The data were collected using a questionnaire and an interview guide. The quantitative data was analysed using means and standard deviation, while the qualitative data were subjected to thematic analysis. These findings revealed that the tutors show concern for the welfare of the students and offer chances for student-teacher contact. However, big class sizes limit how much faculty can customise the learning environment. Also, students were friendly, helpful, cooperative, and supported one another during activities. The study recommended that the management of the Institute of Education and centre coordinators make every effort to secure spacious classrooms to help reduce large class sizes and increase opportunities for student-teacher interactions, cohesiveness, and students' participation in the classroom. In addition, tutors should foster an atmosphere that invites student interaction and identify students' strengths and weaknesses.

Development of a blended teaching quality evaluation scale (BTQES) for undergraduate nursing based on the Context, Input, Process and Product (CIPP) evaluation model: A cross-sectional survey

ObjectiveDeveloping a nursing undergraduate blended teaching quality evaluation tool based on the Context, Input, Process and Product model and evaluating its reliability and validity. BackgroundBlended teaching is a commonly used teaching method in medical education, but there are limited tools available to effectively measure the quality of blended teaching. DesignA Delphi study and cross-sectional study. MethodsUsing the Context, Input, Process and Product model as the theoretical framework, a questionnaire was developed through literature review, expert consultation and pre-survey. From April to July 2023, 448 students from a certain university were selected as the research subjects and the questionnaire was examined for reliability and validity through a survey method. ResultsThe blended teaching quality evaluation scale with 35 items includes four dimensions Context, Input, Process and Product. The content validity and reliability of the blended teaching quality evaluation scale are both good, with a content validity index of 0.934 for the total scale and a content validity index of 0.750–1.00 for each item. The SEM shows that χ2/df = 6.89, RMSEA = 0.115, CFI = 0.882, NFI=0.865, RFI= 0.855, IFI = 0.882, TLI = 0.873. The Cronbach’s α coefficient of the total scale is 0.991 and the Cronbach’s α coefficient for each dimension is 0.944–0.984. ConclusionThe scale is based on the characteristics of blended learning and quality evaluation covers all aspects of teaching. It can accurately evaluate the quality of teaching, evaluate the problems in the teaching process based on the teaching quality score and propose reasonable teaching improvement suggestions based on the weak links in the teaching process.

Research on Evaluation Methods of Black Soil Farmland Productivity Based on Field Block Scale

Black soil plays an important role in maintaining a healthy ecosystem, promoting high-yield and efficient agricultural production, and conserving soil resources. In this paper, a typical black soil area of Keshan Farm in Qiqihar City, Heilongjiang Province, China, is used as a case study to investigate the black soil farmland productivity evaluation model. Based on the analysis of the composite index (CI) model, productivity index (PI) model and various machine learning models, the soil productivity evaluation method was improved and a prediction model was established. The results showed that the support vector machine regression model based on simulated annealing algorithm (SA-SVR), as well as the Gaussian process regression model (GPR), had obvious advantages in data preprocessing, feature selection, and model optimization compared to the modified composite index model (MCI), the modified productivity index model (MPI), and the coefficients of determination (R2) of their modelling, which were up to 0.70 and 0.71, respectively, and these machine learning prediction models can reflect the effects on maize cultivation and its yield through soil parameters even with small datasets, which can better capture the nonlinear relationship and improve the accuracy and stability of yield prediction, and is an effective method for guiding agricultural production as well as soil productivity evaluation.

A Method for Evaluating Coalbed Methane Reservoir Productivity Considering Drilling Fluid Damage

In the process of coalbed methane development, drilling fluid and fracturing fluid cannot achieve absolute compatibility with formation. The incompatibility between the working fluid and reservoir will lead to the intrusion of working fluid into the reservoir and cause reservoir pollution. This is a very common phenomenon. There is a large amount of pulverized coal in the coal seam, and the intrusion of working liquid will be combined with the pulverized coal to form cement to block the seepage space in the reservoir. Since pressure relief and fracturing fluid backflow will be performed at the first time after fracturing, the intrusion range of the working fluid is small, generally reaching 10 m to 50 m. Compared with a conventional gas reservoir or shale gas reservoir, the working fluid loss during CBM development will seriously affect the subsequent production project and even make the gas well lose production capacity. On the other hand, in order to avoid this phenomenon, measures such as acidification or volumetric fracturing are sometimes used to improve the seepage environment near the well and near the fracture. The purpose of this study is to quantitatively evaluate the impacts of working fluid filtration and reservoir reconstruction on production. In this study, a single well productivity evaluation model and sensitivity analysis method considering drilling fluid filtration loss, fracturing fluid filtration loss, reservoir reconstruction and other processes is proposed. The formation mechanism of fluid loss during drilling and fracturing is described, and the productivity evaluation model considering fluid loss is combined with the Langmuir isothermal adsorption equation, steady-state diffusion law, Darcy’s seepage law and Duhamel convolution formation. Combined with the distribution of actual gas reservoir flow characteristics, the sensitivity of single well productivity to gas reservoir porosity, gas reservoir permeability, coal seam adsorption coefficient, working fluid filtration loss and reservoir reconstruction measures are analyzed. Through the analysis and fitting of the actual production data on site, the relationship curve can better fit the field production data, and the evaluation results are in line with the drilling and fracturing conditions at that time and the subsequent production conditions, with small errors. The obtained method is suitable for predicting the productivity of fractured vertical wells in different working conditions and provides a basis for the development and productivity prediction of CBM reservoirs in China and in international cooperation.

The influence of Teaching Factory (TEFA) implementation and work readiness on vocational high school students' future job perspectives

Graduates who are superior, competitive, and ready to work are the goals of vocational education. The purpose of this research is to determine the impact of Teaching Factory (TEFA) implementation with the Context, Input, Process, and Product (CIPP) evaluation model and student work readiness on the Occupational Future Time Perspective (OFTP). Indeed, nowadays, professional/vocational graduates must be ready to enter the industrial world after graduation. This research involved 456 respondents of Vocational High School (VHS) students in South Sulawesi, Indonesia, who were determined using a proportional random sampling technique. This type of research is descriptive quantitative with data analysis using SEM AMOS. The results showed that there was a significant influence between the implementation of TEFA and the level of work readiness up to 57%, while the actual contribution of teaching and work readiness factors to future employment time was 80.7%. Overall, the results show that the implementation of TEFA has successfully helped students become more independent and ready to face the competitive world of work. Although 19.3 factors still influence work readiness and prospects, the research results do not change much. Therefore, the application of a teaching factory in the learning process is highly recommended for teachers and students in vocational schools. The implementation can be adjusted to the learning conditions and resources available in VHS. This research contributes as a source of reference in future studies related to improving practical learning and developing students' entrepreneurial skills.

Evaluation Study of Special Class Sports Program Management at High School Level

This research aimed to evaluate the management of the special sports class (kelas khusus olahraga/KKO) program. Material and Methods: This research is evaluation research that employed the context, input, process, and product (CIPP) evaluation model. The research utilized a qualitative data approach, employing an interview guide as a research instrument. The sampling technique used was non-probability sampling, specifically purposive sampling, which involved setting research sample criteria and obtaining 5 samples. Each sample was interviewed at different times, and their identities were kept confidential to ensure objectivity in the responses. The findings of this research indicate that the evaluation of the special sports class program management in all aspects is still suboptimal. The results for each aspect are as follows: the context aspect meets the good criteria, the input aspect meets the medium criteria, the process aspect falls into the poor criteria, and the product aspect also meets the medium criteria. These results are accompanied by essential notes fundamental to the input, process, and product aspects. As a result, the researchers recommend several actions for each aspect. Firstly, for the context aspect, administrators are advised to continue operating the program in line with the existing vision and mission to enhance its optimal functioning. Secondly, for the input aspect, administrators are encouraged to place KKO students within the science major. Furthermore, for the process aspect, it is recommended that the management determine the continuity of the teaching and learning process for the KKO program, whether to use a new curriculum specifically for KKO, merge it with regular classes, or continue managing it in one class by simply changing the major system. Finally, for the product aspect, it is recommended to collaborate with the education department and local sports faculties to provide outreach to prospective students and their parents about the function of the KKO program’s major system

Pelaksanaan pelayanan jemput bola pada PT BPR BKK Jateng Cabang Karanganyar

<p dir="ltr"><span>This study aims to determine (1) the implementation of the ball pick-up system service and (2) the results of the CIPP (Context, input, process, product) evaluation of the ball pick-up system service. This is an evaluation research with a qualitative descriptive approach using the CIPP (Context, input, process, product) evaluation model. The results of the study are as follows: 1) the implementation of the ball pick-up system service includes the procedure for implementing the ball shuttle service program, the facilities and infrastructure of the ball pick-up service program and the implementing officers of the ball shuttle service program, (2) The results of: a) context evaluation shows that PT BPR BKK Jateng Cabang Karanganyar already has guidelines for implementing the ball pick-up system service, the targets served are all communities around Karanganyar Regency b) input evaluation shows that the facilities and infrastructure are quite adequate, training has been attended by all employees implementing the ball shuttle service, c) process evaluation shows that employee competence is good enough in providing services to customers, there is already an evaluation carried out every month there are supporting and inhibiting factors for the implementation of the ball pick-up system service, d) product evaluation shows that customers have high loyalty to the company, the amount of savings and the number of customers has increased.</span></p><div><span><br /></span></div>

Validity and Reliability of Child-Friendly School Policy Evaluation Instruments in Primary Schools: Confirmatory Factor Analysis

<p style="text-align:justify">Evaluation of child-friendly school (CFS) policies is essential to determine the achievements of school efforts in reducing violence cases. This research aims to proving the reliability and validity of CFS policy evaluation instruments in elementary schools with different locations. This investigation uses the Context Input Process Product (CIPP) evaluation model to confirm the factor structure or dimensions of several observed variables (items) to evaluate the reliability and validity of the CFS policy evaluation tool in elementary schools. The validity and reliability of previously created instruments are evaluated quantitatively, but this study utilises different subjects and study sites. There were 320 respondents, with 145 school principals and 175 teachers taken randomly. Confirmatory factors analysis (CFA) results show goodness of fit (GOF), and the model is acceptable. The CFS evaluation instrument can be accepted after eliminating several question items and modifying them. All items of the teal instrument meet the goodness of fit criteria in terms of chi-square and root mean square error of approximation (RMSEA). The instrument for evaluating CFS policies in primary schools using the CIPP model has met a valid and reliable psychometric property test so that it can be applied.</p>

Context input process product evaluation of hybrid learning practices in Indonesian universities

<span lang="EN-US">The transformation of post-pandemic learning at Indonesian universities is becoming increasingly diverse. Several universities use hybrid learning models to implement hybrid learning practices. The purpose of this study is to assess the hybrid learning process at two Indonesian universities. The context input process product (CIPP) evaluation model is used in this study as part of a mixed method. Quantitative methods are used to get an overview of student and lecturer responses, whereas qualitative methods are used to dig deeper into data about hybrid learning practices. This study included 341 students and 22 lecturers from both universities. Techniques for collecting data include questionnaires, interviews, observation, and documentation studies. The data was analyzed using learning theories. The study’s findings indicate that hybrid learning practices are performing well. The readiness of university infrastructure, as well as the readiness of students and lecturers, determines the success of hybrid learning implementation. In practice, however, some lecturers tend to use face-to-face or online learning practices exclusively to fill gaps in the hybrid learning process. This study suggests that universities investigate an effective model for implementing hybrid learning.</span>

Evaluating the dentistry program in Iran using the context, input, process, and product (CIPP) model: a comprehensive analysis.

Attaining a commendable level of quality in an educational program is not just important but imperative. Hence, this study was undertaken to assess the quality of the general dentistry program for students in Iran, utilizing the comprehensive Context, Input, Process, and Product (CIPP) evaluation model. This cross-sectional study was carried out among dentistry students in the 5th to 13th semesters at Ahvaz Jundishapur University of Medical Sciences in Ahvaz, Iran. Data collection for this research utilized a questionnaire designed in alignment with the CIPP Evaluation Model. The perspectives of students were sought in assessing the four domains of context, input, process, and product. Statistical analysis of the data was conducted using ANOVA and T-test methods. The mean scores of the educational program were as fallow: Content (2.76 ± 0.58), input (2.71 ± 0.65), process (2.51 ± 0.68), and product (3.31 ± 0.68). Overall, the quality of dentistry program was undesirable in all dimensions. Among these dimensions, "product" had the highest mean, while "process" had the lowest mean score. The results of this study indicate that the general dentistry educational program were Undesirable in all domains. The CIPP evaluation framework assists decision-makers and policymakers in determining the continuation or renewal of a training program by identifying its strengths and weaknesses.

Literature Review Evaluation of Fieldwork Practice Programs in Vocational High Schools in Indonesia

In an effort to maintain and improve the quality of Vocational High School (SMK) graduates and reduce misses from the demands of the industrial world and technological advances, the government has tried to implement various policies both in terms of quantity and quality. The activities of students in an effort to increase skill competence are through Field Work Practice (PKL) activities that involve the world of work directly. But in fact, according to nationwide data from the Central Statistics Agency (BPS), in February 2023, unemployment for vocational school graduates reached 9.6%, which is the largest of the overall levels of education in Indonesia. This literature review provides a summary of the results of the PKL program evaluation by applying the Context, Input, Process, Product (CIPP) evaluation model. The results of this study prove that the program is running in accordance with the objectives with good output. However, there needs to be careful preparation and seriousness from schools and learners.