Development Of Evaluation Tool Research Articles

‘A web of connections’: A thematic analysis of the learning from a period of coaching that enables sustained change

The Coaching Psychology literature suggests that coaching is effective and associated with a range of positive gains. Outcome research, however, is largely quantitative and assesses short-term gains with coachees who are managers receiving coaching in work contexts. This qualitative study provides new insight into the learning gained from coaching that enables sustained change. Semi-structured interviews were used to gather narratives from nine participants who had finished a period of coaching, applied across work and life domains, after a delay. Reflexive Thematic Analysis (Braun & Clarke, 2022) was used to analyse participant responses to a set of novel questions designed to assess learning in the months following coaching. Four non-linear interconnected themes were created reflecting that the enablers of sustained change were a changed relationship with: self, action, others and coaching. Profound internalised deep learnings worked together to sustain change. A model suggests the presence of an ‘inner coach’ as a sustainer of lasting change and continued development. The implications for the development of evaluation tools, return on investment (ROI) and ethical conversations about coaching impact are discussed. The study provides a new lens through which to explore coaching as a tool for sustainable change.

Climate Change, Environment, and Health: The implementation and initial evaluation of a longitudinal, integrated curricular theme and novel competency framework at Harvard Medical School

Climate change, air pollution, and ecological degradation impact health through numerous, complex mechanisms. To train future physicians to understand these impacts, medical schools can deliver longitudinal climate curricula in undergraduate medical education, but the field remains nascent. This report describes the development, implementation, and evaluation of the longitudinal, integrated Climate Change, Environment, and Health curricular theme and novel competency framework at Harvard Medical School (HMS). A group of HMS students collaborated with faculty to integrate climate content into the pre-clerkship curriculum. The team subsequently pursued institutional recognition as a formal HMS curricular theme and created a new competency framework that guided curriculum integration mapping and evaluation tool development. The competencies cover the impact of climate change, air pollution, and ecological degradation on health in the context of historical and structural inequities and explore the role of healthcare in contributing to both climate change and solutions. A retrospective, eight-item survey using a seven-point Likert scale and two open-ended questions was administered at the end of the pre-clerkship curriculum. HMS approved a required, four-year Climate Change, Environment, and Health curricular theme in January 2023. Survey data from 100/134 (74.6%) study participants showed that most students agreed (somewhat agree/agree/strongly agree) the curricular theme was valuable (76.0%) and improved their understanding of the health impacts of climate change (80.0%). Most students agreed that their abilities in the five competencies improved because of exposure to the curricular theme. Qualitative comments indicated that students found the curriculum valuable, and also provided constructive feedback. Efforts to expand the curriculum to all four years of medical school and conduct further evaluation continue. Further scholarship is needed to present different curricular approaches and competency frameworks, which can ultimately support effective training of future physicians to understand and respond to the impacts of climate change on health and health equity.

The <i>fake news</i> during the chilean social outbreak and the role of <i>fact checking</i> against disinformation

The objective of this research is to understand the impact generated by fake news on the political perception and critical thinking of citizens who receive information through social networks during the Social Outbreak in Chile, and to assess the value of new independent fact checking media created during the same period. The methodology employs a mixed approach with an exploratory scope, involving the creation of an assessment tool used to evaluate 95 subjects from the Biobío Region, Chile who assessed and categorized a news item as true or false. The primary findings reveal that participants perceive sharing fake news as a perilous action, and they hold the belief that fake news has the potential to alter political and social ideologies. In conclusion, assessing subjects' strategies for identifying fake news allows for the development of evaluation tools that promote data verification and enhance media literacy. This becomes crucial as the criteria for verification among active social network users are often low, indicating a level of credibility in published content without thorough scrutiny of data sources or acknowledgment of the risks associated with disseminating potentially false information.

Data Center Energy Evaluation Tool Development and Analysis of Power Usage Effectiveness with Different Economizer Types in Various Climate Zones

Data centers are energy-intensive facilities, with over 95% of their total cooling load attributed to the heat generated by information technology equipment (ITE). Various energy-saving techniques have been employed to enhance data center efficiency and to reduce power usage effectiveness (PUE). Among these, economizers using outdoor air for cooling are the most effective for addressing year-round cooling demands. Despite the simplicity of the load composition, analyzing data center cooling systems involves dynamic considerations, such as weather conditions, system conditions, and economizer control. A PUE interpretation tool was specifically developed for use in data centers, aimed at addressing the simplicity of data center loads and the complexity of system analysis. The tool was verified through a comparison with results from DesignBuilder implementing the EnergyPlus algorithm. Using the developed tool, a comparative analysis of economizer strategies based on the PUE distribution was conducted, with the aim of reducing the PUE of data centers across various climatic zones. The inclusion of evaporative cooling (EC) further improved cooling efficiency, leading to reductions in PUE by approximately 0.02 to 0.05 in dry zones. Additionally, wet zones exhibited PUE reductions, ranging from approximately 0.03 to 0.07, with the implementation of indirect air-side economizer (IASE). Sensitivity and uncertainty analysis were further conducted. The computer room air handler (CRAH) supply temperature and CRAH temperature difference were the most influential factors affecting the annual PUE. For the direct air-side economizer (DASE) and DASE + EC systems, higher PUE uncertainty was observed in zones 1B, 3B, 4B, and 5B, showing ranges of 1.17–1.39 and 1.15–1.17, respectively. In the case of the IASE and IASE + EC systems, higher PUE uncertainty was noted in zones 0A, 0B, 1A, 1B, and 2A, with ranges of 1.22–1.43 and 1.17–1.43, respectively. The distinctive innovation of the tool developed in this study is characterized by its integration of specific features unique to data centers. It streamlines the computation of cooling loads, thus minimizing the burden of input, and delivers energy consumption data for data center cooling systems with a level of precision comparable to that of commercial dynamic energy analysis tools. It provides data center engineers with a valuable resource to identify optimal alternatives and system design conditions for data centers. This empowers them to make informed decisions based on energy efficiency enhancements, thereby strengthening their ability to improve energy efficiency.

Peran Guru PAI dalam Pengembangan Alat Evaluasi yang Mendukung Proses Pembelajaran yang Berkualitas

Effectiveness in learning as a very important thing in determining success in the learning process, especially the role of the teacher himself. But in fact, there are some problems that occur during the learning evaluation process, students who keep asking questions, lack of motivation and students who are not careful in reading the available questions. Therefore, the purpose of this study is to find out the role of PAI teachers in developing evaluation tools that support a quality learning process. This study used a qualitative approach with an analytical descriptive model. The data collection technique used observation to class VI at SDN Sawahlega 02 with 32 students, interviews with the principal, PAI teacher and two students in class VI and documentation studies. The result is the role of PAI teachers in developing evaluation tools that support a quality learning process that has the effectiveness of students thinking critically and increasing learning motivation. The role of the teacher himself in carrying out learning evaluations is carried out per each material that has been carried out to achieve quality learning targets. In conclusion, the development of evaluation tools supports the role of PAI teachers to have a positive impact on achieving quality learning for students in class VI SDN Sawahlega 02.

Develop test and evaluation tools for the competency of physical education and sports activities in teaching 10th grade physical education syllabus

Develop test and evaluation tools for the competency of physical education and sports activities in teaching 10th grade physical education syllabus

Algorithm for Evaluating the Effectiveness of Compositional Equilibrium of Graphical User Interfaces

Formulation of the problem: with the rapid development of information technology, numerous analogues of multidisciplinary programs are increasingly appearing on the software market. Despite the similarity of functions and identical sets of tools, these programs have different graphical user interfaces - program shells that provide the user with the opportunity to interact with the program using logic. In most cases, the overall assessment of users regarding the quality of programs depends on the effectiveness of interfaces. Having a scientific and methodological tool for assessing the effectiveness of interfaces, we can analyze them for the presence of various defects. Currently, there is no comprehensive tool for assessing the effectiveness of interfaces in the scientific literature. The purpose of the work is to develop evaluation tools that allow assessing the effectiveness of software product interfaces in numerical form. Methods: to achieve the stated goal, a comparative analysis of existing quantitative methods, metrics and laws from the scientific literature and international standards for software design and their software interfaces was carried out. Novelty: in comparison with existing methods, the developed approach is presented in the form of an algorithm capable of calculating indicators in the direction of the effectiveness of the compositional equilibrium of graphical user interfaces, which has not previously been evaluated by other researchers. Result: an algorithm has been developed for assessing the effectiveness of the compositional balance of graphical user interfaces, which allows for the evaluation and comparison of software products in this area.

Development of an applicability and performance evaluation tool based on energy simulation for smart greenhouse cooling packages

Rapid population growth and a surge in the demand for agriculture products have necessitated improvements in food security and sustainable food production. Shortening the fallow period due to high temperature through cooling in a smart greenhouse during summer, extending the crop harvest period, and improving productivity can help achieve this goal. Cooling during summers requires excessive cooling energy for maintaining optimal crop growth conditions. Therefore, for effective decision-making in introducing and controlling the cooling system, a greenhouse model that accurately predicts the process of mass and energy change, including the effect of crops, and an adequate evaluation tool are necessary. In this study, three cooling packages applicable to smart greenhouses were proposed, and a greenhouse energy model realizing plant transpiration was developed using EnergyPlus. Subsequently, 1,296 simulation datasets were constructed based on the developed model and a combination of four design variables: installation area, scale, crops, and covering materials. Therefore, a cooling package applicability and performance evaluation tool was developed based on the simulation datasets through three evaluation indices: temperature control, humidity control, and energy cost. The developed evaluation tool can enable to select an efficient cooling package for sustainable crop production.

Development of a tool for assessing the performance of long-term care systems in relation to care transition: Transitional Care Assessment Tool in Long-Term Care (TCAT-LTC)

BackgroundImproving the quality and safety of care transitions is a priority in many countries. Carrying out performance measurements play a significant role in improving quality of decisions undertaken by different actors involved in reforms. Therefore, the main objective of this paper is to present the development of an evaluation tool for assessing the performance of long-term care systems in relation to care transition, namely the Transitional Care Assessment Tool in Long-Term Care (TCAT-LTC). This study is performed as part of a larger European TRANS-SENIOR project.MethodsThe development of the TCAT-LTC involved three steps. First, we developed a conceptual model based on Donabedian’s quality framework and literature review. Second, we carried out a thorough process of item pool generation using deductive (systematic literature review) and deductive-inductive methods (in-depth interviews) with experts in the field of long-term care. Third, we conducted preliminary validation of the tool by asking experts in research and practice to provide an opinion on a tool and to assess content validity. Future fourth step will involve a tool’s pilot with country experts from Germany, the Netherlands and Poland.ResultsBy applying methodological triangulation, we developed the TCAT-LTC, which consists of 2 themes, 12 categories and 63 items. Themes include organizational and financial aspects. Organizational aspects include categories such as communication, transfer of information, availability and coordination of resources, training and education of staff, education/support of the patient/informal caregiver, involvement of the patient/informal caregiver, telemedicine and e-Health, and social care. Financial aspects include categories such as primary care, hospital, and long-term care. We also present the instructions on the application of the TCAT-LTC.ConclusionsIn this paper, we presented the development of the TCAT-LTC evaluation tool for assessing the performance of long-term care systems in relation to care transition. The TCAT-LTC is the first tool to assess the performance of long-term care systems in relation to care transition. Assessments can be carried out at the national and international level and enable to monitor, evaluate, and compare performance of the long-term care systems in relation to care transition within and across countries.

How Strategy Evaluation Affects Academic Performance in Public Secondary Schools in Bungoma County, Kenya

The Ministry of Education directed that all public secondary schools must formulate and implement strategic plans; some schools have been faced with the challenges in their strategy management. The purpose of this study was to investigate the influence of strategy evaluation on academic performance in public secondary schools in Kenya. The target population for the study was public secondary school principals, teachers, and students in Bungoma County. The county has nine administrative Sub-Counties, each with a Sub-County Education Director, a total of 258 secondary schools having 258 schools’ principals, 1,290 heads of departments, 258 school bursars from public secondary schools. The main tools for data collection for this study were questionnaires, interview schedules and document analysis guides. Both qualitative and quantitative data were collected and analysed. The results of the study illustrated that there was strong positive and significant relationship between strategy evaluation and academic performance in public secondary schools. It is concluded that effective execution of strategic evaluation activities like review of academic performance, setting and achieving targets, involvement of strategic planning team, conducting of SWOT analysis and conducting of periodic performance appraisal. Recommendations of the study are that schools should ensure development of evaluation tools and processes that are aligned with school goals and objectives. Schools should make use of the evaluation results to inform decision-making and improve strategies over time. The findings of this study may be useful in the generation of new knowledge to the Ministry of Education and other stakeholders in education in their improvement of policies and practices of the effectiveness of strategy implementation on academic performance in secondary schools

Promoting Clinical Instructors’ Success in Advance Practice Nursing Programs

Advance practice nursing programs use clinical instructors (CIs) to bridge the theory-practice gap and to maintain relationships with clinical preceptors. A clear understanding and support of the CI role for advanced practice nursing is needed to promote positive program outcomes. Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines and the Johns Hopkins Nursing Evidence-Based Practice Evidence Level and Quality Guide were used to conduct the review. Nineteen articles met the inclusion criteria. Findings from the review revealed several themes including role development, competency, communication, evaluation, technology, plan of study, and teaching resources. Findings were used to develop a multitouch electronic resource guide to support CI success in their role in advance practice education. The implementation of training programs to promote CI competency should be considered. Further investigation of CI competencies specific to advance practice nursing and the development of evaluation tools to assess competency are recommended.

Evaluation of Communicable Diseases Surveillance System Structure in Mosul City

Background: One of the most important global public health issues and it is a major source of death for many people around the world. Illnesses caused by infection invasion of the body with specific germs such as viruses, bacteria, funguses, and parasites. Aim(s): Evaluatıng communicable diseases surveillance system structure at Mosul City. Methodology: A descriptive study using an evaluation approach is conducted to evaluate the Communicable Diseases Surveillance System Structure in Mosul City from April 20th 2022 to May 21th 2023. A non-probability multistage sample was adopted of the study, as twenty-three (23) health institutions are chosen and interview is conducted with health staff works in the communicable diseases Surveillance System. Developed evaluation tool (Questionnaire) used to collect the data according to WHO framework (Generic Questionnaire) for monitoring and evaluating surveillance and response system for communicable disease. Results: The outcomes indicate that the most of system's organizational structure component are effective, available and sufficient to implement such system for the benefit of consumers from communicable diseases services’ in relation to patient surveillance manual, personnel, resources and supplies and training. However, the study findings showed that Public Health Department, both healthcare sectors and hospitals, in Mosul City, have much better organizational structure of Communicable Diseases Surveillance System than Main and Family Medicine Primary Healthcare Centers. Conclusion: All hospitals, in Mosul City, have presented an experimental evidence that their organizational structure of the Communicable Diseases Surveillance System is well competent to implement it.

대학생의 비판적 사고 향상 미디어 리터러시 교육에 관한 질적 메타분석

Objectives This study focused on critical thinking on the effects of media literacy education in universities and sought to find out the implications of this.
 Methods A qualitative meta-analysis method was used based on studies on subjects related to media literacy opened in universities. Therefore, the future direction of education was considered through the positive effects and complementary points of the educational method for improving critical thinking, focusing on the cases of 6 qualitative research subjects finally selected according to the 7th stage of the analysis procedure.
 Results While the sharing of various opinions under the guidance of the instructor was very helpful in cultivating a critical mind, most of the learners found it difficult to lead learning activities voluntarily due to the nature of the discussion. In addition, it was found that it was important to select the latest issues or related media in a timely manner, but the lack of concentration in class was revealed as a problem due to unreliable data exposure and irra-tionality that could occur due to bias. Above all, considering that writing education for critical thinking has hardly been dealt with except for Part 1, it can be seen that it is urgent to prepare a plan to activate writing.
 Conclusions In this study, through a qualitative meta-analysis of media literacy education for the improvement of college students' critical thinking, positive effects and complementary points of discussion, media analysis, video platform, and critical writing were derived. The implications of this include development of convergence ed-ucational contents, design of critical thinking process, and development of evaluation tools. Even though the Ministry of Education and the field of education are currently emphasizing the importance of media literacy educa-tion, universities still lack systematic programs. In the future, it is expected that media literacy education for learn-ers will be activated in various major subjects through collaboration between universities and instructors.

Implementation of the Project-Based Learning Model (PJBL) in Islamic Religious Education Subjects Based on Merdeka Curriculum at SMKN 1 Purwosari Pasuruan

This research seeks to determine the process of implementing Islamic Religious Education subject based on Merdeka Curriculum at SMKN 1 Purwosari Pasuruan and the steps. This study was carried out with a qualitative method and descriptive approach. To obtain the datas, the techniques used were: in-depth interviews, observations and documentation. This study indicated that the PjBL in Islamic Religious Education subject at SMKN 1 Purwosari Pasuruan consisted of three main steps: planning step, execution step, and evaluation step. There are six main aspects on project-based learning planning: (1) formulation of learning objectives; (2) students characteristics analysis; (3) learning strategies; (4) making worksheets; (5) designing the need for learning resources; and (6) developing evaluation tools. The implementation of the project-based learning in Islamic Religious Education subject at SMKN 1 Purwosari Pasuruan have met the standards set by the George Lucas Educational Foundation on implementing project-based learning. (1) starting with essential queries; (2) designing a project plan: (3) scheduling; (4) monitoring students and their project progress; (5) assessing learning results; and (6) reflection. At the level evaluation, there are three types of evaluations: formative assessment, summative assessment and diagnostic assessment, including project evaluation

Implementation of the Project-Based Learning Model (PJBL) in Islamic Religious Education Subjects Based on Merdeka Curriculum at SMKN 1 Purwosari Pasuruan

This research seeks to determine the process of implementing Islamic Religious Education subject based on Merdeka Curriculum at SMKN 1 Purwosari Pasuruan and the steps. This study was carried out with a qualitative method and descriptive approach. To obtain the datas, the techniques used were: in-depth interviews, observations and documentation. This study indicated that the PjBL in Islamic Religious Education subject at SMKN 1 Purwosari Pasuruan consisted of three main steps: planning step, execution step, and evaluation step. There are six main aspects on project-based learning planning: (1) formulation of learning objectives; (2) students characteristics analysis; (3) learning strategies; (4) making worksheets; (5) designing the need for learning resources; and (6) developing evaluation tools. The implementation of the project-based learning in Islamic Religious Education subject at SMKN 1 Purwosari Pasuruan have met the standards set by the George Lucas Educational Foundation on implementing project-based learning. (1) starting with essential queries; (2) designing a project plan: (3) scheduling; (4) monitoring students and their project progress; (5) assessing learning results; and (6) reflection. At the level evaluation, there are three types of evaluations: formative assessment, summative assessment and diagnostic assessment, including project evaluation

Application of Developed Evaluation Tool for Nurse Educator Core Competencies

Application of Developed Evaluation Tool for Nurse Educator Core Competencies

Development of Tool for Evaluation of Motor Perception Activity Learning of Students with Intellectual Disabilities

The aim of this study was to develop an application-based assessment tool for evaluating motor perception learning in children with intellectual disabilities who attend elementary classes in State Special Schools in Yogyakarta City. The tool was designed to align with the characteristics of these children and determine their mastery of motor perception activities in the educational context. The measurement instruments were designed based on the underlying concept of the research, and the items were structured as follows: (1) Sensory awareness, which assessed the children's ability to identify and select balls of different sizes; (2) Balance awareness, which involved the children climbing blocks over a 5-meter distance; (3) Space awareness, which examined the children's ability to form shapes (circles, triangles, and rectangles) using body movements; (4) Body awareness, which evaluated the children's knowledge of the functions of different body parts (feet, hands, eyes, and ears); (5) Time awareness, which assessed the children's throwing and catching abilities using light and heavy balls; and (6) Directional awareness, which tested the children's ability to throw the ball in different directions (up, down, front, and back). The results indicated that the motor perception activity evaluation tool consisted of six items, each of which assessed the mastery of motor perception in children with intellectual disabilities who attend elementary classes. The validity of the test was found to be 0.720, and the reliability was 0.837. In conclusion, this research successfully developed an application-based learning evaluation tool and established motor perception assessment norms for children with intellectual disabilities attending elementary grades in State Special Schools in Yogyakarta City. These tools can be utilized by physical education teachers to assess the motor perception activities of children with intellectual disabilities in an educational setting.

Fidelity in acupuncture-moxibustion clinical research: application and reflection

As an indicator that measures the degree of implementation of intervention measures during the implementation process, fidelity could be used for monitoring and quality evaluation of the completion degree of intervention measures, and plays an important role in improving the degree of intervention implementation and clarifying the factors that affect intervention implementation. This article aims to introduce the connotation and significance, measurement, control, and current application status of fidelity, as well as the current application status of fidelity in acupuncture-moxibustion clinical research and its inspiration for future research. Meanwhile, based on the existing evaluation tool development methods of fidelity and the characteristics of acupuncture-moxibustion clinical research, a preliminary fidelity evaluation framework is proposed. Introducing fidelity into acupuncture-moxibustion clinical research could improve the implementation quality and compliance of acupuncture-moxibustion in clinical research, increase the credibility and effectiveness of clinical research results, and promote the transformation of acupuncture-moxibustion experience into easily learnable and promotable treatment plans.

초⋅중학생의 디지털 리터러시 역량 평가를 위한 프레임워크 개발

Objectives The purpose of this study is to develop a framework for evaluating the digital literacy competencies of primary and middle school students in South Korea.
 Methods To achieve this, the researchers analyzed previous domestic and international studies and cases to develop a draft evaluation framework that includes definitions of digital literacy, evaluation areas, sub-elements, definitions of sub-elements, and examples of achievement. The developed draft was revised and validated through two rounds of the Delphi survey.
 Results The final proposed digital literacy evaluation framework consists of five evaluation areas and 11 sub-elements, including ① digital tools (understanding of digital tools, utilization of digital tools), ② digital information and data (information search and data collection, analysis and evaluation of information and data, management of information and data), ③ digital communication and collaboration (digital communication, digital collaboration), ④ digital resource production (content production, problem-solving based on computational thinking), and ⑤ digital safety and health (digital safety, digital health).
 Conclusions The significance of the evaluation framework for the digital literacy developed in this study is that it systematizes the construct for measurement of the digital literacy required by primary and middle school students. In the future, this framework can be used to develop evaluation tools for diagnosing the level of digital literacy of students.

Implementasi Kurikulum 2013 Di SMA Kota Serang Menuju Sekolah Unggulan

An adequate and modern curriculum system is needed to support quality education. So that the learning process can form and develop students to be skilled and have good character education. This research was conducted because it has the aim of knowing comprehensively about the implementation of the 2013 curriculum at SMAN 1 Kota Serang. In implementing the 2013 curriculum, it is hoped that students will be more enthusiastic about learning so that the process carried out can run optimally. SMAN 1 Serang City Can become a superior school that can produce outstanding students who are ready to be competitive in the national or international arena. By applying the 2013 curriculum appropriately, it can build a conducive learning environment and can add to students' understanding when studying in class. The process of implementing a good and clear curriculum requires formulating goals, organizing learning experiences, organizing materials, needs, and developing evaluation tools. Thus, it will be easier to implement the curriculum at SMAN 1 Serang City to become a quality superior school to help students who will later enter college get good grades. Because if seen from the truth, the 2013 curriculum has a very significant role because it can help students learn to ask questions during learning related to the learning conveyed by the teacher, have objective reasoning power, make observations, and be able to present the results of their learning to the teacher by good for good results.