Development Of Evaluation Tool Research Articles

즉흥연주 관련 국내 음악교육 분야 연구 동향

This study aims to analyze research trends in music education related to improvisation in Korea and to provide suggestions for future research. For this purpose, this study analyzed 91 papers based on six criteria: type of paper, publication year, research topic, keywords, research subjects, and research methods. The analysis revealed that studies focusing on teaching and learning strategies for improvisation targeting elementary school students were predominant. A literature review was the most commonly used research method, while quantitative and qualitative studies were relatively scarce. Therefore, the study suggests expanding research to include subjects such as middle and high school students and music majors, studies reflecting teachers' experiences with improvisation, the development of evaluation tools for improvisation, the use of Edutech, and the increased use of quantitative and qualitative data. These proposals emphasize the need for more diverse discussions regarding research subjects, topics, and methods. Based on these suggestions, it is hoped that the quality of research related to improvisation in music education will improve.

EvalDepApps: How to evaluate depression management based on evidence and end users

Abstract The use of apps is increasing in the field of mental health due to their ease of use and accessibility, although there is not enough evidence on their effectiveness and safety. EvalDepApps aims to develop an evaluation tool for depression management apps. A systematic review with meta-analysis (SRMA) was performed to evaluate the efficacy and safety of apps for depression, and to identify the evaluation criteria used. PRISMA methodology was followed. The MEDLINE, PsycINFO, and Embase databases were consulted. The risk of bias was assessed with the RoB2 scale. An online 2 rounds Delphi was carried out to prioritize the most relevant criteria identified. 44 people (26 professionals, 18 patients) were invited. They were asked to rate the importance of each criterion on a Likert scale (1 - 6). Those that obtained a high consensus were selected; those with a medium were submitted to the 2nd round. Empathization (6) and co-design (6) sessions were held with patients (23) and professionals (33) in Catalonia, the Canary Islands and Andalusia to identify what relevant aspects the tool should have. Twenty-nine studies were included in the SRMA (67% unclear bias), finding a significant effect of mHealth interventions in reducing depressive symptoms compared to non-active control (Hedges g = −0.62, 95% CI: −0.87 to − 0.37, I2 = 87%). In Round 1 of the Delphi (59% participation) 24 criteria obtained a high consensus, 20 a medium and 7 a low. In Round 2 (52% participation), 4 criteria reached high consensus. The empathy sessions showed that the actions most requested by patients were reduce anxiety, and information about their condition; for professionals, suicide prevention. Regarding co-design, it was proposed that the tool provide ranking of the apps, recommendation systems and a very visual format. The RSMA and Delphi guarantee that the tool will be based on scientific evidence and expert judgment, while empathization and co-design that it will fit with the needs of end users. Key messages • It is relevant to evaluate the quality of health apps, especially those addressed to vulnerable populations such as people with depression. • It is crucial that the development of evaluation tools for digital health interventions will be developed based on evidence-based but also includes end users.

Pengembangan Metode Evaluasi Pembelajaran Berbasis Quizizz Berbantuan E-Modul dalam Menunjang Kegiatan Pembelajaran di Kelas X APAPL SMKN 9 Makassar

In the learning process, the success or failure of the delivery of material carried out is measured in giving tests or evaluations. Evaluation is one of the important aspects of the learning process. One of the evaluation media that can be used is quizizz. This study aims to develop and analyze the results of validation and student responses to the use of evaluation media. The media developed is a quizizz-based evaluation tool with the help of e-modules. This research uses a research and development (R&D) approach with the ADDIE development model. The subjects of the study were 23 class X students majoring in Brackish Water and Sea Fisheries Agribusiness (APAPL) SMKN 9 Makassar, media experts, and material experts. The results showed: (1) The validation assessment of media experts obtained an average value of 3.69 and 3.87. (2) The material expert validation assessment obtained an average score of 4.0 and 4.0. Based on the average validation scores of the two experts, it can be said that the evaluation tool is declared feasible to use because it is in the very valid category. (3) The average result response of 12 small group students amounted to 81.83 who were in the very good category. (4) The average result response of 23 large group students amounted to 84.56 who were in the very good category. Based on the average scores of the two group trials, it can be stated that the development of evaluation tools is declared feasible for use and is in the very good category to be applied.

‘A web of connections’: A thematic analysis of the learning from a period of coaching that enables sustained change

The Coaching Psychology literature suggests that coaching is effective and associated with a range of positive gains. Outcome research, however, is largely quantitative and assesses short-term gains with coachees who are managers receiving coaching in work contexts. This qualitative study provides new insight into the learning gained from coaching that enables sustained change. Semi-structured interviews were used to gather narratives from nine participants who had finished a period of coaching, applied across work and life domains, after a delay. Reflexive Thematic Analysis (Braun & Clarke, 2022) was used to analyse participant responses to a set of novel questions designed to assess learning in the months following coaching. Four non-linear interconnected themes were created reflecting that the enablers of sustained change were a changed relationship with: self, action, others and coaching. Profound internalised deep learnings worked together to sustain change. A model suggests the presence of an ‘inner coach’ as a sustainer of lasting change and continued development. The implications for the development of evaluation tools, return on investment (ROI) and ethical conversations about coaching impact are discussed. The study provides a new lens through which to explore coaching as a tool for sustainable change.

Climate Change, Environment, and Health: The implementation and initial evaluation of a longitudinal, integrated curricular theme and novel competency framework at Harvard Medical School

Climate change, air pollution, and ecological degradation impact health through numerous, complex mechanisms. To train future physicians to understand these impacts, medical schools can deliver longitudinal climate curricula in undergraduate medical education, but the field remains nascent. This report describes the development, implementation, and evaluation of the longitudinal, integrated Climate Change, Environment, and Health curricular theme and novel competency framework at Harvard Medical School (HMS). A group of HMS students collaborated with faculty to integrate climate content into the pre-clerkship curriculum. The team subsequently pursued institutional recognition as a formal HMS curricular theme and created a new competency framework that guided curriculum integration mapping and evaluation tool development. The competencies cover the impact of climate change, air pollution, and ecological degradation on health in the context of historical and structural inequities and explore the role of healthcare in contributing to both climate change and solutions. A retrospective, eight-item survey using a seven-point Likert scale and two open-ended questions was administered at the end of the pre-clerkship curriculum. HMS approved a required, four-year Climate Change, Environment, and Health curricular theme in January 2023. Survey data from 100/134 (74.6%) study participants showed that most students agreed (somewhat agree/agree/strongly agree) the curricular theme was valuable (76.0%) and improved their understanding of the health impacts of climate change (80.0%). Most students agreed that their abilities in the five competencies improved because of exposure to the curricular theme. Qualitative comments indicated that students found the curriculum valuable, and also provided constructive feedback. Efforts to expand the curriculum to all four years of medical school and conduct further evaluation continue. Further scholarship is needed to present different curricular approaches and competency frameworks, which can ultimately support effective training of future physicians to understand and respond to the impacts of climate change on health and health equity.

The <i>fake news</i> during the chilean social outbreak and the role of <i>fact checking</i> against disinformation

The objective of this research is to understand the impact generated by fake news on the political perception and critical thinking of citizens who receive information through social networks during the Social Outbreak in Chile, and to assess the value of new independent fact checking media created during the same period. The methodology employs a mixed approach with an exploratory scope, involving the creation of an assessment tool used to evaluate 95 subjects from the Biobío Region, Chile who assessed and categorized a news item as true or false. The primary findings reveal that participants perceive sharing fake news as a perilous action, and they hold the belief that fake news has the potential to alter political and social ideologies. In conclusion, assessing subjects' strategies for identifying fake news allows for the development of evaluation tools that promote data verification and enhance media literacy. This becomes crucial as the criteria for verification among active social network users are often low, indicating a level of credibility in published content without thorough scrutiny of data sources or acknowledgment of the risks associated with disseminating potentially false information.

Data Center Energy Evaluation Tool Development and Analysis of Power Usage Effectiveness with Different Economizer Types in Various Climate Zones

Data centers are energy-intensive facilities, with over 95% of their total cooling load attributed to the heat generated by information technology equipment (ITE). Various energy-saving techniques have been employed to enhance data center efficiency and to reduce power usage effectiveness (PUE). Among these, economizers using outdoor air for cooling are the most effective for addressing year-round cooling demands. Despite the simplicity of the load composition, analyzing data center cooling systems involves dynamic considerations, such as weather conditions, system conditions, and economizer control. A PUE interpretation tool was specifically developed for use in data centers, aimed at addressing the simplicity of data center loads and the complexity of system analysis. The tool was verified through a comparison with results from DesignBuilder implementing the EnergyPlus algorithm. Using the developed tool, a comparative analysis of economizer strategies based on the PUE distribution was conducted, with the aim of reducing the PUE of data centers across various climatic zones. The inclusion of evaporative cooling (EC) further improved cooling efficiency, leading to reductions in PUE by approximately 0.02 to 0.05 in dry zones. Additionally, wet zones exhibited PUE reductions, ranging from approximately 0.03 to 0.07, with the implementation of indirect air-side economizer (IASE). Sensitivity and uncertainty analysis were further conducted. The computer room air handler (CRAH) supply temperature and CRAH temperature difference were the most influential factors affecting the annual PUE. For the direct air-side economizer (DASE) and DASE + EC systems, higher PUE uncertainty was observed in zones 1B, 3B, 4B, and 5B, showing ranges of 1.17–1.39 and 1.15–1.17, respectively. In the case of the IASE and IASE + EC systems, higher PUE uncertainty was noted in zones 0A, 0B, 1A, 1B, and 2A, with ranges of 1.22–1.43 and 1.17–1.43, respectively. The distinctive innovation of the tool developed in this study is characterized by its integration of specific features unique to data centers. It streamlines the computation of cooling loads, thus minimizing the burden of input, and delivers energy consumption data for data center cooling systems with a level of precision comparable to that of commercial dynamic energy analysis tools. It provides data center engineers with a valuable resource to identify optimal alternatives and system design conditions for data centers. This empowers them to make informed decisions based on energy efficiency enhancements, thereby strengthening their ability to improve energy efficiency.

Peran Guru PAI dalam Pengembangan Alat Evaluasi yang Mendukung Proses Pembelajaran yang Berkualitas

Effectiveness in learning as a very important thing in determining success in the learning process, especially the role of the teacher himself. But in fact, there are some problems that occur during the learning evaluation process, students who keep asking questions, lack of motivation and students who are not careful in reading the available questions. Therefore, the purpose of this study is to find out the role of PAI teachers in developing evaluation tools that support a quality learning process. This study used a qualitative approach with an analytical descriptive model. The data collection technique used observation to class VI at SDN Sawahlega 02 with 32 students, interviews with the principal, PAI teacher and two students in class VI and documentation studies. The result is the role of PAI teachers in developing evaluation tools that support a quality learning process that has the effectiveness of students thinking critically and increasing learning motivation. The role of the teacher himself in carrying out learning evaluations is carried out per each material that has been carried out to achieve quality learning targets. In conclusion, the development of evaluation tools supports the role of PAI teachers to have a positive impact on achieving quality learning for students in class VI SDN Sawahlega 02.

Develop test and evaluation tools for the competency of physical education and sports activities in teaching 10th grade physical education syllabus

Develop test and evaluation tools for the competency of physical education and sports activities in teaching 10th grade physical education syllabus

Algorithm for Evaluating the Effectiveness of Compositional Equilibrium of Graphical User Interfaces

Formulation of the problem: with the rapid development of information technology, numerous analogues of multidisciplinary programs are increasingly appearing on the software market. Despite the similarity of functions and identical sets of tools, these programs have different graphical user interfaces - program shells that provide the user with the opportunity to interact with the program using logic. In most cases, the overall assessment of users regarding the quality of programs depends on the effectiveness of interfaces. Having a scientific and methodological tool for assessing the effectiveness of interfaces, we can analyze them for the presence of various defects. Currently, there is no comprehensive tool for assessing the effectiveness of interfaces in the scientific literature. The purpose of the work is to develop evaluation tools that allow assessing the effectiveness of software product interfaces in numerical form. Methods: to achieve the stated goal, a comparative analysis of existing quantitative methods, metrics and laws from the scientific literature and international standards for software design and their software interfaces was carried out. Novelty: in comparison with existing methods, the developed approach is presented in the form of an algorithm capable of calculating indicators in the direction of the effectiveness of the compositional equilibrium of graphical user interfaces, which has not previously been evaluated by other researchers. Result: an algorithm has been developed for assessing the effectiveness of the compositional balance of graphical user interfaces, which allows for the evaluation and comparison of software products in this area.

Development of an applicability and performance evaluation tool based on energy simulation for smart greenhouse cooling packages

Rapid population growth and a surge in the demand for agriculture products have necessitated improvements in food security and sustainable food production. Shortening the fallow period due to high temperature through cooling in a smart greenhouse during summer, extending the crop harvest period, and improving productivity can help achieve this goal. Cooling during summers requires excessive cooling energy for maintaining optimal crop growth conditions. Therefore, for effective decision-making in introducing and controlling the cooling system, a greenhouse model that accurately predicts the process of mass and energy change, including the effect of crops, and an adequate evaluation tool are necessary. In this study, three cooling packages applicable to smart greenhouses were proposed, and a greenhouse energy model realizing plant transpiration was developed using EnergyPlus. Subsequently, 1,296 simulation datasets were constructed based on the developed model and a combination of four design variables: installation area, scale, crops, and covering materials. Therefore, a cooling package applicability and performance evaluation tool was developed based on the simulation datasets through three evaluation indices: temperature control, humidity control, and energy cost. The developed evaluation tool can enable to select an efficient cooling package for sustainable crop production.

Development of a tool for assessing the performance of long-term care systems in relation to care transition: Transitional Care Assessment Tool in Long-Term Care (TCAT-LTC)

BackgroundImproving the quality and safety of care transitions is a priority in many countries. Carrying out performance measurements play a significant role in improving quality of decisions undertaken by different actors involved in reforms. Therefore, the main objective of this paper is to present the development of an evaluation tool for assessing the performance of long-term care systems in relation to care transition, namely the Transitional Care Assessment Tool in Long-Term Care (TCAT-LTC). This study is performed as part of a larger European TRANS-SENIOR project.MethodsThe development of the TCAT-LTC involved three steps. First, we developed a conceptual model based on Donabedian’s quality framework and literature review. Second, we carried out a thorough process of item pool generation using deductive (systematic literature review) and deductive-inductive methods (in-depth interviews) with experts in the field of long-term care. Third, we conducted preliminary validation of the tool by asking experts in research and practice to provide an opinion on a tool and to assess content validity. Future fourth step will involve a tool’s pilot with country experts from Germany, the Netherlands and Poland.ResultsBy applying methodological triangulation, we developed the TCAT-LTC, which consists of 2 themes, 12 categories and 63 items. Themes include organizational and financial aspects. Organizational aspects include categories such as communication, transfer of information, availability and coordination of resources, training and education of staff, education/support of the patient/informal caregiver, involvement of the patient/informal caregiver, telemedicine and e-Health, and social care. Financial aspects include categories such as primary care, hospital, and long-term care. We also present the instructions on the application of the TCAT-LTC.ConclusionsIn this paper, we presented the development of the TCAT-LTC evaluation tool for assessing the performance of long-term care systems in relation to care transition. The TCAT-LTC is the first tool to assess the performance of long-term care systems in relation to care transition. Assessments can be carried out at the national and international level and enable to monitor, evaluate, and compare performance of the long-term care systems in relation to care transition within and across countries.

How Strategy Evaluation Affects Academic Performance in Public Secondary Schools in Bungoma County, Kenya

The Ministry of Education directed that all public secondary schools must formulate and implement strategic plans; some schools have been faced with the challenges in their strategy management. The purpose of this study was to investigate the influence of strategy evaluation on academic performance in public secondary schools in Kenya. The target population for the study was public secondary school principals, teachers, and students in Bungoma County. The county has nine administrative Sub-Counties, each with a Sub-County Education Director, a total of 258 secondary schools having 258 schools’ principals, 1,290 heads of departments, 258 school bursars from public secondary schools. The main tools for data collection for this study were questionnaires, interview schedules and document analysis guides. Both qualitative and quantitative data were collected and analysed. The results of the study illustrated that there was strong positive and significant relationship between strategy evaluation and academic performance in public secondary schools. It is concluded that effective execution of strategic evaluation activities like review of academic performance, setting and achieving targets, involvement of strategic planning team, conducting of SWOT analysis and conducting of periodic performance appraisal. Recommendations of the study are that schools should ensure development of evaluation tools and processes that are aligned with school goals and objectives. Schools should make use of the evaluation results to inform decision-making and improve strategies over time. The findings of this study may be useful in the generation of new knowledge to the Ministry of Education and other stakeholders in education in their improvement of policies and practices of the effectiveness of strategy implementation on academic performance in secondary schools

Promoting Clinical Instructors’ Success in Advance Practice Nursing Programs

Advance practice nursing programs use clinical instructors (CIs) to bridge the theory-practice gap and to maintain relationships with clinical preceptors. A clear understanding and support of the CI role for advanced practice nursing is needed to promote positive program outcomes. Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines and the Johns Hopkins Nursing Evidence-Based Practice Evidence Level and Quality Guide were used to conduct the review. Nineteen articles met the inclusion criteria. Findings from the review revealed several themes including role development, competency, communication, evaluation, technology, plan of study, and teaching resources. Findings were used to develop a multitouch electronic resource guide to support CI success in their role in advance practice education. The implementation of training programs to promote CI competency should be considered. Further investigation of CI competencies specific to advance practice nursing and the development of evaluation tools to assess competency are recommended.

Evaluation of Communicable Diseases Surveillance System Structure in Mosul City

Background: One of the most important global public health issues and it is a major source of death for many people around the world. Illnesses caused by infection invasion of the body with specific germs such as viruses, bacteria, funguses, and parasites. Aim(s): Evaluatıng communicable diseases surveillance system structure at Mosul City. Methodology: A descriptive study using an evaluation approach is conducted to evaluate the Communicable Diseases Surveillance System Structure in Mosul City from April 20th 2022 to May 21th 2023. A non-probability multistage sample was adopted of the study, as twenty-three (23) health institutions are chosen and interview is conducted with health staff works in the communicable diseases Surveillance System. Developed evaluation tool (Questionnaire) used to collect the data according to WHO framework (Generic Questionnaire) for monitoring and evaluating surveillance and response system for communicable disease. Results: The outcomes indicate that the most of system's organizational structure component are effective, available and sufficient to implement such system for the benefit of consumers from communicable diseases services’ in relation to patient surveillance manual, personnel, resources and supplies and training. However, the study findings showed that Public Health Department, both healthcare sectors and hospitals, in Mosul City, have much better organizational structure of Communicable Diseases Surveillance System than Main and Family Medicine Primary Healthcare Centers. Conclusion: All hospitals, in Mosul City, have presented an experimental evidence that their organizational structure of the Communicable Diseases Surveillance System is well competent to implement it.

대학생의 비판적 사고 향상 미디어 리터러시 교육에 관한 질적 메타분석

Objectives This study focused on critical thinking on the effects of media literacy education in universities and sought to find out the implications of this.
 Methods A qualitative meta-analysis method was used based on studies on subjects related to media literacy opened in universities. Therefore, the future direction of education was considered through the positive effects and complementary points of the educational method for improving critical thinking, focusing on the cases of 6 qualitative research subjects finally selected according to the 7th stage of the analysis procedure.
 Results While the sharing of various opinions under the guidance of the instructor was very helpful in cultivating a critical mind, most of the learners found it difficult to lead learning activities voluntarily due to the nature of the discussion. In addition, it was found that it was important to select the latest issues or related media in a timely manner, but the lack of concentration in class was revealed as a problem due to unreliable data exposure and irra-tionality that could occur due to bias. Above all, considering that writing education for critical thinking has hardly been dealt with except for Part 1, it can be seen that it is urgent to prepare a plan to activate writing.
 Conclusions In this study, through a qualitative meta-analysis of media literacy education for the improvement of college students' critical thinking, positive effects and complementary points of discussion, media analysis, video platform, and critical writing were derived. The implications of this include development of convergence ed-ucational contents, design of critical thinking process, and development of evaluation tools. Even though the Ministry of Education and the field of education are currently emphasizing the importance of media literacy educa-tion, universities still lack systematic programs. In the future, it is expected that media literacy education for learn-ers will be activated in various major subjects through collaboration between universities and instructors.

Implementation of the Project-Based Learning Model (PJBL) in Islamic Religious Education Subjects Based on Merdeka Curriculum at SMKN 1 Purwosari Pasuruan

This research seeks to determine the process of implementing Islamic Religious Education subject based on Merdeka Curriculum at SMKN 1 Purwosari Pasuruan and the steps. This study was carried out with a qualitative method and descriptive approach. To obtain the datas, the techniques used were: in-depth interviews, observations and documentation. This study indicated that the PjBL in Islamic Religious Education subject at SMKN 1 Purwosari Pasuruan consisted of three main steps: planning step, execution step, and evaluation step. There are six main aspects on project-based learning planning: (1) formulation of learning objectives; (2) students characteristics analysis; (3) learning strategies; (4) making worksheets; (5) designing the need for learning resources; and (6) developing evaluation tools. The implementation of the project-based learning in Islamic Religious Education subject at SMKN 1 Purwosari Pasuruan have met the standards set by the George Lucas Educational Foundation on implementing project-based learning. (1) starting with essential queries; (2) designing a project plan: (3) scheduling; (4) monitoring students and their project progress; (5) assessing learning results; and (6) reflection. At the level evaluation, there are three types of evaluations: formative assessment, summative assessment and diagnostic assessment, including project evaluation

Implementation of the Project-Based Learning Model (PJBL) in Islamic Religious Education Subjects Based on Merdeka Curriculum at SMKN 1 Purwosari Pasuruan

This research seeks to determine the process of implementing Islamic Religious Education subject based on Merdeka Curriculum at SMKN 1 Purwosari Pasuruan and the steps. This study was carried out with a qualitative method and descriptive approach. To obtain the datas, the techniques used were: in-depth interviews, observations and documentation. This study indicated that the PjBL in Islamic Religious Education subject at SMKN 1 Purwosari Pasuruan consisted of three main steps: planning step, execution step, and evaluation step. There are six main aspects on project-based learning planning: (1) formulation of learning objectives; (2) students characteristics analysis; (3) learning strategies; (4) making worksheets; (5) designing the need for learning resources; and (6) developing evaluation tools. The implementation of the project-based learning in Islamic Religious Education subject at SMKN 1 Purwosari Pasuruan have met the standards set by the George Lucas Educational Foundation on implementing project-based learning. (1) starting with essential queries; (2) designing a project plan: (3) scheduling; (4) monitoring students and their project progress; (5) assessing learning results; and (6) reflection. At the level evaluation, there are three types of evaluations: formative assessment, summative assessment and diagnostic assessment, including project evaluation

Application of Developed Evaluation Tool for Nurse Educator Core Competencies

Application of Developed Evaluation Tool for Nurse Educator Core Competencies

Development of Tool for Evaluation of Motor Perception Activity Learning of Students with Intellectual Disabilities

The aim of this study was to develop an application-based assessment tool for evaluating motor perception learning in children with intellectual disabilities who attend elementary classes in State Special Schools in Yogyakarta City. The tool was designed to align with the characteristics of these children and determine their mastery of motor perception activities in the educational context. The measurement instruments were designed based on the underlying concept of the research, and the items were structured as follows: (1) Sensory awareness, which assessed the children's ability to identify and select balls of different sizes; (2) Balance awareness, which involved the children climbing blocks over a 5-meter distance; (3) Space awareness, which examined the children's ability to form shapes (circles, triangles, and rectangles) using body movements; (4) Body awareness, which evaluated the children's knowledge of the functions of different body parts (feet, hands, eyes, and ears); (5) Time awareness, which assessed the children's throwing and catching abilities using light and heavy balls; and (6) Directional awareness, which tested the children's ability to throw the ball in different directions (up, down, front, and back). The results indicated that the motor perception activity evaluation tool consisted of six items, each of which assessed the mastery of motor perception in children with intellectual disabilities who attend elementary classes. The validity of the test was found to be 0.720, and the reliability was 0.837. In conclusion, this research successfully developed an application-based learning evaluation tool and established motor perception assessment norms for children with intellectual disabilities attending elementary grades in State Special Schools in Yogyakarta City. These tools can be utilized by physical education teachers to assess the motor perception activities of children with intellectual disabilities in an educational setting.