Measure Learning Outcomes Research Articles

Requirements for Professional Teachers and Professional Teachers as Communicators and Facilitators

The group learning discussion method is one of the strategies to influence the motivation of students' interest in learning to be high. The existence of high interest in learning makes students study diligently and responsibly, which in the end is manifested in measurable and good student learning outcomes. This study aims to find out an overview of the factors that affect the learning motivation of students of the Civil Engineering, Informatics, and Electrical Engineering Study Program of Sumbawa University of Technology in the Islamic Religious Education Course. The type of research used is quantitative; descriptive with primary data types. Purposive sampling technique. Then the data collection technique in this study uses observation, interview, and documentation study guidelines. Data analysis using data collection; data reduction; data presentation; and conclusions and verification. Based on these results, it is recommended to lecturers in religious education courses to strengthen the factors that motivate students during the educational process in an effort to increase the success of the students themselves

A Study of Components on Effective Academic Administration with Participation of Parents and Community in Small-Sized Schools under the Office of the Basic Education Commission

The research aimed to examine the components of effective academic administration involving collaborative participation from parents and the local community in small-sized schools under the authority of the Basic Education Commission. The study employed a mixed-method research approach, incorporating both quantitative and qualitative methodologies, divided into two phases. Phase 1: Examine the components of academic administration by synthesizing documents and related studies. Phase 2: Conduct interviews and verify the effectiveness of academic administration. The information providers consisted of 7 highly qualified individuals in the field of educational administration. The selection method was purposive sampling. The tools utilized included interview and assessment forms. Statistical analysis involved mean, standard deviation, and content analysis. The research findings indicated that the effective collaborative components of academic administration involving parents and communities in small-sized schools consisted of three main components: 1) The workload and scope of academic administration in small-sized schools, comprising 10 aspects, 2) Effective academic administration, consisting of 4 aspects, and 3) Collaborative management processes, involving 4 steps. The assessment results demonstrated a high level of suitability for the effective collaborative components of academic administration involving parents and communities in small-sized schools, both at the individual component level and overall. The component with the highest level was the development of an internal quality assurance system within the educational institution, including measurement, assessment, and comparison of learning outcomes. Conversely, the component with the lowest level was the development of learning resources.

Development of an Interactive E-Module Based On Flipbook Protista Material To Improve Student Biology Learning Outcomes

The development of a flipbook-based interactive e-module is an innovative step in increasing the effectiveness of biology learning, especially Protista material. Protista is a group of eukaryotic organisms that includes various microorganisms such as protozoa, unicellular algae, and others. This research aims to develop an interactive e-module based on flipbook material on protists that is valid, practical and effective. The research method refers to the analysis, design, development, implementation, and evaluation development model. The subjects of this research were class X students at Oikomene Manokwari High School, consisting of 24 students. Data collection procedures in the form of a questionnaire to determine validator and student responses to interactive e-modules as well as providing multiple choice questions to measure learning outcomes. Descriptive data analysis technique by calculating validation results and student learning outcomes. The research results showed that the media and material expert validation test results obtained a percentage of 96.67% with a very valid category. The results of the assessment of student responses in large group trials obtained an average percentage of 83.61% in the very practical category. The test results show that the average student learning outcome is 82.21 in the very high category. This research can be concluded that the flipbook-based interactive e-module on protist material meets the criteria of being valid, practical and effective in improving student learning outcomes.

Exploration of Practice Teaching Reform Based on Outcome-Based Education Concept: Taking Environmental Design Major as an Example

The concept of OBE (outcome-based education) is more focused on designing and implementing teaching activities around expected learning outcomes than the traditional teaching model and enhancing the quality of education through clear and measurable learning outcomes, which has led to profound changes in the field of education. However, environmental design practice teaching faces a series of challenges in the implementation of the OBE concept, including the complexity of the assessment system, personalized learning and creative learning, and over-reliance on quantitative assessment. Therefore, in order to further deepen the professionalization of the OBE concept, we have conducted research on the design education practice models at home and abroad, explored the practice teaching models and their applications such as project system, studio model, practical internships, and technology-driven interdisciplinary integration, and took the practice innovative teaching models of Stanford d.school and Rhode Island School of Design (RISD) as examples to explore the characteristics of the curricula, cultivation modes, and the development of the environmental design professional practice teaching model. The characteristics of OBE and RISD are discussed to provide a global vision and local contextual reference for the practice teaching reform of environmental design majors.

A Framework Model for Exploring Factors for Measuring E-Learning Systems and Its Relevant Outcomes via AHP

Universities have focused on learning outcomes as a metric for evaluating the quality assurance of educational systems. However, due to the absence of a clear guide on measuring outcomes and analysing them accordingly to improve the educational cycle, educators struggled to efficiently and effectively address shortcomings. By proposing a new framework, this study fills this gap and provides a guided approach to measuring learning outcomes in the context of university e-learning systems. Facilitated by a comprehensive research literature review of 102 articles, filtered from 271 articles using the PRISMA method, the opinions of five experts regarding e-learning systems and their outcomes were analysed using the analytical hierarchy process (AHP) to provide priority rankings. Teaching methods, teaching quality, learning environment, and students emerged as the main factors, along with their sub-factors. Moreover, our experts from diverse educational and geographical backgrounds provide added value, enabling the framework to be implemented across various environments and fields. Ultimately, this framework accurately measures sub-factors to identify the strengths and weaknesses of educational variables. The proposed framework is a step in the right direction, enabling the design of a suitable system that takes into account users’ needs when assessing e-learning outcomes.

Towards believable and educational conversations with virtual patients

Virtual Reality (VR) technology allows the design and application of realistic but adaptive learning environments in medical education. In particular, virtual patient systems have logistical and methodological advantages compared to non-computerized interventions. However, evidence for their effectiveness is fragmented as any educational domain introduces its requirements regarding learning goals, measurements of learning outcomes, and application design. In this context, we present preliminary results of evaluating a VR training application for conducting a clinical interview to diagnose mental disorders in children and adolescents using virtual patients. The evaluation focuses on design elements related to the virtual patient’s appearance and natural language capabilities. Our results indicate that our virtual patient design is highly believable and that our dialog system is satisfying. However, conversational flow requires optimization. We discuss design directions and potential enhancements for learner-virtual patient interactions in VR and address future operations to evaluate the effectiveness of our approach.

Analisis Butir Soal Ulangan Harian Siswa Mata Pelajaran PPKn Kelas IV Menggunakan Rach Model di Madrasah Ibtidaiyah Negeri

The study aimed to analyze the items on students' daily test questions on PPKN subjects made by the teacher to measure learning outcomes during the previous lesson process. Conducted on fourth-grade students at the 01 West Pasaman State Madrasah Ibtidayah. The method used in this research is descriptive quantitative using Rasch model data analysis with Win Step software. The results of the data analysis carried out were on the reliability data analysis using Winstep Cronbach Alpha 0.49 software. From the existing data, it is clear that the level of reliability of the questions is still relatively weak. The results of the Rasch model of person reliability and item reliability are 0.47 and 0.52. The results of the analysis of the quality of the items in terms of the validity of the items using the Rasch model obtained 6 questions that were said to be valid and 24 questions that were said to be invalid because they did not meet the requirements for the MNSQ outfit, ZSTD outfit, and the Point Measure correlation (PT measure Corr). In using the Rasch model it is felt to be more accurate because it meets these three criteria, so it is considered valid. above the P value or the level of difficulty of the items below 0.25, there are 3 items, meaning the item is very difficult. Questions that are above 0.75 have 5 items meaning the question is too easy. And questions that are scored between 0.25-0.75 have 17 questions. That is, 18 questions have a good level of difficulty. Analysis of distracting items using the Winstep Rasch Model software for 25 daily test questions for students of Civics class IV at Madrasah Ibtidayah Negeri 01 Pasaman Barat shows that there are 23 questions with good functioning distractors. Items where the distractor does not function properly are 5 questions.

Evaluating OPEN-MURDER Scenario Impact on Vocational Education

This study investigates the impact of the OPEN-MURDER scenario on the learning outcomes of 36 Software Engineering program students in Vocational Schools (SMK). Utilizing a quasi-experimental design, pretest-posttest assessments were conducted to measure learning outcomes before and after implementing OPEN-MURDER, focusing on mood, understanding, recall, digest, expand, and review. Results show a significant improvement, with pretest scores averaging 71.72 and posttest scores 89.53 (p < 0.05). The findings underscore OPEN-MURDER's positive influence on SMK students' learning outcomes, suggesting its potential as an effective teaching model to enhance motivation, problem-solving skills, and classroom engagement. Future research could explore comparative analyses with control groups and encourage educators to adopt OPEN-MURDER for innovative teaching practices. Highlight: OPEN-MURDER Evaluation: Assesses impact on vocational students' learning outcomes. Experimental Design: Utilizes pretest-posttest method to measure effectiveness. Positive Influence: Shows significant improvement in student learning outcomes post-implementation. Keywoard: Open-Murder Scenario, Learning Outcomes, Vocational Schools, Quasi-Experimental Design, Teaching Model.

Digital Problem Based Learning for Facilitating the Acquisition of Collaborative Competencies

Is Networked Learning (NL) and Problem-Based Learning (PBL) the future of education to foster collaboration? Networked learning has been proposed to be combined with PBL. Both are pedagogies and philosophies influenced by traditions of open learning, radical pedagogies and humanistic educational ideas. Problem-based learning is a constructivist, student-centered, and problem-based approach used at the medical education at Aalborg University (AAU). During COVID, AAU fast-tracked the implementation of Digital PBL (DPBL) methods. Digital PBL opens new possibilities for collaborations across platforms and holds a potential to improve learning. This potential has yet to be released through systematic efforts to understand the possibilities in the context of medical education.The curriculum at the medical education at AAU is centered around the seven roles of physicians originally described in the Canadian framework, CanMEDS. Healthcare systems becomes increasingly complex, interconnected, and rely on interdisciplinary teamwork. The Collaborator role thus becomes more important than ever before. Physicians are expected to excel in clinical expertise and collaborate effectively with other healthcare professionals, patients, and families.The specific focus on collaboration is a good example of alignment between PBL-, NL pedagogy and the CanMEDS framework, and could be important to further exploration using DPBL.This study will investigate the possibilities of DPBL within the medical education at AAU by exploring and testing digitally supported pedagogical design options for facilitating the acquisition of collaborative competencies.This explorative sequential mixed-method study will explore user-needs and perspectives using DPBL in the medical education. This contextualized knowledge will inform the development of a new teaching intervention aimed at enhancing the Collaborator role. It will be evaluated using quantitative measures of student engagement, time requirements, satisfaction and self-report learning outcomes. The data will be merged with focus group interviews to gain an in-depth understanding of the quantitative results.The theoretical background will be learning design, including constructivism. This approach will be employed using the ACAD-model. The DPBL will include a digital element, the podcast media, and a pedagogical practice encouraging the medical students to engage actively in the learning process. This is facilitated by podcast production in groups.At NLC24 the findings of the user-needs and perspectives will be presented and interpreted as part of the design and frame of the podcast intervention. The intervention will take place in autumn 2024 and this can answer if NL and PBL is part of the future education to foster collaboration.

Index Card Match Boosts Math Learning by 84.2%

This study examines the effectiveness of the Index Card Match (ICM) learning model on fifth-grade mathematics education at SDIT Ainul Yaqin. Using a pre-experimental design, 20 students were selected through purposive sampling. Test sheets were used to measure learning outcomes, and data analysis included testing for normality and calculating N-Gain scores. The results showed a significant 84.2% improvement in mathematics learning outcomes, indicating the positive impact of the ICM model on student achievement. This research contributes to understanding innovative teaching methods' efficacy in enhancing elementary mathematics education. Highlight: Effective Math Learning: Evaluating Index Card Match model in fifth-grade math education. Pre-Experimental Design: Utilizing purposive sampling to assess teaching model impact. Notable Improvement: 84.2% increase in math learning outcomes observed. Keyword: Index Card Match, Mathematics Education, Elementary School, Learning Outcomes, Innovative Teaching Methods.

Integrity games: an online teaching tool on academic integrity for undergraduate students

In this paper, we introduce Integrity Games (https://integgame.eu/) – a freely available, gamified online teaching tool on academic integrity. In addition, we present results from a randomized controlled experiment measuring the learning outcomes from playing Integrity Games.Integrity Games engages students in reflections on realistic and relevant academic integrity issues that lie in the grey zone between good practice and misconduct. Thereby, it aims to 1) motivate students to learn more about academic integrity, 2) increase their awareness of the grey-zone issues, and 3) increase their awareness of misconduct. To achieve these aims, the tool presents four gamified cases that lead students through an engaging narrative.The experiment to measure learning outcomes was conducted in three European countries, and included N = 257 participants from across natural science, social science and the humanities. We show that the participants enjoyed playing Integrity Games, and that it increased their sensitivity to grey-zone issues and misconduct. However, the increases identified were similar to those achieved by the participants in the control group reading a non-gamified text.We end by discussing the value of gamification in online academic integrity training in light of these results.

The Influence of Problem Based Learning Weblog on Students Motivation and Learning Outcomes on Thermochemical

This research aims to determine the influence of weblog media using the problem-based learning model on student motivation and learning outcomes on thermochemical material. This research was conducted at SMAN 1 Percut Sei Tuan in the 2023/2024 academic year. Sample determination was carried out using a purposive sampling technique. The sample consisted of 2 classes, namely class XI-Matlanko 2 as an experimental class (30 students) which was taught using Weblog media and class The instruments used are test instruments to measure learning outcomes and non-test instruments to measure learning motivation. The results of this research indicate that there is an influence of using a weblog using a problem-based learning model on student learning motivation by testing the sig hypothesis. 0.00 < α (0.05) and there is also an influence of using a weblog using the problem-based learning model on student learning motivation with hypothesis testing sig. 0.00 < α (0.05). Apart from that, there is a correlation between learning motivation and student learning outcomes who are taught using weblog media using the problem-based learning model with sig. 0.00 < α (0.05) and Pearson correlation 0.953 with the high category.

Developing professional development for vocational teachers based on the OBE framework and its effect on trainees’ learning motivation and training satisfaction

Professional Development (PD) for teachers plays a significant role in nurturing new skills, extending updated knowledge and promoting educational reform. The concept of Outcome-Based Education (OBE) is highly recognised in the field of education as it matches the student-centred claim and emphasises measurable learning outcomes. In order to improve the training effectiveness and stimulate vocational teachers’ learning motivation, authors in this research developed a PD for vocational teachers according to the design process and learning outcomes of the OBE concept. Trainees’ learning motivation is measured through the questionnaire based on Kirkpatrick’s model of training evaluation and the ARCS Model of motivation. A total of 40 secondary vocational teachers and 40 higher vocational teachers from Guangdong, China were enrolled in this research. The analysis of quantitative data was conducted using paired samples t-test and one-sample t-test to evaluate trainees’ motivation and satisfaction throughout the PD. The findings of this research suggest that the PD design based on the OBE framework has a significant impact on trainees’ learning motivation and training satisfaction according to the comparison of the data collected from trainees before and after attending the PD.

Impact of Artificial Intelligence on Nursing Students' Attitudes toward Older Adults: A Pre/Post-Study.

As the global population ages, nurses with a positive attitude toward caring for older adults is crucial. However, studies indicate that nursing students often exhibit negative attitudes toward older adults. This study aimed to determine if a three-phased educational intervention significantly improved nursing students' attitudes toward older adults. A pre/post-test study design was used to measure the change in nursing students' attitudes toward older adults, as measured by the UCLA Geriatrics Attitudes Survey, after participating in an Artificial Intelligence in Education learning event (n = 151). Results indicate that post-intervention scores (M = 35.07, SD = 5.34) increased from pre-intervention scores (M = 34.50, SD = 4.86). This difference was statistically significant at the 0.10 significance level (t = 1.88, p = 0.06). Incorporating artificial intelligence technology in a learning event is an effective educational strategy due to its convenience, repetition, and measurable learning outcomes. Improved attitudes toward older adults are foundational for delivering competent care to a rapidly growing aging population. This study was prospectively registered with the university's Institutional Review Board (IRB) on 30 July 2021 with the registration number IRB-FY22-3.

Upaya Meningkatkan Hasil Belajar IPA pada Materi Perubahan Wujud Benda Melalui Metode Eksperimen SDN 054906 Tebasan Lama

The problem with the teaching methods used by teachers in the classroom in science subjects, especially the material "changes in the form of objects", is that teachers only use lecture or theory methods so that the learning process is only teacher-centred and has an impact on low student learning outcomes. The aim of this research is to make efforts to improve students' science learning outcomes through experimental methods at SDN 054906 Tebasan Lama. This type of research is Classroom Action Research (PTK). The subjects of this research were 20 class III students at SDN 054906 Tebasan Lama. This research data collection technique was carried out using tests and non-tests, the tests contained evaluation questions to measure learning outcomes and the non-tests consisted of observation and documentation observation sheets. The data analysis technique uses reflection analysis by connecting the data obtained through tests with predetermined success criteria data. The results of the research showed that before being given experimental method treatment in cycle I (pre-test) the learning outcomes were obtained with an average score of 48 and a completion percentage of 25% of the minimum completeness criteria, whereas after being given experimental method treatment in cycle II (post-test) There was an increase in the completion percentage by 60% with an average value of 82.75 and a completion percentage of 85%. So it can be concluded that efforts to improve students' science learning outcomes using experimental methods at SDN 054906 Tebasan Lama were declared successful and had a positive impact on improving student learning outcomes.

Efektivitas Model Pembelajaran Picture and picture terhadap Hasil Belajar IPA Siswa di Sekolah Dasar

This study aims to evaluate the effectiveness of the Picture and picture learning model in improving science learning outcomes at SDN Inpres Kawae. The methodology employed was a quasi-experimental design with a subject group of 13 fifth-grade students, comprising 1 male and 12 female students. Data were collected using a test instrument to measure learning outcomes before and after the implementation of the Picture and picture learning model. The results indicate a significant improvement in students' learning outcomes. Before the implementation of the model, no students achieved the very high category (scores 76-100) on the pretest. However, after implementation, 7 students (about 45% of the total sample) reached the very high category on the posttest. This demonstrates that the Picture and picture learning model is effective in enhancing the effectiveness of science learning outcomes at SDN Inpres Kawae

Study of the effectiveness of modern learning technologies in preparing future professionals

This study investigates the effectiveness of contemporary learning technologies in equipping prospective professionals with the necessary skills. The objective is to assess how modern teaching tools enhance the preparation of future experts in diverse fields. The methodology involves a comparative analysis between traditional teaching methods and the integration of advanced technologies in educational settings, measuring learning outcomes and student engagement. The findings reveal a significant improvement in students' retention of information, critical thinking abilities, and practical skill acquisition when exposed to modern learning tools. Moreover, the study highlights the importance of adapting teaching practices to align with technological advancements to better prepare future professionals for the evolving demands of the workforce.

How does assessment shape student identities? An integrative review

ABSTRACT Assessment of student learning is commonly understood as a seemingly objective measurement of learning outcomes. It is seen as fair that assessment targets students’ abilities – not their identities or personalities. This idea fails to acknowledge how assessment transforms its object, the students, often in unintended ways. While higher education research has largely emphasised the impact of assessment on student learning, the ontological question of how assessment shapes students has remained marginal. This is despite assessment being a part of the fabric of life in higher education: examinations, assignments, grades, rubrics, rankings, and metrics characterise the student experience. The present study addresses this knowledge gap by reviewing empirical studies on how assessment shapes student identities through a theory-driven integrative review of 32 articles (2007–2023). First, these studies are summarised to understand how they conceptualise ‘identities’, what kinds of assessment practices they depict, and what the reported influences on student identities are. Second, a conceptual synthesis provides a metatheory on how assessment transforms student identities in higher education. This theorisation suggests that assessment shapes students through the ontological mechanisms of (1) gatekeeping, (2) legitimisation, (3) concretisation, (4) socialisation and (5) individualisation. Moreover, the theorisation considers students’ own agency over their identity development. Overall, this study emphasises the crucial, hitherto overlooked role of assessment in shaping students’ professional and personal identities in higher education. This study proposes a research agenda to better understand student identity formation in and through assessment.

Video clips in physics education

Film recordings – video clips – have been used in the teaching and learning processes for decades. At the very beginning, the dominant role was played by television and professionally prepared recordings on portable media (e.g. LaserDiscs). With the advancement of technology and the emergence of new media, as well as the revolution in access to image and sound recording and processing devices, video clips – including amateur ones – have become the dominant path of contemporary visual communication. The paper is of an overview character and discusses examples of educational use of video in physics education in the past and at present, including TV lectures, popular science programs, dedicated video materials and educational environments, software for video measurement and evaluation of learning outcomes. Various illustrations along with literature references are given to outline potential educational pathways in making use of video clips as didactically valuable medium in teaching - learning physics.

Efficacy of an Antimicrobial Reality Simulator (AMRSim) as an Educational Tool for Teaching Antimicrobial Stewardship to Veterinary Medicine Undergraduates

Purpose: Simulation-based medical education has changed the teaching of clinical practice skills, with scenario-based simulations being particularly effective in supporting learning in veterinary medicine. In this study, we explore the efficacy of simulation education to teach infection prevention and control (IPC) as part of Antimicrobial Stewardship (AMS) teaching for early years clinical veterinary medicine undergraduates. Methods: The intervention was designed as a 30-minute workshop with a simulation and script delivered online for 130 students as a part of hybrid teaching within the undergraduate curriculum. Learning outcome measures were compared between an intervention group and waitlist-control group using one-way between-groups analysis of covariance tests. Results: Significant differences between groups were found for outcomes measures related to short-term knowledge gain and confidence in IPC and AMS in small animal clinical practice. However, lateral knowledge transfer to large animal species clinical practice showed no significant differences. Student feedback indicated that the intervention was an enjoyable and engaging way to learn AMS. Conclusions: The intervention provided short-term knowledge gain in IPC protocols and enhanced procedural skills via active learning and motivation to learn in large groups of students. Future improvements would be to include large animal clinical scenario discussions and evaluate longer-term knowledge gain.