Higher Education Outcomes Research Articles

A multivariate analysis of the early dropout using classical machine learning and local interpretable model-agnostic explanations

Student dropout rates can have a significant negative impact on both the development of educational institutions and the personal growth of students. Consequently, many institutions are focused on identifying key factors that contribute to dropout and implementing strategies to mitigate them. This study aims to predict student dropout rates using classical machine learning algorithms while analyzing the key factors influencing these outcomes in higher education. The dataset includes demographic, socioeconomic, and academic information from various sources. Additionally, the study leverages the Local Interpretable Model-Agnostic Explanations (LIME) model to provide insights into the predictions, offering a clearer understanding of the factors driving dropout decisions. This knowledge is crucial for identifying influential factors and, more importantly, enhancing early intervention strategies and policies in educational settings, ultimately reducing dropout rates.

Higher education and public good in England

AbstractIn the Anglophone jurisdictions, higher education policy is over-determined by economic policy and subjected to neoliberal regulation based on quasi-market competition between corporatised institutions, regulated by performative comparisons, tuition fees, and outputs imagined as commodities. England installed marketisation in successive policy changes between the Thatcher government’s introduction of commercial fees for international students in 1979 and the full-fee market for domestic students, supported by subsidised income-contingent loans, in 2012. Policy commitment to public good outcomes (the collective and non-pecuniary individual benefits of higher education) was largely emptied out, leaving only attenuated proxies such as widening participation and research impact. Responsibility for public good outcomes was transferred from government to institutions. Following a discussion of Anglophone concepts of ‘public’ and an overview of key policy reports from 1963–2019, the paper reports on qualitative research into approaches to higher education and public good in England. There were 24 semi-structured interviews, with middle and senior manager-leaders in two universities and policy professionals. Nearly all advocated a broad public good role, in contrast to policy in England, and provided examples of public outcomes in higher education. However, these concepts lacked clarity, while at the same time the shaping effects of the market were sharply understood.

The impact of different combinations of game elements for gamified learning in higher education on student learning outcomes: a multilevel meta-analysis

ABSTRACT This study employed a multilevel meta-analysis to assess the overall effectiveness of gamified learning on educational outcomes in higher education based on 143 effect sizes from 32 studies published between 2013 and 2024. The analysis specifically evaluated the impact of different combinations of game elements on cognitive, skill-based, and affective learning outcomes and explored the moderating variables influencing gamified learning effects. The findings reveal that gamified learning (g = 0.515) has a moderate impact on student learning outcomes compared to non-gamified conditions. More specifically, the impact of gamified learning on cognitive learning outcomes (g = 0.716) and skill-based learning outcomes (g = 0.605) is moderately high, while its effect on affective learning outcomes is moderately low (g = 0.317). The most effective combinations of game elements for enhancing the cognitive, skill-based, and affective learning outcomes are ‘Performance/Measurement + Ecological + Social + Personal,’ ‘Performance/Measurement + Social + Personal,’ and ‘Performance/Measurement + Ecological + Social + Personal + Fictional,’ respectively. These findings can guide educators in designing gamified learning experiences that significantly enhance various learning outcomes. Additionally, the learning domain and intervention duration moderated the impact of gamified learning.

A Bibliometric Literature Review on Trends in the Internationalization of Higher Education

In recent years, the internationalization of higher education has become a critical theme, reflecting global interconnectedness and the increasing mobility of students and academics. This study aims to identify and analyze trends in internationalization research from 2015 to 2024. Utilizing a bibliometric analysis of 9,180 articles and 44,000 keywords from Web of Science and Scopus databases, the research synthesizes developments in nine key fields over the past decade. Methods include data cleaning, keyword determination, and the use of Excel for data processing and analysis. The results reveal significant progress in understanding the complexities of internationalization, such as student mobility, societal and cultural integration, educational methods, and quality assurance. The study highlights the accelerated role of digital technology due to the COVID-19 pandemic and emerging national security issues. Conclusions offer new theoretical and practical insights into the role of internationalization in higher education outcomes and predict future trends. The findings have significant implications for policy-making, institutional strategies, and future research directions. This research contributes to the literature by providing a comprehensive analysis of past trends and suggesting directions for future studies, emphasizing the need for coordinated efforts from educational institutions, governments, and international organizations. Emphasis is placed on inclusivity and sustainability, with a call for innovative strategies to address emerging challenges and leverage new opportunities in the field of higher education internationalization.

AI and Education: Impact of AI on Learning Outcomes in Higher Education

AI and Education: Impact of AI on Learning Outcomes in Higher Education

Stability indicators, child welfare provisioning and trajectory into university for care-experienced youth

PurposeChildren and youth who enter the care system have lower educational outcomes and university participation rates than their peers. This study aims to understand trend exceptions by examining the background of care-experienced undergraduates attending a research-intensive university in Canada.Design/methodology/approachInformed by social affordance theory, this study examined the presence of four indicators of stability (home, household occupants, school and legal status) during participants’ final three years of secondary education. Care-experienced undergraduates (N = 30) completed an online questionnaire. Associations between stability indicators, child welfare involvement in the final year of high school, educational outcomes and routes into higher education were analysed.FindingsStability across three to four indicators was experienced by 40% of participants, while 47% reported changes across three to four indicators. Only 20% had a change of school as compared to 47%–60% for other indicators. During their final year of high school, 73% of participants were supported by the child welfare system, with 50% being supported via a support program specifically for 16- to 18-year-olds. Stability scores were significantly lower for this latter subgroup compared to those who spent time in foster or group care and those who did not receive child welfare support during the final year of high school. Ninety percent of participants graduated from high school, 67% with the grades required to attend university. Three trajectories into undergraduate study were identified but could not be predicted using regression models.Originality/valueThis paper focuses on what has supported progression into a research-intensive university for care-experienced young adults and highlights the role of support programs for 16- to 18-year-olds.

Putting ICAP to the test: how technology-enhanced learning activities are related to cognitive and affective-motivational learning outcomes in higher education

Digital technology is considered to have great potential to promote learning in higher education. In line with the Interactive, Constructive, Active, Passive (ICAP) framework, this seems to be particularly true when instructors stimulate high-quality learning activities such as constructive and interactive learning activities instead of active and passive learning activities. Against the background of a lack of empirical studies in authentic, technology-enhanced instructional settings, we investigated the cognitive and affective-motivational effects of these learning activity modes in technology-enhanced higher education courses. To this end, we used 3.820 student assessments regarding 170 course sessions for which the teachers stated the learning activities students were engaged in. Results of multilevel structural equation modelling highlight the importance of technology-enhanced interactive learning activities for students’ perception of learning and the potential negative consequences of passive learning activities for affective-motivational outcomes. However, the superiority of constructive and interactive learning activities compared to passive and active learning activities for cognitive and affective-motivational outcomes was not supported by the findings. Instead, the findings point to potential differential effects of the individual learning activities within one activity mode. Future research should follow up on these effects to gain a more fine-grained understanding of how technology-enhanced learning activities can be optimized to enhance students’ learning outcomes.

The Influence of Artificial Intelligence (AI) and Mobile Learning on Learning Outcomes in Higher Education: Did the Mediation of Self-Competence Matter?

Islamic Religious Education (PAI) has a significant impact on the development of students' character, morality, and overall learning outcomes. This study aims to investigate the effects of artificial intelligence (AI) and mobile learning on student learning outcomes, with a specific focus on the role of students' self-competence as a mediating factor. Employing a quantitative survey approach, the research included 208 students from the PAI Study Program at IAIN Ponorogo, using probability sampling techniques. Data was collected through Likert-scale questionnaires, and the research data was analyzed using PLS-SEM analysis. The results indicate a positive influence of AI and mobile learning on student learning outcomes, with self-competence playing a crucial role as a mediating factor. These findings highlight the importance of educators promoting self-regulation, self-efficacy, and motivation skills within online learning environments. The study emphasizes the potential of integrating AI and mobile learning to enhance the quality of education and recommends that educators continuously update their knowledge of technological advancements through training and collaboration. Strengthening these competencies can lead to a more interactive, personalized, and adaptive learning environment for students.

Transforming teaching through cooperative inquiry: meaningful research for university teachers

ABSTRACT In this article, seven participants from nursing, social work, accounting, fine arts, bioscience, and learning support disciplines share insights gained through participation in a transdisciplinary cooperative inquiry research group aimed at developing excellence in teaching. This Cooperative Inquiry for Reflection and Collaboration on Learning Effectiveness (CIRCLE) group promoted transformation of individual participants’ teaching as well as development of interdepartmental collaboration and camaraderie within the context of contemporary, performance-based academic environments. Collaborative, pedagogical, action research was undertaken through cooperative inquiry (CI) to explore transformative learning activities that increased teachers’ and students’ engagement while covering prescribed learning outcomes using creative approaches. The results are presented in a reflexive, collaborative autoethnography through seven authentic teacher stories. Reflections on the process and the impact of being in the research group provide evidence of the potential transdisciplinary, CI research groups offer to enhance research and teaching outcomes in higher education. These findings are significant internationally in light of the necessity to meet the increasing expectations of all stakeholders in the global tertiary education sector.

Adaptive Education as a Key Element for Enhancing the Effectiveness of Learning Processes

This article explores issues related to the adaptive learning of students in higher education institutions, presenting the main characteristics of both traditional and contemporary educational paradigms. It describes the latter’s advantages in the context of the dynamic changes of the modern world and, specifically, the demands on the process and outcomes of higher education. In discussing modern learning concepts, those foundational to adaptive learning are examined separately. The authors provide a description, objectives, methods, and results of the study conducted as an experiment with first-year undergraduate students. The results are assessed in the conclusion, and recommendations for their practical application are presented.

The State of the Empirical Evidence for Interdisciplinary Learning Outcomes in Higher Education: A Systematic Review

Abstract: This review systematically synthesizes empirical evidence on learning outcomes of interdisciplinary learning. A meta-synthesis approach was used to synthesize data in two rounds, based on strict (n = 38) versus more lenient (n = 60) operationalizations of interdisciplinary learning. The results revealed a variety of interdisciplinary learning outcomes that were categorized into three overarching themes: 1) academic and disciplinary engagement, 2) metacognitive skills, and 3) perspective taking skills. Process results revealed that empirical evidence in the field is still in its infancy. The findings of this review can be considered as a starting point for the further operationalization of interdisciplinary learning outcomes, so that robust evidence for various aspects of interdisciplinary learning can be collected, and compared with other forms of learning such as cross or transdisciplinary learning.

Hospital Use of a Web-Based Clinical Knowledge Support System and In-Training Examination Performance Among Postgraduate Resident Physicians in Japan: Nationwide Observational Study.

The relationship between educational outcomes and the use of web-based clinical knowledge support systems in teaching hospitals remains unknown in Japan. A previous study on this topic could have been affected by recall bias because of the use of a self-reported questionnaire. We aimed to explore the relationship between the use of the Wolters Kluwer UpToDate clinical knowledge support system in teaching hospitals and residents' General Medicine In-Training Examination (GM-ITE) scores. In this study, we objectively evaluated the relationship between the total number of UpToDate hospital use logs and the GM-ITE scores. This nationwide cross-sectional study included postgraduate year-1 and -2 residents who had taken the examination in the 2020 academic year. Hospital-level information was obtained from published web pages, and UpToDate hospital use logs were provided by Wolters Kluwer. We evaluated the relationship between the total number of UpToDate hospital use logs and residents' GM-ITE scores. We analyzed 215 teaching hospitals with at least 5 GM-ITE examinees and hospital use logs from 2017 to 2019. The study population consisted of 3013 residents from 215 teaching hospitals with at least 5 GM-ITE examinees and web-based resource use log data from 2017 to 2019. High-use hospital residents had significantly higher GM-ITE scores than low-use hospital residents (mean 26.9, SD 2.0 vs mean 26.2, SD 2.3; P=.009; Cohen d=0.35, 95% CI 0.08-0.62). The GM-ITE scores were significantly correlated with the total number of hospital use logs (Pearson r=0.28; P<.001). The multilevel analysis revealed a positive association between the total number of logs divided by the number of hospital physicians and the GM-ITE scores (estimated coefficient=0.36, 95% CI 0.14-0.59; P=.001). The findings suggest that the development of residents' clinical reasoning abilities through UpToDate is associated with high GM-ITE scores. Thus, higher use of UpToDate may lead physicians and residents in high-use hospitals to increase the implementation of evidence-based medicine, leading to high educational outcomes.

The Impact of Merdeka Belajar Kampus Merdeka (Emancipated Learning) and Motivation on Students’ Learning Outcomes in Higher Education in Indonesia

The implementation of Merdeka Belajar Kampus Merdeka (MBKM/Emancipated Learning) with a form of learning activity that is more involved in community life and a hybrid learning model is very likely to influence student learning outcomes. This study explores the impact of implementing the MBKM program, which emphasizes a learning approach integrated with community life and adopts a hybrid learning model. The objectives of this study are to analyze the determinants of students’ learning outcomes in the context of MBKM through hybrid learning and assess factors that affect student learning outcomes in the same learning model. The methodology used was a quantitative survey design. These research steps involved questionnaires that had been proven valid and reliable for data collection. The collected data was then analyzed using descriptive and inferential statistics, with path analysis techniques to understand the relationship between the variables studied. The results reveal that 1) The learning model has a significant influence on student learning outcomes; 2) Learning motivation has a significant effect on learning outcomes; 3) MBKM structure contributes significantly to learning outcomes; 4) The learning model has a significant effect on learning motivation, and 5) MBKM structure affects student learning motivation significantly. This research provides important insights into the effectiveness of emancipated learning (MBKM) and hybrid learning in higher education in Indonesia.

Evaluating the impact of educational technology on learning outcomes in the higher education sector: a systematic review

This systematic review evaluates the impact of educational technology on learning outcomes in the higher education sector. With the rapid integration of digital tools in educational settings, understanding their effectiveness has become crucial. The paper's objective is to synthesize existing research findings to assess how educational technologies influence learning outcomes. We employed a comprehensive search strategy across multiple databases, including peer-reviewed journals and conference proceedings, to collect studies published in the last decade. The inclusion criteria focused on empirical studies that measured the impact of technologies such as learning management systems, online simulations, and digital collaborative tools on student learning outcomes in higher education. Our methodology involved a rigorous screening process, quality assessment, and data extraction, followed by a thematic synthesis of the findings. The review included a total of 47 studies, which were analyzed to identify patterns, themes, and gaps in the current literature. Key findings suggest that educational technology, when effectively integrated into teaching and learning processes, can enhance student engagement, improve knowledge retention, and foster higher-order thinking skills. However, the impact varies significantly depending on the type of technology used, pedagogical approach, and context of implementation. The review also highlights the importance of faculty training and support in maximizing the potential benefits of educational technologies. Educational technology holds promise for improving learning outcomes in higher education, but its success is contingent upon thoughtful implementation, pedagogical alignment, and ongoing support for instructors. Future research should focus on longitudinal studies to better understand the long-term effects of educational technologies on learning outcomes. Keywords: Educational Technology, Learning Outcomes, Higher Education, Digital Divide, Accessibility, Equity, Blended Learning, Virtual Reality, Artificial Intelligence, Mobile Learning, Pedagogical Approaches, Professional Development, Strategic Integration.

Exploring the Impact of Game-Based Learning and Creative Active-Learning Activities on Student Engagement and Academic Performance: A Case Study in the basic sciences for Pharmacy Education

Game-based learning is a well-established educational concept that has been rejuvenated through digital technology. Game-based learning leverages the interactive nature of games to promote active knowledge acquisition in students. The effectiveness of game-based learning centers on two key components: competition and engagement. This theory is rooted in the belief that engagement occurs when students actively perform tasks within a stimulating game environment, fostering active learning. Modern digital games seamlessly integrate educational content with gameplay, facilitating the transfer of information from short-term to long-term memory. Game-based learning is applicable across various educational settings, including higher education in the health professions. In higher education, digital games stimulate active engagement, supporting the development of problem-solving skills and collaboration in academic environments. Furthermore, game-based learning instills a valuable lesson in students — the ability to learn from mistakes and failures while completing the assignment. Game-based learning provides a safe space for students to learn, offering scaffolding through simulations, preparing them for course performance. Some of the most popular educational games are those that allow educators to create questions with answers, enabling students to compete for points. Most of these games can be specifically tailored for the current content, are accessible online, and multiple groups can participate simultaneously. In this study, we developed several web-based games for multiple student cohorts, incorporating them into class activities and making them available as solo-play options within the Learning Management System (LMS) as SCORM packages. In specific courses such as biochemistry and physiology, students were invited to engage in free online games developed by the instructor, employing various free platforms. The games were optional, and participation was not tied to grading. These games featured questions designed at a Bloom's Taxonomy level comparable to the summative assessments in the course. The games fostered a competitive, enjoyable atmosphere that was well-received by students. These game questions served as additional checkpoints for revisiting key concepts and essential details from the class sessions. Importantly, as these questions were not associated with grading, it ensured a stress-free learning experience. As assessment resources, students were able to access the games through the LMS, reviewing questions and playing them repeatedly to learn from their errors and reinforce their understanding. This approach allowed students to engage in self-assessment while feeling that they were studying, even outside the classroom. To investigate whether student engagement with games correlates with improved academic performance, we tracked access to the games in the LMS during the semester. We recorded the number of times each student accessed the games and correlated this data with their course grade. In addition, we distributed an end-of-semester survey to gather students' perceptions regarding the utility of game-based learning in their learning process. The feedback from students was overwhelmingly positive, highlighting the significant benefits of game-based learning in their learning journey. However, our analysis revealed that there was no statistically significant correlation between student engagement with the games and their course grade. In conclusion, our study demonstrates that the integration of game-based learning activities into the classroom environment enhances student engagement, promotes active learning, and receives strong positive feedback from students. While game-based learning offers a valuable tool for reinforcing key concepts and providing a stress-free environment for self-assessment, our findings do not suggest a direct correlation between student engagement with game-based learning and improved course grades. This intriguing result underscores the complex relationship between student engagement and academic performance, suggesting that other factors play a pivotal role in determining student outcomes in higher education. None. This is the full abstract presented at the American Physiology Summit 2024 meeting and is only available in HTML format. There are no additional versions or additional content available for this abstract. Physiology was not involved in the peer review process.

Evaluating the impact of educational technology on learning outcomes in the higher education sector: A systematic review

This systematic review evaluates the impact of educational technology on learning outcomes in the higher education sector. With the rapid integration of digital tools in educational settings, understanding their effectiveness has become crucial. The paper's objective is to synthesize existing research findings to assess how educational technologies influence learning outcomes. We employed a comprehensive search strategy across multiple databases, including peer-reviewed journals and conference proceedings, to collect studies published in the last decade. The inclusion criteria focused on empirical studies that measured the impact of technologies such as learning management systems, online simulations, and digital collaborative tools on student learning outcomes in higher education. Our methodology involved a rigorous screening process, quality assessment, and data extraction, followed by a thematic synthesis of the findings. The review included a total of 47 studies, which were analyzed to identify patterns, themes, and gaps in the current literature. Key findings suggest that educational technology, when effectively integrated into teaching and learning processes, can enhance student engagement, improve knowledge retention, and foster higher-order thinking skills. However, the impact varies significantly depending on the type of technology used, pedagogical approach, and context of implementation. The review also highlights the importance of faculty training and support in maximizing the potential benefits of educational technologies. Educational technology holds promise for improving learning outcomes in higher education, but its success is contingent upon thoughtful implementation, pedagogical alignment, and ongoing support for instructors. Future research should focus on longitudinal studies to better understand the long-term effects of educational technologies on learning outcomes.

Towards a robust approach for evidencing quality in higher education learning: The new CALOHEE model

PurposeKey to transnational higher education (HE) cooperation is building trust to allow for seamless recognition of studies. Building on the Tuning Educational Structures initiative (2001) and lessons learnt from the Organisation for Economic Cooperation and Development (OECD)-Assessment of Learning Outcomes in Higher Education (AHELO) feasibility study, this paper offers a sophisticated approach developed by the European Union (EU)-co-financed project Measuring and Comparing Achievements of Learning Outcomes in Europe (CALOHEE). These evidence the quality and relevance of learning by applying transparent and reliable indicators at the overarching and disciplinary levels. The model results allow for transnational diagnostic assessments to identify the strength and weaknesses of degree programmes.Design/methodology/approachThe materials presented have been developed from 2016 to 2023, applying a bottom-up approach involving approximately 150 academics from 20+ European countries, reflecting the full spectrum of academic fields. Based on intensive face-to-face debate and consultation of stakeholders and anchored in academic literature and wide experience.FindingsAs a result, general (overarching) state-of-the-art reference frameworks have been prepared for the associated degree, bachelor, master and doctorate, as well as aligned qualifications reference frameworks and more detailed learning outcomes/assessment frameworks for 11 subject areas, offering a sound basis for quality assurance. As a follow-up, actual assessment formats for five academic fields have been developed to allow for measuring the actual level of learning at the institutional level from a comparative perspective.Originality/valueFrameworks as well as assessment models and items are highly innovative, content-wise as in the strategy of development, involving renown academics finding common ground. Its value is not limited to Europe but has global significance. The model developed, is also relevant for micro-credentials in defining levels of mastery.

Evaluating The Impact Of Innovative Assignment Design On Student Engagement And Learning Outcomes In Higher Education

This research explores the role of innovative assignment design in enhancing student engagement and learning outcomes within the context of higher education. Utilizing a mixed-methods approach, the study combines quantitative data from surveys of 120 students and 15 instructors of STIA Yappi Makassar across multiple institutions with qualitative insights from semi-structured interviews with a selected subset of these participants. The findings reveal a significant positive correlation between innovative assignment design and increased student engagement, as well as improved learning outcomes. Quantitatively, students exposed to innovative assignments reported higher engagement levels and better learning outcomes compared to their peers in traditional assignment settings. Qualitatively, themes emerged highlighting the benefits of practical application and relevance found in innovative assignments, alongside challenges such as the need for clearer guidelines and additional support. This study underscores the potential of innovative pedagogical strategies to create more engaging, relevant, and effective learning environments in higher education. It calls for educators to embrace and refine these approaches, addressing implementation challenges to fully realize their benefits. The research contributes to the broader discourse on educational quality and innovation, offering evidence-based recommendations for enhancing student engagement and success through pedagogical innovation.

Professional competence of primary education teachers to educate pupils with disabilities

Developments in the practice of inclusive education have led to significant increase of the expectations of a teacher having professional competence. The hitherto ‘two-track’ professional preparation of teachers for their professional role in mainstream and special schools should be replaced by the preparation that enables each teacher to achieve high educational outcomes for all students, including students with disabilities. The aim of the study was to analyze early education teachers’ assessment of their own professional competence to educate students with and without disabilities. A total of 130 teachers participated in the study, in which a diagnostic survey method (Perceived Teacher Professional Competence Questionnaire and Sociodemographic Questionnaire) was applied. The results indicate that both having a background in special education and having experience working with students with disabilities were associated with higher levels of evaluation of a teachers’ perceived competence to work with students with disabilities.

Economic uncertainty, households’ credit situations, and higher education

In this paper, we study the relationship between economic uncertainty, households’ credit situations, and educational outcomes. Using the System Generalized Methods of Moments (SYS-GMM) on educational and economic data from the World Bank and IMF, we find that economic uncertainty and households’ access to credit have positive impacts on higher education. Further analyses suggest that economic uncertainty and households’ access to credit have heterogeneous effects on educational outcomes at the tertiary level, by gender and development status. Specifically, we find that economic uncertainties expand enrollments in developed countries and contract them in developing economies. In addition, access to credit has a more pronounced positive impact on educational outcomes in developing nations compared to developed ones. Furthermore, our analysis indicates that household credit coupled with economic uncertainty decreases women’s educational outcomes in higher education, posing a serious threat to gender equality in higher education. Lastly, we find that monetary policy appears to play a role in these results. These findings remain robust to alternative proxies of economic uncertainty and approach such as the Instrumental Variable (IV) regression method, which uses a political database on government changes and ideological gaps between cabinets as instruments. In general, the findings emphasize the enduring influence of economic uncertainties, typically associated with business cycles, on long-term aspects such as education.