Digital Learning Materials Research Articles

Evaluating Embeddings from Pre-Trained Language Models and Knowledge Graphs for Educational Content Recommendation

Educational content recommendation is a cornerstone of AI-enhanced learning. In particular, to facilitate navigating the diverse learning resources available on learning platforms, methods are needed for automatically linking learning materials, e.g., in order to recommend textbook content based on exercises. Such methods are typically based on semantic textual similarity (STS) and the use of embeddings for text representation. However, it remains unclear what types of embeddings should be used for this task. In this study, we carry out an extensive empirical evaluation of embeddings derived from three different types of models: (i) static embeddings trained using a concept-based knowledge graph, (ii) contextual embeddings from a pre-trained language model, and (iii) contextual embeddings from a large language model (LLM). In addition to evaluating the models individually, various ensembles are explored based on different strategies for combining two models in an early vs. late fusion fashion. The evaluation is carried out using digital textbooks in Swedish for three different subjects and two types of exercises. The results show that using contextual embeddings from an LLM leads to superior performance compared to the other models, and that there is no significant improvement when combining these with static embeddings trained using a knowledge graph. When using embeddings derived from a smaller language model, however, it helps to combine them with knowledge graph embeddings. The performance of the best-performing model is high for both types of exercises, resulting in a mean Recall@3 of 0.96 and 0.95 and a mean MRR of 0.87 and 0.86 for quizzes and study questions, respectively, demonstrating the feasibility of using STS based on text embeddings for educational content recommendation. The ability to link digital learning materials in an unsupervised manner—relying only on readily available pre-trained models—facilitates the development of AI-enhanced learning.

Digital transformation in schools of two southern regions of Sweden through implementation-informed approach: A mixed-methods study protocol.

The enhancement of-or even a shift from-traditional teaching and learning processes to corresponding digital practices has been rapidly occurring during the last two decades. The evidence of this ongoing change is still modest or even weak. However, the adaptation of implementation science in educational settings, a research approach which arose in the healthcare field, offers promising results for systematic and sustained improvements in schools. The aim of this study is to understand how the systematic professional development of teachers and schools principals (the intervention) to use digital learning materials and learning analytics dashboards (the innovations) could allow for innovative and lasting impacts in terms of a sustained implementation strategy, improved teaching practices and student outcomes, as well as evidence-based design of digital learning material and learning analytics dashboards. This longitudinal study uses a quasi-experimental cluster design with schools as the unit. The researchers will enroll gradually 145 experimental schools in the study. In the experimental schools the research team will form a School Team, consisting of teachers/learning-technologists, school principals, and researchers, to support teachers' use of the innovations, with student achievement as the dependent variable. For the experimental schools, the intervention is based on the four longitudinal stages comprising the Active Implementation Framework. With an anticipated student sample of about 13,000 students in grades 1-9, student outcomes data are going to be analyzed using hierarchical linear models. The project seeks to address a pronounced need for favorable conditions for children's learning supported by a specific implementation framework targeting teachers, and to contribute with knowledge about the promotion of improved teaching practices and student outcomes. The project will build capacity using implementation of educational technology in Swedish educational settings.

ELEVATING INSIGHTS: PROGRESSIVE E-BOOKLET DEVELOPMENT IN TEMPERATURE AND HEAT

This study aims to evaluate the feasibility of an E-Booklet centered on temperature and heat materials. Employing the Research and Development (R&D) methodology, the research adheres to the Alessi and Trollip model, progressing through planning, design, and development stages. Validation instruments, encompassing validation sheets for both material and media, were employed. The validation process involved six material experts, including lecturers and teachers, along with three media experts. Results demonstrate the high feasibility of the developed E-Booklet for temperature and heat materials, attaining an average score of 95.58%, categorized as "very feasible." Material expert validation from lecturers yielded an average score of 97.87%, categorized as "very decent," while validation from teachers resulted in an average score of 94.12%, also categorized as "very decent." Media expert validation produced an average score of 94.75%, falling within the "very decent" category. In conclusion, the developed E-Booklet for temperature and heat materials proves highly suitable for integration into the learning process. Implications of the study highlight the importance of integrating innovative digital resources to enhance educational experiences. This research contributes to advancing educational practices through the creation of effective and engaging digital learning materials in the field of temperature and heat.

Digital Learning Materials in Teaching Languages for Special Purposes in Higher Education in QuILL Project

Aim. The Erasmus+ project ‘QuILL – Quality in Language Learning’ was approved within the Strategic Partnerships for Digital Education Readiness as it proposes a new insight into the way digital open educational resources (OER) are made available to language lecturers teaching languages for specific purposes or as foreign languages and how they can maximise their use in a qualitative way. The project ended in February 2023. One of QuILL’s main goals is to provide higher education language lecturers with a substantial number of Open Educational Resources (OER) to assist them in the teaching and learning process. Apart from that, a training package has been developed to guide lecturers into the way they identify, use and create online resources. The guidelines brought into play in the e-book of the project concur with the core principles that guide higher education lecturers’ teaching practice: to make learners become motivated and engaged, unfettering them from narrowmindedness, fostering autonomy and critical thinking.
 Methods. The identification of the sources has been made by the experts of the project partnership following a bottom up approach and the participation of a relevant number of potential beneficiaries, focusing in particular on Language for Specific Purpose (LSP). Each resource is presented both in English and the target language through a review, a case study and a guideline on how to use it. The e-learning based package addressed to university LSP lecturers is specifically aimed to guide them in innovating their language teaching methodologies through the effective use of quality digital based OER teaching sources including 2 operative tools, 2 case studies and an interactive self-assessment test. A third outcome of the project is an e-book titled Implementation of Digital language Learning Opportunities. This publication brings together contributions from the six partners that integrate the QuILL project consortium. Therefore, it consists of six chapters.
 Results. In the QuILL portal, both language lecturers and learners will find many OERs for 18 European languages, already tested and validated by students in real teaching scenarios. The OERs used for LSP described according to quality indicators: comprehensive approach, added value, motivation enhancement, innovation, transferability, skills assessment and validation, adaptability. The content of the e-learning based training package is structured in 3 modules, each of which follows the same structure with the combination of a readable e-text, extensive use of links to existing resources and downloadable supplementary document. The e-book, containing important theoretical and practical guidelines, is aimed at Higher Education (HE) policy makers, as well as LSP lecturers, to improve the implementation of digital based language learning opportunities in higher education systems. It also intends to present, examine and reflect on the opportunities related to the use of digital technology in the language learning and teaching process.
 Conclusions. Most resources found on the Internet are targeted at learners of English. This is one of the issues that QuILL addresses. The publication, an e-book on digital language teaching addresses the process of language learning via digital resources and keywords such as “quality” “innovation”, and “digital education” are common to all of the six chapters. In the specific context of LSP, digital technologies equip teachers and students with more tools that will empower them during the learning and teaching process, so they continue to open as many doors as possible.

Co-Developing an Easy-to-Use Learning Analytics Dashboard for Teachers in Primary/Secondary Education: A Human-Centered Design Approach

Learning Analytics Dashboards (LADs) can help provide insights and inform pedagogical decisions by supporting the analysis of large amounts of educational data, obtained from sources such as Digital Learning Materials (DLMs). Extracting requirements is a crucial step in developing a LAD, as it helps identify the underlying design problem that needs to be addressed. In fact, determining the problem that requires a solution is one of the primary objectives of requirements extraction. Although there have been studies on the development of LADs for K12 education, these studies have not specifically emphasized the use of a Human-Centered Design (HCD) approach to better comprehend the teachers’ requirements and produce more stimulating insights. In this paper we apply prototyping, which is widely acknowledged as a successful way for rapidly implementing cost-effective designs and efficiently gathering stakeholder feedback, to elicit such requirements. We present a three-step HCD approach, involving a design cycle that employs paper and interactive prototypes to guide the systematic and effective design of LADs that truly meet teacher requirements in primary/secondary education, actively engaging them in the design process. We then conducted interviews and usability testing to co-design and develop a LAD that can be used in classroom’s everyday learning activities. Our results show that the visualizations of the interactive prototype were easily interpreted by the participants, verifying our initial goal of co-developing an easy-to-use LAD.

Role of Libraries in Implementing the New Education Policy 2020 in Higher Education in India

Libraries play a crucial and multi-faceted role in the implementation of the New Education Policy (NEP) of 2020 in higher education in India. They function as hubs of knowledge and are instrumental in supporting the educational goals outlined in the NEP. This article examines the intricate and significant part that libraries play in the effective execution of the NEP, specifically within the context of NEP 2020. It discusses how libraries can promote access to diverse knowledge resources, encourage research, and foster critical thinking skills among students. By utilizing the potential of libraries as centers of learning, higher education institutions can establish a more inclusive and just learning environment according to the NEP’s vision. The primary focus of this study is to comprehensively elaborate on the multi-faceted involvement of libraries, including the active promotion of digital literacy, cultivation of research efforts and innovative initiatives, and facilitation of an all-encompassing and impartial approach to acquiring information for all segments of society. The article notes that libraries can contribute to the promotion of digital literacy, which is a critical aspect of the NEP. As the use of digital technologies in education increases, libraries play a vital role in providing access to a wide range of digital resources, such as e-books, online databases, and various digital learning materials. They can provide instructional guidance and assistance to both students and faculty members on the effective use of digital tools and platforms, leading to a significant improvement in their digital literacy skills. Libraries also offer access to a vast array of scholarly resources, including academic journals, research papers, and books. This accessibility empowers students and faculty members to engage in significant research endeavors. They also provide guidance and direction for conducting literature reviews, accessing relevant research databases, and keeping up with the latest developments in various disciplines. Therefore, libraries serve as collaborative spaces for interdisciplinary research and innovation, facilitating knowledge sharing and networking among students and faculty members, which is essential for NEP 2020. This research emphasizes the expected academic roles of libraries in enhancing all educational programs and proposes specific strategies to improve their functions. Previous literature is combined with qualitative research data from semi-structured interviews with 125 faculties, including Professors, Associate Professors, and working librarians from four universities associated with higher education institutions. Questionnaires and interview tools were used to explore the relevant data collection instruments.

Factors that impact student frustration in digital learning environments

The use of digital learning technologies and platforms has skyrocketed over the past decade. Although digital materials have many advantages, using them can be frustrating to students. Frustration is a negative achievement emotion that can serve as a barrier to learning. Therefore, understanding how frustration influences student learning and attitudes toward technology can help create more engaging and effective digital learning experiences. Previous research has identified three areas of frustration with academic e-textbooks (e-text frustration): (1) interactions with e-text interface, (2) technical difficulties, and (3) curriculum integration. This study investigated the relationships among e-text frustration and motivational, cognitive, attitudinal, academic, and demographic factors that impact frustration with e-texts in undergraduate biology classes. Extraneous cognitive load and motivation significantly predicted each of the three frustration constituents. Surprisingly, intrinsic cognitive load failed to predict e-text frustration. This study makes an important contribution to emotion research in education by examining the factors that impact learning in digital settings and emotions. Its implications are relevant for educators, researchers, and developers of digital learning materials and environments.

Digital Teaching Materials Development Containing Environmental Education Using Task Based Language Learning (TBLL)

The Covid-19 pandemic results in unavoidable changes in all aspects of life, including education. This pandemic has led to the opportunity to enter digital learning. This study aims to develop digital learning materials based on Task-Based Language Teaching (TBLT) which contains environmental education for senior high school students. This Research & Development (R&D) was based on Plomp’s development model. Digital learning materials were developed using the i-Spring application and integrated with the LMS Edmodo. The instruments used were questionnaires, observation sheets, and tests. The results of the study showed that digital learning materials were valid, practical, and effective for use in language learning. Besides, the developed model was validated with a self-validation value of 93.12% and an expert validation value of 93.18%. The developed model was tested for its practicality with a teacher practicality value of 93.54% and student validity of 80.62% with the category of very practical. The learning activity score reached 93.33% with the category of very active learning. Based on statistical data analysis, the developed digital learning materials were effective in improving learning outcomes.

Empowering Deaf Learners: The Promise of Sign Language MOOCs

In the realm of education, deaf students face significant communication barriers that limit their integration and success within intellectual communities. Due to the use of distinct mother languages, a communication gap arises between deaf and non-deaf communities. This poses serious difficulties for deaf students, who communicate primarily in sign language and are unable to fluently read materials written in spoken language. As most didactic materials in higher education are available exclusively in spoken languages, this further limits the opportunities and chances for deaf students to succeed. While technological advancements have made it possible to create tools and services that translate between spoken and sign languages, they are often expensive and not widely available in educational settings. The proposal is a pedagogical model that seeks to overcome these obstacles and foster inclusivity by offering deaf students access to educational resources in their mother language – sign language. This is accomplished using Massive Online Open Courses (MOOCs) paired with automatic sign language translation technology. To demonstrate this model's effectiveness, a digital literacy course for schoolteachers was developed and evaluated within a group of users, including deaf students. The paper discusses the state-of-the-art of digital educational content available to the deaf, the process of translating digital learning materials into sign languages, the specifications needed to structure educational content for the deaf, and an example of the development methodology for creating multilingual learning objects for the deaf. The evaluation results indicate that MOOC is inclusive and positively impacts deaf students' learning outcomes. The proposed pedagogical model has significant implications for improving access to education and promoting inclusivity for deaf students worldwide. By utilizing technological advancements and creating inclusive digital educational materials, it is possible to bridge the communication gap between deaf and non-deaf individuals, thereby enabling deaf students to acquire, expand, and improve their knowledge in various subjects.

PERSPECTIVES AND EXPERIENCES OF INDONESIAN PRE-SERVICE ENGLISH TEACHERS IN DEVELOPING DIGITAL LEARNING RESOURCES

The adoption of the 2022 Emancipated Curriculum in Indonesia has prompted a need for pre-service English teachers to acquire new skill sets. These skill sets entail the integration of technology and pedagogy, aligning with UNESCO's transformative pedagogy approach to learning, which emphasizes a new paradigm of learning with a focus on essential elements of language learning. This qualitative study aims to investigate the perspectives and experiences of pre-service English teachers in Indonesia in developing digital learning resources for English learners that resonate well with the nature of the Emancipated Curriculum. A phenomenological research approach was adopted, and data were collected through a questionnaire and semi-structured interviews with 16 pre-service English teachers who had completed their final research project on the development of digital learning resources that promote a holistic English language learning. The data was analysed using both corpus analysis and thematic analysis techniques. The findings reveal that pre-service English teachers in Indonesia encounter substantial obstacles when it comes to developing and utilizing digital resources. These challenges include limited access to technology, resistance from schools to embrace digital learning, and students' inadequate English proficiency levels. Despite these constraints, the pre-service teachers generally express satisfaction and confidence in creating their digital learning materials. They also view digital technology as a valuable resource that can enrich the teaching and learning experience. In conclusion, the paper emphasizes the need to equip preservice English teachers in Indonesia with the necessary skills and knowledge to navigate the digital age and work as curriculum engineers effectively. This study suggests that by integrating digital pedagogy and providing access to digital resources, preservice English teachers can become competent curriculum engineers who can deliver quality English language instruction in the 21st century. Ultimately, this will enhance the quality of English language instruction in Indonesia and ensure that preservice teachers are well-prepared to navigate the digital age and provide quality education to their students.

Sustainability in E-Learning: E-Books and Academic Procrastination among Secondary Students

This article investigates the extent of academic procrastination among secondary school students in the Kingdom of Saudi Arabia who utilize sustainable digital learning materials, specifically e-books, compared to those who rely on printed books in a traditional face-to-face learning environment. A sample of 336 first-year secondary school students was randomly recruited and divided into two experimental groups based on their preference for either electronic or printed textbooks. An online survey was employed to assess academic procrastination. The findings indicate no statistically significant differences in the impact of textbook formats (electronic versus printed) on academic procrastination among secondary school students. This study emphasizes the importance of employing e-books instead of printed books as sustainable digital learning resources, thereby contributing to sustainable education and the preservation of natural resources. Furthermore, this research could serve as part of a broader series of studies investigating the effects of integrating sustainable digital resources into education on students’ psychological development, study habits, and educational outcomes.

Digital Learning Materials and Their Relationship with Faculty Nursing Students’ Self-Efficacy at Menoufia University

Digital Learning Materials and Their Relationship with Faculty Nursing Students’ Self-Efficacy at Menoufia University

Light Wave Digital Learning Material with Augmented Reality and CTL Model to Improve Students' 4C Skill

The learning in 21st century should implement students' 21st century skills, known as 4C skills. These skills are needed by students to face global competition in the future. The preliminary research results show that skills of 4C by students are still lack. The way for fix the problem is that students need learning media that is more interactive and attracts interest in learning. Digital learning materials with Augmented Reality integrated with CTL models are a solution to the problem. The research purpose was to analyze the needs analysis, validity, and practicality of using digital learning materials with an AR integrated CTL model. This research method uses research and development using the Hannafin & Peck development model. The research instruments include a needs analysis instrument, a validation questionnaire sheet, and a practicality questionnaire sheet. The techniques for data analysis used are descriptive, qualitative, and quantitative statistics. Based on the data that has been analysed, there are three research results. First, the needs analysis research results stated that the low 4C skills of students. Second, the product validation results obtained an average value of 0.8 in the category was valid. Third, the product practicality results obtained an average value of 86 in the very practical category. The research results implication are that digital teaching materials with AR and CTL can be used as alternative learning resources to achieve learning goals, then teachers can construct students' 4C skills by using AR-CTL Physics digital teaching material.

Using Sequential Pattern Mining to Understand How Students Use Guidance While Doing Scientific Calculations

AbstractIn natural science education, experiments often lead to the collection of raw data that need to be processed into results by doing calculations. Teaching students how to approach such calculations can be done using digital learning materials that provide guidance. The goal of this study was to investigate students’ behaviour regarding the use of guidance while doing scientific multi-step calculations, and to relate this behaviour to learning. Sequential pattern mining was used to i) identify students’ behaviour patterns while doing calculations in an online learning environment, ii) study the relation between use of guidance and success on first attempt at submitting a calculated value, iii) study the relation between students’ use of guidance and learning gain, and iv) study the relation between students’ use of guidance and prior knowledge. Data showed that all students frequently used the guidance provided in the learning task. Moreover, students who used the option to check their intermediate calculations and students who studied worked examples were more likely to successfully complete the calculation on their first attempt than students who did not use this guidance. Guidance in the form of hints was used frequently. However, using the hints did not result in more success at the first attempt. We did not find a relation between learning gain and use of guidance, but we did find a trend that students with a low prior knowledge used more guidance compared to students with a high prior knowledge. The results of this study imply that providing hints and intermediate calculations is of utmost importance for students to independently complete scientific multi-step calculations.

Design principles and best practices for software digital learning materials

This paper aims to explore the design principles and best practices for software digital learning materials to meet the demands of modern education. Firstly, the article introduces the importance and widespread application of digital learning materials in the field of education. Subsequently, it discusses in detail the key principles and best practices for designing software digital learning materials in four sections, including content design, interactivity, accessibility, and assessment methods. Finally, the paper summarizes the main findings, emphasizes the significance of software digital learning material design, and calls on educators and designers to actively adopt these principles and practices in the digital education field to enhance educational quality.

Utilization of Chatbot Telegram AI to Promote Students' Creative and Innovative Entrepreneurship in Learning Context

The development of technology in the current era is advancing very rapidly. Along with digital learning materials, they can increase verbal communication and various visual, audio and motion texts. This study aims to develop students' 4C competencies (Creativity and Innovation, Critical Thinking and Problem-Solving, Communication and Collaboration) in 21st-century learning through creative entrepreneurship learning materials of the Telegram Chatbot Artificial Intelligence with Natural Language Processing (NLP) Method. The scope learning materials are focused on Personal Business Plans, Customer Interviews, Customer Observation, Selling Products, and being a Creative Entrepreneur, which will be uploaded to the Telegram Chatbot as e-learning students' material. This research will use the Research and Development approach of Borg and Gall (1983). The series of research and development steps are carried out in stages, and each action will be taken to the results of the previous step until a new development product of learning materials is finally obtained. Product development design of the preliminary stage needs analysis is carried out by collecting related data and developing Creative Entrepreneurship learning materials for the Telegram chatbot model. The Creative Entrepreneurship learning program will involve 50 students of the English Literature Department, Universitas Negeri Medan, to analyze the feedback from the questionnaire Google form.

Students’ Perceptions of Using Roblox in Multimodal Literacy Practices in Teaching and Learning English

The need for digital technology involvement in education is increasingly apparent, so learning techniques are required to be prepared in various digital formats. Using digital learning materials enables teachers to implement the current concept of literacy, i.e., multimodal literacy. This study aims to find out the students' need for digital literacy and their perceptions of using the Roblox game as the learning media to improve their multimodal literacy. This descriptive study used a survey method, taking the second-year junior high school students in the 2021-2022 academic year in one of the state junior high schools in Medan, Indonesia as the respondents. The data were collected using two sets of closed-ended questionnaires. The data obtained from the first questionnaire were analyzed using a forced choice technique for yes or no answers, while the data obtained from the second questionnaire were analyzed using a 4-Point Likert Scale. The results indicate the students' need for digital literacy and their good perceptions of using Roblox as the learning media in improving their English multimodal literacy. It is concluded that teaching English at junior high school is expected to be designed in a digital format by involving games as the media, facilitating the students to improve their English multimodal literacy.

Need Analysis of Interactive E-Worksheet as a Source of Digital Learning based on Local Wisdom in Learning Folklore Texts

Worksheet refers to a document or a digital file that contains exercises, questions, or tasks for students to complete as part of their learning activities. This study aims to analyze the need for an appropriate interactive E-Worksheets in learning folklore texts. This research is a qualitative descriptive research. In this qualitative research, the research instrument is the researcher himself. The subjects in this study were students of senior high school in Padang. Data collection techniques in this study used a questionnaire. This data collection technique is in the form of a questionnaire filled out by students. Based on the results and discussion, it can be concluded that E-Worksheets can increase students' interest in learning, especially in learning folklore texts. The implications of this research highlight the importance of incorporating interactive E-Worksheets in teaching folklore texts. Educators and curriculum developers can utilize these findings to design and implement digital learning materials that effectively engage students and promote a deeper understanding of cultural heritage.

Hybrid Imbalance: Collaborative Fabrication of Digital Teaching and Learning Material

Digitization of schools has increased significantly in recent years and is generating a massive innovation boost in education. This development is accompanied by an increased demand for new digital educational objects for schools. The resources required for creating such objects (expert knowledge from teaching contexts versus technological knowledge and infrastructures) are distributed among different groups of actors from digital economy and educational practice. Therefore, the production of such new objects requires new forms of cooperation in the education sector. This article discusses such a hybrid collaboration between a software developer and the teachers of two pilot schools for the creation of interactive learning software. We examine this collaborative relationship in light of different bodies of knowledge that both groups of actors bring to the relationship and that need to be reconciled. We also examine the ways in which the organizational boundaries between schools and companies are temporarily blurred, and the distribution of costs and benefits between the participating groups of actors. By looking at the various dimensions of the cooperative commercial production of these digital objects as well as their (prototypical) experimental stage, the paper analyses the digital transformation of teaching as an innovative social process, structured by economic and educational rationalities.

Measuring self‐regulated learning in a junior high school mathematics classroom: Combining aptitude and event measures in digital learning materials

AbstractBackgroundMeasurement of students' self‐regulation skills is an active topic in education research, as effective assessment helps devising support interventions to foster academic achievement. Measures based on event tracing usually require large amounts of data (e.g., MOOCs and large courses), while aptitude measures are often qualitative and need careful interpretation. Precise and interpretable evaluation of self‐regulation skills in a normal K‐12 classroom thus poses a challenge.ObjectivesThe present study proposes and explores a learning analytics method of combining aptitude and event measures to evaluate student's self‐regulation skills.MethodsAn explorative learning analytics study was conducted in a junior high school mathematics class ( students), using a three‐lesson intervention with digital learning materials. Students first assessed their self‐regulation skills with a self‐report questionnaire, after which trace logs and observations of student behaviour were collected. Learning sessions were extracted from trace logs, clustered, and linked to learning strategies. Students were clustered by the self‐report results and learning behaviour profiles. Session clusters, student behaviour clusters and assignment grades were also tested for association.Results and ConclusionsThe detected session and student behaviour types were linked to learning tactics and strategies found in prior studies. Additionally, association was found between self‐reported self‐regulation skills and the student behaviour obtained from trace logs.ImplicationsThe results demonstrate the feasibility of concurrently using aptitude and event measures on a classroom scale, providing teachers with a tool to evaluate and support self‐regulated learning. Combined with further measures like predictive learning analytics, teachers can obtain an early and highly interpretable picture of at‐risk students in their classes.