Targeted Learning Outcomes Research Articles

Using multimodal learning analytics as a formative assessment tool: Exploring collaborative dynamics in mathematics teacher education

AbstractBackgroundTraditionally, understanding students' learning dynamics, collaboration, emotions, and their impact on performance has posed challenges in formative assessment. The complexity of monitoring and assessing these factors have often limited the depth and breadth of insights.ObjectivesThis study aims to explore the potential of multimodal learning analytics as a formative assessment tool in math education. The focus is on discerning how collaborative discourse behaviours and emotional indicators interplay with lesson evaluation performance.MethodsUsing undergraduate students' multimodal data, which includes collaboration data, facial behaviour data, and emotional data, the study explored the patterns of collaboration and emotion. Through the lens of multimodal learning analytics, we conducted exploratory data analysis to identify meaningful relationships between specific types of collaborative discourse, facial expressions, and performance indicators. Moreover, the study evaluated a machine learning model's potential to predict target learning outcomes by integrating data from multiple channels.ResultsThe analysis revealed key features from both discourse and emotion data as significant predictors. These findings underscore the potential of a multimodal analytical approach in understanding students' learning process and predicting outcomes.ConclusionsThe study emphasizes the importance and feasibility of a multimodal learning analytic approach in the context of math education. It highlights the academic and practical implications of such an approach, along with its limitations, pointing towards future research directions in this area.

Strategic Approaches to Cybersecurity Learning: A Study of Educational Models and Outcomes

As the demand for cybersecurity experts in the industry grows, we face a widening shortage of skilled professionals. This pressing concern has spurred extensive research within academia and national bodies, who are striving to bridge this skills gap through refined educational frameworks, including the integration of innovative information applications like remote laboratories and virtual classrooms. Despite these initiatives, current higher education models for cybersecurity, while effective in some areas, fail to provide a holistic solution to the root causes of the skills gap. Our study conducts a thorough examination of established cybersecurity educational frameworks, with the goal of identifying crucial learning outcomes that can mitigate the factors contributing to this skills gap. Furthermore, by analyzing six different educational models, for each one that can uniquely leverage technology like virtual classrooms and online platforms and is suited to various learning contexts, we categorize these contexts into four distinct categories. This categorization introduces a holistic dimension of context awareness enriched by digital learning tools into the process, enhancing the alignment with desired learning outcomes, a consideration sparsely addressed in the existing literature. This thorough analysis further strengthens the framework for guiding education providers in selecting models that most effectively align with their targeted learning outcomes and implies practical uses for technologically enhanced environments. This review presents a roadmap for educators and institutions, offering insights into relevant teaching models, including the opportunities for the utilization of remote laboratories and virtual classrooms, and their contextual applications, thereby aiding curriculum designers in making strategic decisions.

Student Perceptions and Reflections on Targeted Learning Outcomes

The purpose of this study was to evaluate student perceptions on targeted learning outcomes through reflections and engagement questionnaires. The learning outcomes used for the research were based on Fink’s Taxonomy, which offers an integrated model for significant learning. Participants responded to quantitative and qualitative prompts about their perceptions of core concepts related to learning. A subset of the sample completed reflective assignments as part of their coursework that aimed to understand learning goals related to human dimension and caring goals. These goals measure learning through the development of new feelings, interest, and values, and learning about oneself and others. Evaluating student responses on targeted learning outcomes is an effective tool in understanding effective approaches aimed at achieving significant learning.

Технологія визначення готовності майбутніх тренерів-викладачів до медичних аспектів професійної діяльності на основі факторного підходу

The article analyzes the current state of the problem of determining the readiness of upcoming trainers before the provision of first assistance. It is confirmed that the readiness detection technology must accommodate the subsequent iterations. First of all, this is an online survey of medical practitioners regarding the competencies of trainers for the provision of first aid, which are related to the theoretical, practical and situational-cognitive spheres. Second, when medical experts discuss the results of the questionnaire, they reduce the results to laconic formulations. Thirdly, the assessment of the importance of identifying competencies from the provision of first assistance by practicing trainers from various sports by the way of their assessment on a rating scale. Fourthly, factor analysis of the data from the previous iteration. Finally, the development of the professional construct “The readiness of the future training coach before the provision of first assistance” is based on a critical interpretation of the factor analysis data by representatives of the academic staff. According to our assumption, this construct can become a convenient basis for determining the target learning outcomes and assessment tools. Confirmation of this assumption is the direction of further research.

An Evaluation of the Use of Artificial Intelligence Applications in Online Education

Achieving targeted learning outcomes in online education and creating an effective learning environment require an interactive learning environment with a sense of learning community, personalized learning opportunities, a well-designed instructional content with effective use of visuals, sounds and teaching assistants, and instructors who can create and present them all effectively. AI applications can be utilized for a wide range of purposes in addressing the indicators of effective online education and developing strategies to achieve them. This research aims to explore various applications of AI in online education and its impact on teaching and learning processes. In line with this purpose, the study used qualitative case study method to explore the potential of AI applications in improving the quality of online education and the extent to which such applications can be utilized in online education. Following the research, examples of artificial intelligence (AI) applications that can be used in online education for the purposes of providing personalized learning experiences, creating learning content, emphasizing the use of visual and audio content in teaching, providing learning assistance, improving student engagement through the use of teaching assistants and chatbots, strengthening the interaction between the instructor and students, and evaluation were presented and suggestions were made for the contexts in which these applications can be used. The potential and limitations of AI applications in the development of online education were emphasized. On the other hand, it was recommended that the ethical implications of using AI applications in online education should be considered through further research and critical evaluation.

Mobile Assisted Language Learning Needs Assessment in Secondary Education

Mobile-assisted language learning (MALL) has entered students' educational life with a rising momentum. For this reason, it is necessary to determine the needs of English language curricula, teachers, and students in terms of mobile-assisted language learning. In this study, a convergent parallel design of mixed methods was used. The study group of research consists of 130 high school students and 5 teachers working in secondary education institutions. A mobile application adoption scale was used for the data collected from the students. Semi-structured interviews were conducted with teachers. As a result of the research, it was concluded that students find mobile applications useful and adopt them, and teachers need to be informed about the MALL. It was also found that mobile applications should support the target learning outcomes and cover all four language skills.

Challenging the growth-prosperity Nexus: Redefining undergraduate economics education for the Anthropocene

This paper proposes a conceptual framework to guide the transformation of undergraduate economics education, anchored in integrated human flourishing and ecological sustainability. The framework moves beyond the dominant focus on utility and profit maximization to encompass holistic goals of universal human development, social equity, and ecological sustainability within planetary boundaries. It outlines current economic problems and links them to key competencies critical to addressing these issues. Accordingly, educational themes and corresponding anchor topics are developed that align with the key competencies to equip students with pluralistic, transdisciplinary perspectives and solution-oriented skills for catalyzing a just economy that sustains the web of life. The framework is based on the multidimensional concept of prosperity and includes three interrelated dimensions: ecological sustainability, social inclusion and equality, and quality of life. To implement this framework, guiding principles and targeted learning outcomes for economics are defined that emphasize systems thinking, personal development, transdisciplinarity, and collective agency for transformative change. The goal is to provide a coherent structure to transform undergraduate economics education and empower students to become agents of social change who can critique and reorient the current economic system towards justice and ecological stewardship.

Integrated foreign languages teaching: development of learning outcomes for IT majors

Introduction. Design of descriptors for achieving objectives of foreign language education in case of non-language majors at tertiary level on the basis of the existing scales of the Common European Competences in Foreign Language (CEFR) promotes the policy of cultural diversity and multilingualism implemented by the Council of Europe. The motivation for the research lies in the fact that Russian universities lack a clear and transparent system of criteria that can be used for planning and assessing foreign language competences for non-language majors. The paper presents a developed scale of descriptors for planning learning outcomes and assessing language proficiency of undergraduate students majoring in information technologies in the context of Russian education at tertiary level. With regard to federal state educational standards for higher education, foreign language competence is described as integrative foreign language professional communicative competence which combines professional and linguistic constituents. Materials and methods. The exploration adopted combined methods of analysis of previous studies, CEFR descriptors, interviews with master and bachelor students of IT majors (Togliatti State University, Russia), and foreign language communicative needs analysis in the IT industry. The obtained data were then processed in the backward design of targeted learning outcomes following the Common European Framework of Reference for Languages format. Research results. The study elicited cross-cultural communicative needs in the industry in question, and then there were selected appropriate CEFR descriptors for their subsequent modification. The choice of the CEFR format was justified by its high adaptability and the author’s previous successful experience of elaborating such scale descriptors for automotive engineering majors. The author designed a scale for A2, B1 and B2 levels, where learning outcomes are presented as descriptors of communicative language activities with CEFR level distinctions being combined with activities involved in on-the-job cross-cultural communication. Conclusion. The initiated research should be helpful to investigate ways of devising and testing adequate sets of CEFR-based descriptors to improve the quality of university syllabi. The proposed scale of descriptors has certain limitations, therefore, further exploration directions are outlined. Keywords: integrative foreign language professional communicative competence, learning outcomes, CEFR-based descriptors, assessment, IT majors

Work experience, information revelation, and study effort

Abstract Firms screen graduates using grade thresholds, which can turn into students’ targeted learning outcomes or reference points in the model of study effort choice. Variability in the usage of grade thresholds implies students’ uncertainty about the value of grades. Work experience from internships can reduce this uncertainty and, in turn, affect the choice of study effort. We theoretically show that a reduction in uncertainty induces more effort from less able students but, in contrast, less effort from more able students. Consistent with the theory, we empirically find that students returning from year-long internships have a flatter grade-ability profile.

Impact of Teaching a Neuro-Computerized Course Through VLE to Develop Computational Thinking Among Mathematics Pre-service Teachers

The current study aims to determine the effect of teaching a mechanic neuro-computerized course through virtual learning environments (VLE) to develop computational thinking among mathematics pre-service teachers. The neuro-computerized virtual learning environments (NCVLE) model was designed to be used to teach the mechanics course to third-year students of the mathematics department. To achieve the targeted learning outcomes, the study recruited (102) third-year students of the Faculty of Education and classified them into a control group of (50) students and an experimental group of (52) students. The experiment lasted for 14 weeks during one semester of the 2021-2022 academic year. The results agreed with most of what has been found from relevant literature and studies. Also, the results indicated that the NCVLE model played a vital role in the purposeful teaching, learning, and assessment processes and enhanced the learning of computational thinking.

Meningkatkan Pemahaman Belajar Pada Materi Sifat Wajib Bagi Allah siswa Kelas III SD Negeri 23 Pangkalpinang Melalui Metode Pair Checks

This study aims to find out about the application of the pair checks method in improving students' understanding of learning in Islamic Religious Education sub-material of the mandatory attributes of Allah in third grade students of SD Negeri 23 Pangkalpinang. This study uses classroom action research (Action Research) by applying two cycles. Each cycle consists of four stages, namely: planning, implementation, observation, and reflection. Collecting data in this study using observation and test techniques. The sample in this study was the third-grade students of SD Negeri 23 Pangkalpinang, amounting to 33 people. Data analysis used descriptive qualitative. The results showed that the understanding of student learning outcomes using pair checks can be categorized as high, this is illustrated by the average student learning outcomes, namely in the first cycle the average is 66.67 while in the second cycle the average is 75.45 and completeness the minimum is very significant which can be stated from the percentage gain for each cycle, namely 63.64% in the first cycle, increasing to 93.94% in the second cycle. So, it can be stated that the use of the Pair Checks method shows a significant relationship in achieving the targeted learning outcomes.

An Evaluation of the Student Entrance-exit survey (EES) and PO Score for the Electric Circuit II Course

The entrance-exit survey (EES) is a good tool to measure the student’s perceived level of course comprehension while the Continuous Evaluation (CE) was carried out to access the actual student performance. This paper evaluates the PO attainment for the Electric Circuit II course as measured using both EES and CE methods. The samples of 76 students in part three from the Diploma in Electrical Engineering Electronic (EEE111) and Diploma in Electrical Engineering Power (EE112), that enrolled in the course from October 2021 to February 2022 are used in this study. Out of twelve PO provided by the Engineering Technology Accreditation Council (ETAC) for the engineering curriculum program, three PO were linked to this course which are PO1, PO2, and PO4. A total of nineteen survey questions regarding the course content were distributed at the beginning and end of the course and all questions were mapped to the designated PO for analysis. The cognitive and psychomotor aspects are the focus of the knowledge domain associated with the three PO. Aside from that, the PO attainment was also performed using 65% as the specified program achievement requirements. The findings may imply that entry-exit surveys are one method of capturing students' perceived attainment of the targeted learning outcomes, and they may give light to the development of course evaluation measures in general.

Climate of Online e-Learning During COVID-19 Pandemic in a Saudi Medical School: Students' Perspective.

The circumstances of the COVID-19 lockdown offered an opportunity to develop remote educational strategies in medical education. To assess medical students' experiences with online e-learning (OeL) satisfaction, intellectual environment, and communication during the COVID-19 pandemic. A cross-sectional study was conducted at the College of Medicine, University of Bisha, Saudi Arabia. A self-administered questionnaire (21 items) was used to evaluate OeL in three domains of satisfaction (nine items), intellectual environment (seven items), and communication (five items). Students from years one to six were invited to fill out the questionnaire form with five-point Likert scale responses. Descriptive statistics, one-way analysis of variance (ANOVA), and independent t-test were used to evaluate the association between variables. Out of 237 participants, 96.6% (158 male and 71 female) responded to the questionnaire. Most students (86.5%) preferred the blackboard for their e-learning. The mean total scores were 30.18 ± 6.9 out of 45 for satisfaction, 19.67 ± 5.4 out of 25 for communication 25.43 ± 5.1 out of 35 for the intellectual environment. Over 50% of the students rated moderate scores on satisfaction and intellectual environment domains. About 85% of the students rated moderate scores in the communication domain. Male students rated higher significant scores than female students for satisfaction (31.3 ± 6.3 vs 27.6 ± 7; P < .001) and intellectual environment (26.3 ± 4.32 vs 3.5 ± 6.1; P < .001). There were no significant differences in students' responses to the tested domains related to GPA level. Significantly higher levels of scores for satisfaction (33.3 ± 5.6 vs 28.8 ± 6.9; P < .001) and communication (21.2 ± 4.5 vs 18.9 ± 5.7; P = .019) were obtained by clerkship students than pre-clerkship. Medical students' experiences with e-learning are encouraging, which might be more effective with continuous training programs for students and tutors. Although OeL is an acceptable methodology, further studies are needed to analyze its impact on the target learning outcomes and students' academic achievement.

Supporting teaching practice, program improvement, and accreditation efforts in an engineering program

This paper emphasizes the essential role of a support person for faculty teaching and assessing the Canadian Engineering Accreditation Board (CEAB) graduate attributes as part of an ongoing accreditation cycle. It details the continuous program improvement process adopted by the Department of Biosystems Engineering at the University of Manitoba, and the role of engineering stakeholders. It recounts a study that details the supportive efforts of a Research Associate who helped to validate and implement rubrics with individual professors as outcomes-based tools for teaching and assessing the 12 CEAB graduate attributes, which resulted in the creation of 14 rubrics for 12 courses. Findings included new pedagogical understandings, the appreciation of individual support from the Research Associate, and the continued use of rubrics; the work led most professors to think deeply and in new ways about teaching and assessment. There was evidence that six professors engaged in ‘reverse design’, developing rubrics with targeted learning outcomes and course materials in mind. The work led to critical improvement in teaching practices and evidence of continual program improvement. Despite overall engagement and success, some professors continued to struggle with the concept and use of rubrics. In sum, this experience emphasizes the benefit of a dedicated person to support professors to implement rubrics, and in creating and sustaining an outcomes-based assessment culture in the department.

Right heart catherisation – a virtual reality

Abstract Introduction Right heart catheterisation (RHC) is the gold standard for assessing patients with pulmonary hypertension. Doctors require training in this procedure in a safe and friendly environment with minimal risk to patients. Due to the Covid pandemic, formal RHC teaching workshops were cancelled in our country, so we sought to develop a Virtual Reality Right Heart Catheterisation (VRRHC) training program to fulfil this area of need without the need for face to face contact. The aim was to improve training, competency and confidence in this technique with improved diagnostic skills and reduction of procedural errors. Method We approached a health technology company to design a VRRHC training module based on our current RHC simulation workshops. Phase 1 required virtual insertion of RHC via the right internal jugular vein using micro-puncture, double Seldinger technique under ultrasound guidance, followed by insertion of the RHC to the right atrium, right ventricle and pulmonary artery with pulmonary artery occlusion using real time pressure tracings and fluoroscopy. Thermodilution cardiac outputs and chamber saturations were also performed. The proprietary platform technology was delivered via a laptop and VR headset. Clinicians perform the VRRHC with imaging, monitoring and haptic feedback with the collection of real time performance tracking allowing user data (e.g. failed steps and proficiency scores) to be captured and subsequently visualised in the learning management system. We collected analytics and data on user engagement, experience and retention, targeted learning outcomes and learning curve, reduction in operating costs, reduction in procedure times due to higher proficiency, early diagnosis of pulmonary hypertension, reduced complications, improved interpretation and diagnosis. Results The program was launched in October 2021. Preliminary data shows a learning curve is associated with both using VR (10–15 minutes) and the RHC procedure itself. Initial time to completion of the RHC was 30–40 mins, reducing to 20–30 minutes with experience and 15 minutes in experts. Completion rates increase with experience from 40–50% to 100% and error rates reduce with frequency of completion. Conclusion A Virtual Reality Right Heart Catheter training program is safe, feasible and non-invasive. Increased experience results in increased completion rates, reduced procedure time and reduced errors. Using this program will potentially have beneficial effects on doctor training, outcomes, patient safety and health economics with no risk to a real patient. Funding Acknowledgement Type of funding sources: Private grant(s) and/or Sponsorship. Main funding source(s): Janssen Pharmaceuticals

Right heart catherisation – a virtual reality

Abstract Introduction Right heart catheterisation (RHC) is the gold standard for assessing patients with pulmonary hypertension. Doctors require training in this procedure in a safe and friendly environment with minimal risk to patients. Due to the Covid pandemic, formal RHC teaching workshops were cancelled in our country, so we sought to develop a Virtual Reality Right Heart Catheterisation (VRRHC) training program to fulfil this area of need without the need for face to face contact. The aim was to improve training, competency and confidence in this technique with improved diagnostic skills and reduction of procedural errors. Method We approached a health technology company to design a VRRHC training module based on our current RHC simulation workshops. Phase 1 required virtual insertion of RHC via the right internal jugular vein using micro-puncture, double Seldinger technique under ultrasound guidance, followed by insertion of the RHC to the right atrium, right ventricle and pulmonary artery with pulmonary artery occlusion using real time pressure tracings and fluoroscopy. Thermodilution cardiac outputs and chamber saturations were also performed. The proprietary platform technology was delivered via a laptop and VR headset. Clinicians perform the VRRHC with imaging, monitoring and haptic feedback with the collection of real time performance tracking allowing user data (e.g. failed steps and proficiency scores) to be captured and subsequently visualised in the learning management system. We collected analytics and data on user engagement, experience and retention, targeted learning outcomes and learning curve, reduction in operating costs, reduction in procedure times due to higher proficiency, early diagnosis of pulmonary hypertension, reduced complications, improved interpretation and diagnosis. Results The program was launched in October 2021. Preliminary data shows a learning curve is associated with both using VR (10–15 minutes) and the RHC procedure itself. Initial time to completion of the RHC was 30–40 mins, reducing to 20–30 minutes with experience and 15 minutes in experts. Completion rates increase with experience from 40–50% to 100% and error rates reduce with frequency of completion. Conclusion A Virtual Reality Right Heart Catheter training program is safe, feasible and non-invasive. Increased experience results in increased completion rates, reduced procedure time and reduced errors. Using this program will potentially have beneficial effects on doctor training, outcomes, patient safety and health economics with no risk to a real patient. Funding Acknowledgement Type of funding sources: Private grant(s) and/or Sponsorship. Main funding source(s): Janssen Pharmaceuticals

Students’ learning experiences in the Communication Program from a university in the Philippines

&lt;p&gt;&lt;span lang="EN-US"&gt;This study analyzed the students’ learning experiences in the Communication Program from a university in the Philippines. A descriptive method was used in analyzing the data gathered from the researcher-made questionnaires and exit interviews of the perceived fourth year student-respondents. Using categories of students’ learning experiences, findings revealed that experiential learning and social climate contribute mostly to their best and worst experiences in the university. Furthermore, aside from problem solving and application of theories into practice, quality of lectures, and discussion, three themes surfaced particularly related to the self, faculty, and university. As learners are encouraged to actively participate in the teaching-learning process and continue to make sense of their identity in a learning environment, the higher education institutions also have equal responsibilities of providing conditions that are conducive to achieving target learning outcomes. Such conditions comprise the schools’ facilities and information technology infrastructure, and carefully designed instructional packages including quality instructional materials and competent teachers. This study provides recommendations in redesigning the Communication Program based on the students' learning experiences.&lt;/span&gt;&lt;/p&gt;

Pengelolaan Media Pembelajaran di tingkat MI/SD

The management of learning media at the elementary school level is one of the supports for achieving the targeted learning outcomes. Media management is our way as educators/teachers to manage something that we will achieve in a program for providing learning media at the elementary school level. This research is a literature study that analyzes several sources, both books, journals, and other references to draw a conclusion as a result of the discussion. For this reason, it was found that there are four stages of learning media management, namely, media planning, media organization, media implementation, and media evaluation. Of the four, it is the management or management of media and learning resources at the MI and SD levels. With the management of learning media, the learning process will run smoothly and effectively.

Teachers’ Views Regarding the Implementation of Education Programs in Distance Education through the EBA Platform During the Covid-19 Pandemic

: The purpose of this study is to evaluate the implementation of the programs in distance education through the Education Information Network (EBA) platform due to the Covid-19 pandemic according to teachers’ opinions. In the study, the case study method, one of the qualitative research methods, was used. A semi-structured questionnaire with open-ended questions was given to 107 teachers. The data obtained were examined using content analysis. According to the study results, in “EBA Internet” and “EBA Live Class,” teachers stated that not having information about activities suitable for distance education and limited interaction with students were the difficulties they have faced. The teachers stated that the contents in the EBA are suitable for the targeted learning outcomes. Still, they are qualitatively simple, insufficient, and most of them cannot be accessed. They also stated that they had difficulty carrying out assessment and evaluation in their teaching activities due to insufficient measurement content suitable for the class level in the EBA platform. The students did not want to answer the questions in distance education courses. In addition, teachers suggested that learning with games, movies, songs, visuals, experiments, and STEM activities should be added for the programs to be implemented more efficiently on the EBA platform. Furthermore, an application that makes the board more practical and useful in live lessons should be created.

L’acquisition de la langue orale par l’entremise de tâches de centres d’apprentissage de littératie dans des classes d’immersion française

This qualitative exploratory study examined the language/literacy tasks performed by elementary students from six elementary French Immersion (FI) classrooms. Various literacy tasks were performed as students rotated through different literacy centres/stations which had been pre-planned by their teachers. Specifically, researchers investigated students’ oral production and opportunities for extended oral output when working at independent learning centres/stations in order to identify key principles for creating literacy-enhancing tasks suitable for developing language literacy skills within second language (L2) contexts. Data were collected through classroom observations ( n = 23) to identify the types of literacy/language tasks proposed to L2 students, the nature of communicative functions, the targeted learning outcomes, and principles of effective L2 learning tasks. Results demonstrate the importance of adapting pedagogical practices, such as literacy centres/stations, borrowed from the first language teaching contexts to maximize L2 literacy/language learning and meet the specific needs of FI students. Results also highlighted the importance of ongoing professional learning opportunities for FI teachers specific to their L2 teaching contexts. Researchers propose principles for creating literacy/language tasks that promote oral language learning in FI contexts.