Student Assessment Research Articles

Realistic mathematics education and mathematical literacy: a meta-analysis conducted on studies in Indonesia

A considerable body of literature exists pertaining to realistic mathematics education (RME) and its correlation with mathematical literacy, with numerous studies demonstrating incongruent results. The principal objective of this meta-analysis is to systematically investigate the overarching influence of RME on mathematical literacy within the context of Indonesia. The collection of documents comprises a total of seventeen publications that were released between the years 2014 and 2023. The estimation methodologies utilized in this study were grounded on a random-effects model, and statistical computations were conducted utilizing the comprehensive meta-analysis (CMA) software in academic writing. The equation proffered by Hedges was employed for the quantification of effect magnitude. The outcomes of the investigation reveal that the implementation of RME learning yielded a noteworthy and advantageous impact (effect size = 1.031; p 0.05) on the adeptness of students in the domain of mathematical literacy. Moreover, many moderating factors, including class capacity, educational level, geographical location, content of the Programme for International Student Assessment (PISA), and the combination of learning, did not significantly impact students' diverse mathematical literacy proficiency. This study proposes that mathematics educators should consider utilizing the RME as a means of improving students' proficiency in mathematical literacy.

Teaching a foreign language through ICT to students with dyslexia and attention deficit hyperactivity disorder (ADHD) and the role of ICTs

Students with learning disabilities are a heterogeneous group and exhibit particularities in the areas of perception, language, memory, attention and concentration, metacognition, self-regulation, motivation, behavior, social skills and emotional development. It is therefore important to identify these difficulties as early as possible, so that students can be helped in time by adapting teaching to their own needs. New technologies, already promising in a variety of fields, seem to be able to be used for the necessary differentiation of teaching, materials and assessment of students with learning difficulties such as dyslexia and ADHD.

Validating an Online Learning Dexterity Survey of University Students’ Online Learning Competence

AbstractCompetent online learners have dexterity as they can manoeuvre a wide range of learning technologies and online learning strategies to learn successfully. In this study, we approach university students’ online learning competence as ‘online learning dexterity’ or an ability to manage different aspects of online learning with appropriate technological and pedagogical strategies. Aligning with emerging visions of more individualised, flexible, multi-modal, and community-driven experiences through online learning in universities, we operationalised an Online Learning Dexterity Survey instrument that assesses online learning competence through six dimensions: (1) asynchronous learning dexterity (2) synchronous learning dexterity (3) self-directed learning dexterity (4) online collaboration dexterity (5) learning technologies dexterity, and (6) learning access dexterity. Construct validity was established through confirmatory factor analysis of responses from 273 university students and discriminant validity was established through cluster analysis. The three-cluster solution show that learning technologies dexterity and learning access dexterity can be used to identify student profiles with lower confidence in their technical competencies but the other dimensions reveal students’ pedagogical challenges with managing learning, online collaboration, and different online learning modalities. The contributions of online learning dexterity factors to improving the assessment and development of university students’ online learning competency are discussed.

Development of a Lagrange Mechanics E-Module Based on a Flipbook Pendulum Spring System

This research is a type of Research and Development (R D) research that uses the 4D development model, namely Define, Design, Develop, Disseminate. This research produces a Lagrange Mechanics E-Module based on a flipbook pendulum spring system. The aim of this research is to produce a Lagrange Mechanics E-Module that is suitable for use as a learning medium for Analytical Mechanics. The data collection instrument used in this research is a questionnaire as a validation assessment for material experts and students, data analysis uses percentages with predetermined categories. The research sample was 14 Physics Education students. The validation results by material experts were 73% in the feasible category. The student response results were 85% in the very appropriate category. From these results, the Lagrange Mechanics E-Module is suitable for use with revisions as an alternative source of learning.

Teaching the Professional Dimension of Translation in Academic Translation Programmes

Reform policies in higher education have brought about changes in attitudes regarding the education of translators. One of the latest challenges concerns the concept of professionalization of translation and the need for a type of training that would provide students with the specific skills required for the translator’s profession. Indeed, most translation programmes today aim at educating highly qualified translators on a competence-based training. Μore particularly, the emphasis is on metacognitive competence acquisition and the reflexive capacity development taking into account students’ motivation and expectations, their general background knowledge as well as individual learning styles. The present paper proposes a didactic approach on a professionally-oriented basis that would help students enter most effectively the translation industry by realizing at the same time the importance of acquiring a strong theoretical background on translation. Among the main issues to be addressed are the contribution of translation theory to the practice of translation, the role of the translator as cultural mediator, his social responsibilities as well as the translator’s psychological traits and their effect on translation quality. Finally, it proposes a variety of learning activities that are closely related to the act of translating together with a number of student assessment methods bearing a strong professional orientation.

Enhancing dance education through convolutional neural networks and blended learning

This article explores the evolving landscape of dance teaching, acknowledging the transformative impact of the internet and technology. With the emergence of online platforms, dance education is no longer confined to physical classrooms but can extend to virtual spaces, facilitating a more flexible and accessible learning experience. Blended learning, integrating traditional offline methods and online resources, offers a versatile approach that transcends geographical and temporal constraints. The article highlights the utilization of the dual-wing harmonium (DWH) multi-view metric learning (MVML) algorithm for facial emotion recognition, enhancing the assessment of students’ emotional expression in dance performances. Moreover, the integration of motion capture technology with convolutional neural networks (CNNs) facilitates a precise analysis of students’ dance movements, offering detailed feedback and recommendations for improvement. A holistic assessment of students’ performance is attained by combining the evaluation of emotional expression with the analysis of dance movements. Experimental findings support the efficacy of this approach, demonstrating high recognition accuracy and offering valuable insights into the effectiveness of dance teaching. By embracing technological advancements, this method introduces novel ideas and methodologies for objective evaluation in dance education, paving the way for enhanced learning outcomes and pedagogical practices in the future.

Bridging Between High School and University: Assessment of Students’ Readiness to First-Year Engineering Programs

This descriptive case study uses self-assessment tools to explore 26 prospective students’ preparedness regarding their knowledge and competencies for entering the first year of engineering programs at a large, research-intensive Canadian university. We aim to provide insight for developing the Brigde2Engg (B2E) Program to empower and support students in their transition to university. Applying Conley’s college readiness model as a theoretical framework, findings from this study reveal that most students appear confident about their knowledge and skill preparedness for the first-year engineering programs, including their critical thinking abilities, problem-solving skills, and understanding of engineering professions. However, they are less confident in physics and the use of engineering tools. Therefore, we suggest that, when they choose to participate in the bridging program, these students should focus mainly on the subject they deem inadequate. Results also show that an introduction to engineering tools is essential to familiarize students with the programming and spreadsheet software they will use throughout their university programs.

Development of the Academic Policy of Universities in Kazakhstan through the Strategy of Authentic Assessment of Students' Educational Achievements

This chapter explores the strategy of authentic assessment of students' educational achievements and its role in the implementation of the academic policy of universities. The research upon which it is based includes a text analysis of the rhetoric of the academic policy of 4 universities in Kazakhstan and several regulatory documents on assessment. We studied the strategy of authentic assessment at the University of Westminster in the UK. The results of the study point to the need to expand and modernize the conceptual apparatus, improve, and revise the principles and strategies of assessment at the universities of Kazakhstan. It also determines the constraints on the transition to authentic assessment.

Student Learning Performance Evaluation: Mitigating the Challenges of Generative AI Chatbot Misuse in Student Assessments

Since the launch of ChatGPT, a growing number of generative artificial intelligence (AI) chatbots have entered the market. Although chatbots have the potential to help students learn, misusing them to complete assessments raises questions about the authenticity of the work and puts students at risk of academic misconduct. Given the crucial role of assessments in evaluating students’ learning performance, uncertainties about the authenticity of the work call into question the extent to which students have achieved the intended learning outcomes. This study conducted a thematic analysis to provide an overview of the challenges that chatbot misuse may pose to student learning performance evaluation, followed by the various mitigation strategies to overcome these challenges. This study searched the Education Resources Information Centre (ERIC) database for peer-reviewed articles published in scholarly journals after 30 November 2022 (the launch date of ChatGPT, as this study focuses on generative AI rather than other types of AI) and until 30 April 2024. The thematic analysis of 17 articles identified five major themes (and respective sub-themes) in the discussions of these articles, i.e., reasons students use chatbots for assessments, challenges that chatbots may pose to student learning performance evaluation, mitigation strategies, detection strategies, and counter-detection strategies. As chatbots become more prevalent and powerful, the study's findings provide education stakeholders with insightful information on the implications of students misusing chatbots for assessments and how this affects their learning performance evaluation.

Teaching Performance of Students of the Faculty of Education, Sohag University: "An Evaluative Study in Light of Teacher Preparation Standards"

This study aimed to evaluate the teaching performance of student teachers at the Faculty of Education, Sohag University, based on teacher preparation standards. The research employed a descriptive-analytical approach and developed a checklist comprising 64 sub-skills categorized under seven main standards: lesson planning, classroom management and student interaction, use of teaching strategies, integration of educational tools and technologies, personal traits and interpersonal skills, mastery of subject matter, and student learning assessment. The performance of 50 student teachers from scientific and literary disciplines was assessed using an observation checklist. The results revealed that teaching performance was moderate across six standards and good in the "personal traits and interpersonal skills" standard. Statistically significant differences (p ≤ 0.01) were found in favor of scientific students compared to their literary counterparts. The study emphasized the need to enhance student teachers' skills to improve the quality of teaching performance.

The influence of the social environment on the development of critical thinking skills in young people: A study in the city of Durres, Albania

Critical thinking is an essential skill for individuals, especially young people, enabling them to analyze and evaluate information to make informed decisions. Young people who are able to make informed decisions have the opportunity to improve their future and contribute to a better society. In Albania, the level of development of young people's critical thinking skills, according to the Program for International Student Assessment (PISA), is very low. In this context, this work aims to explore the social environments that influence the development of critical thinking in young people. The study employed quantitative and qualitative approaches, as well as an analysis of secondary data extracted from similar studies. The quantitative method consists of the analysis of a questionnaire that was completed by 260 young people from 15–30 years of age. The study data show that schools, society, and social media play a very important role in the development of young people's critical thinking skills. The data confirmed that the socioeconomic status of families influences critical thinking abilities. This highlights the importance of supporting young people from all walks of life to ensure that they all have the opportunity to develop critical thinking, regardless of social background. The findings of this study are important for understanding and fostering the development of critical thinking skills in young people. This research supports teachers, parents, policymakers, researchers, and others in their efforts.

Learning medical sociology through an innovative 'Elective study module' integrating humanities with medicine for undergraduate students of a medical college in Bengaluru, India.

Background The newly introduced 'Elective programme', a voluntary special study module in the final phase of the undergraduate medical curriculum, offers scope for new immersive, self-directed learning opportunities. We describe a programme of study for learning 'medical sociology' through the innovative use of humanities in medicine. Methods Our elective module, called 'Community Health and Rock Music' (CHaRM), was a 2-week programme, merging the curricular subject of community health with 'rock music' as an exposure to the 'counter-culture' outside of the medical world. The half-day sessions consisted of: (i) watching/listening to a rock song-video without reading its lyrics; (ii) listening to the same song again but with lyrics; (iii) undertaking an emotionally stimulating activity (watching a movie, making a site-visit, etc.); and (iv) debriefing, to identify/discuss the underlying social determinants of health and their relevance in the grooming of a socially aware medical student. Formative assessment was intended to gauge levels of expression of the affective domain (attitude/emotions). Results Seven of 143 students volunteered for this programme. Key learnings were a clear appreciation of the societal determinants of health (such as deprivation/discrimination/social structures); multi-level causation of diseases; social issues not addressed in traditional medical curriculum; personal growth; teamwork; and the role of empathy in medical practice. Additional learning was the exposure to the 'counter-culture of arts'. All 7 student assessments 'met expectation', with 4 of them 'exceeding expectation'. Conclusion An 'elective programme' combining humanities with medicine is potentially an innovative, student-centric and replicable model of learning that impacts the affective domain critical for doctors-in-training.

Does competitive school climate really harm to students’ anti-bullying attitude: empirical evidence from China

BackgroundSchool bullying remains a social problem and changing students’ attitudes towards bullying is crucial for effective prevention in schools. Based on social-ecological system theory, this study examines how school climate influences anti-bullying attitudes among students. Specifically, it studies how a competitive school environment influences these attitudes, and how students’ competitive attitudes mediate these attitudes.MethodsThe data for this study comes from The Programmed for International Student Assessment (PISA), which is a global student assessment initiative led by the Organization for Economic Co-operation and Development (OECD). The sample consists of 12,058 Chinese students from the 2018 PISA survey. Data analysis was conducted using STATA (version 14.0) software.ResultsSchool competitive climate has a positive and substantial impact on their anti-bullying attitudes (r = 0.1551, p < 0.001). Students’ competitive attitudes are also positively and significantly correlated with their anti-bullying attitudes (r = 0.2249, p < 0.001). Competitive attitudes partially mediate the relationship between the school bullying climate and students’ anti-bullying attitudes.ConclusionIn the context of Chinese education, a competitive school climate clearly has a positive effect on students anti-bullying attitudes. Students’ competitive attitudes also act as partial mediator in this relationship. These findings suggest that a healthy school ecosystem that reflects sound value guidance and fair rules is imperative for fostering anti-bullying attitudes in students.

“Phones off while school's on”: Evaluating problematic phone use and the social, wellbeing, and academic effects of banning phones in schools

AbstractBackground and aimsMobile phone bans in secondary schools are claimed to reduce student distraction and promote learning and face-to-face socializing. Currently, the evidence on phone bans is limited. The aim of this preregistered study was to evaluate the South Australian mobile phone ban's effects on students' problematic phone use, academic engagement, school belonging, and bullying. The study also sought to identify student variables that predict phone ban compliance.MethodsAs the ban was phased in over 2023, a 2 (phone ban: yes/no) × 2 (time: baseline, 1-month follow-up) repeated-measures design was employed. Students (n = 1,282 at baseline; n = 1,256 at follow-up) in Grades 7 to 12 were recruited from five public secondary schools. Surveys included measures drawn from the Longitudinal Study of Australian Children (LSAC) and the Programme for International Student Assessment (PISA).ResultsProblematic phone use was reported by 2.6% of the sample. Being older and a more frequent user of social media predicted lower phone ban compliance. Linear mixed models indicated that ban and no ban school groups did not differ significantly in terms of problematic phone use, academic engagement, and school belonging. There was slightly higher bullying in the ban group but bullying decreased significantly in both groups.DiscussionImposing access restrictions may not affect the underlying psychological mechanisms that drive problematic phone use. Although these results indicate limited to no short-term benefits of the ban, further evaluation with more sensitive methodologies is recommended.ConclusionsStudent-technology interactions in learning institutions should be continually monitored to determine the optimal balance to support student etiquette, learning, and wellbeing.

A Learning Model for Explanation Text Literacy Using Flipbook Applications in SMP/MTS

This research aims to develop an explanatory text literacy learning model using the flipbook application as media in SMP/MTS. The background to this problem 1) How is the planning for an explanatory text literacy learning model using the flipbook application as a medium in class VIII SMP/MTS? 2) How to implement an explanatory text literacy learning model using the flipbook application as a medium in class VIII SMP/MTS? 3) What is the effectiveness of the explanatory text literacy learning model using the flipbook application as a medium in class VIII SMP/MTS? This research uses the Research and Development (R&amp;D) research and development method with the ADDIE (Analyze, Design, Development, Implementation, and Evaluation) model. The steps of this research consist of, needs analysis, learning model design, learning model development, implementation of learning model products, evaluation of learning model products. Data collection in this research was by collecting data from the results of expert validation questionnaires and questionnaires from student assessments. The data obtained was analyzed descriptively using a Likert scale. The results of the validation test by media experts obtained a score of 77.94%, the validation test by language experts obtained a score of 81.25%, the Indonesian language teacher's response score obtained a score of 97.33%, and the average student response obtained a score of 82.13%. The conclusion of this research is that the explanatory text literacy learning model using the flipbook application media in SMP/MTS meets the appropriate criteria to be used as a learning model by students or teachers in Indonesian language subjects with explanatory text material in class VIII SMP/ MTS students.

Digital Teaching Materials for Historical Narrative Texts Oriented to Character Education for SD/MI Students

This research aims to develop digital teaching materials for historical narrative texts oriented towards character education for SD/MI students. Background to the problem of this research 1) What is the need for digital teaching materials for historical narrative texts oriented towards character education for SD/MI? 2) How are digital teaching materials for historical narrative texts oriented towards character education for SD/MI? 3) What is the feasibility of digital teaching materials for historical narrative texts oriented towards character education for SD/MI? This research uses research and development methods with the ADDIE (Analysis Design Development Implementation Evaluate) model. The steps in this research consist of needs analysis, designing digital teaching materials, developing digital teaching materials, implementing digital teaching material products, and product evaluation (digital teaching materials). Data collection in this research was by collecting data from the results of expert validation questionnaires and student assessment questionnaires. The data obtained was analyzed descriptively using a Likert scale. The results of the validation test by material experts obtained a value of 2.93, the validation test by media experts obtained a value of 3.00. The validation test by the Indonesian language teacher received a value of 3.03. The results of implementing e-module teaching materials in schools received a positive response from students with a score of 3.2. The conclusion of this research is that digital historical narrative text teaching materials oriented towards character education for SD/MI students meet the appropriate criteria for use as teaching materials by students or teachers in Indonesian language subjects. Narrative text materials for fifth grade SD/MI students.

From entry to transformation: exploring AI integration in teachers’ K–12 assessment practices

ABSTRACT This study explores the role of artificial intelligence (AI) in K–12 student assessment practices, focusing on educators’ use of AI tools. Through content analysis of active Facebook groups dedicated to AI in education, the authors examined how educators integrate AI into assessment across various grade levels and subjects. Using the Technology Integration Model, they analysed posts to evaluate the use of AI across subjects and grade levels. The findings revealed a progression from initial interest and experimentation with AI to more advanced, adaptive uses in assessment creation and grading. Educators reported positive experiences with AI-driven tools, especially in automating tasks and gamifying assessments. However, challenges such as ensuring reliable, context-specific feedback persist. Overall, the research highlights AI’s potential to enhance student-centred assessment practices and provides insights for educators, administrators and policymakers on AI’s evolving role in education.

Assessment and learning outcomes for generative AI in higher education: A scoping review on current research status and trends

Generative artificial intelligence (GenAI) impacts higher education assessment and learning outcomes, which are closely related and intertwined. Literature suggests that educators and researchers have many varied concerns regarding student assessment in the higher education GenAI context, such as how to assess students’ learning and the new (refocused) learning outcomes that emerged in GenAI-facilitated learning environments. To provide evidence-based insights into and answers to these concerns, we conducted a scoping review by collating literature in relevant research areas. Following a five-stage scoping review framework, we collaboratively collected and coded 34 studies. The three assessment approaches identified in the review were traditional assessment, innovative and refocused assessment and GenAI-incorporated assessment. The new, refocused learning outcomes identified were career-driven competencies and lifelong learning skills. The review also revealed that most research designs were qualitatively oriented (e.g., with exploratory design, descriptive research, ethnographic research and phenomenological research). This study proposes a holistic diagram showing the current research status and trends. It suggests five future research directions: innovative assessment designs, collaborations among assessment approaches, new learning outcomes, relationships between assessment approaches and learning outcomes, and quantitative or mixed research studies. Implications for practice or policy: Traditional assessment methods in higher education do not operate effectively in the GenAI era. Innovative and refocused assessment and GenAI-incorporated assessment are promising strategies to assess student learning. Career-driven competencies and lifelong learning skills are new focused learning outcomes evolved from the use of GenAI. More quantitative and mixed research studies should be conducted to provide additional empirical evidence on the impact of GenAI on student assessment and learning outcomes.

Internal quality assurance strategies for enhancing students’ soft skills in Tanzania’s higher education institutions

This paper explored the strategies used by the Internal Quality Assurance (IQA) units of the Higher Education Institutions (HEIs) to enhance soft skills among university students in Tanzania. The qualitative research approach was adopted using a multi-case study design involving a sample of thirty-nine (39) participants obtained through purposive and convenient sampling procedures. The study used interviews, focus group discussion and documentary review methods to collect data for the study. The paper deployed thematic and content analysis procedures in the analysis of data. The findings revealed four quality assurance strategies to enhance university students’ soft skills, including developing and reviewing curricula, prolonged field attachment, student assessment and developing academic personnel. The study concludes that there is more to be done to ensure that HEIs students are competent in soft skills for their future life realities. The study recommends assigning soft skills greater emphasis in HEIs curricula due to their importance in future life of the students. More studies on the studied topic using larger samples and different contexts are also recommended.

School Nurse-Led Health Assessment for Students Experiencing Homelessness: A Quality Improvement Project.

Childhood homelessness is increasing and is associated with negative health and academic outcomes. The goal of this quality improvement project was to improve access to healthcare and health outcomes for students experiencing homelessness through a school nurse-led comprehensive health assessment. The multilevel intervention included identifying students experiencing homelessness, conducting a standardized health assessment, and making referrals to care. This 8-month project was conducted in an urban school district. Feasibility and acceptability data were collected to guide sustainability. Student health and referral data were analyzed using descriptive statistics. At the project start, 688 students were identified as experiencing homelessness. More than half (67%) had a partial or fully completed health assessment during the project. Of the students assessed, most had a primary care provider, some had a health condition, and half had a dental home. Students experiencing homelessness would benefit from systematic school-based health assessments to identify unmet health needs.