Student Assessment Research Articles

Assessment of student ICT competence according to mathematics, science, and reading literacy: evidence from PISA 2018

To assess the integration of information and communication technologies (ICTs) in teaching and learning, a new construct for ICT competence was developed by the Programme for International Student Assessment (PISA) in 2022. The framework for ICT assessment involves four major dimensions; access to ICT, use of ICT, students’ ICT competencies, and subject-related ICT use. In this paper, we analysed this ICT assessment in terms of validity construction of test scores with data from PISA 2018 and investigated ICT competence in relation to the variables of mathematics, science, and reading literacy. The analyses were based on public data from PISA 2018 for Turkey (N = 6890). After removal of univariate and multivariate outliers from the Turkish sample, factor analysis, correlation analysis, and structural equation modelling were performed on 5438 data items. In the study, we confirmed the four-dimensional structure of ICT competence for the Turkish sample. In this study, the construct validity of the PISA 2018 application ICT test was verified using the Turkish sample. The ESCS variable was included as a control variable in the analyses due to its significant impact on the relevant variables. The analysis showed that the mathematical literacy scores of the PISA 2018 Turkish students were positively low affected by the availability of ICT, negatively low affected by the entertainment of ICT, and positively low affected by the interest and perceived competence in ICT, use of ICT for educational purposes at school and outside school, and the use of ICT related to the subject. Considering the ICT variables that affected the PISA 2018 students’ science literacy scores; the entertainment of ICT and the interest and perceived competence in ICT significantly low affected the students’ use of ICT on the subject. On the other hand, the availability of ICT negative significantly low affect their science literacy scores. While the entertainment of ICT negatively low affected the science literacy scores, interest and perceived competence in ICT and use of ICT for educational purposes at school and outside school positively low affected the students’ use of ICT on the subject. Finally, when we look at the ICT variables that low affected the students’ reading literacy scores; and use of ICT for educational purposes at school and outside school and the interest and perceived competence in ICT significantly positive low affected the use of ICT on the subject. On the other hand, the availability of ICT negative significantly low affect reading literacy scores. While the entertainment of ICT negatively low affected reading literacy scores; interest and perceived competence in ICT positively low affected the use of ICT on the subject.

The Effectiveness of Matific Interactive Game Media to Improve Mathematics Learning Outcomes of Grade VII Students on the Matter of Integers

Math learning is often considered difficult by students, this requires the creativity of math teachers to innovate, one of which is by using interactive learning media such as Matific. The purpose of this study was to determine whether or not the use of Matific interactive game media was effective in improving the learning outcomes of seventh grade mathematics students at SMP Negeri 7 Padang on integer material. This study uses a qualitative method by giving a questionnaire. The results of the research on the use of interactive game media Matific has been running effectively in learning mathematics, especially integers and is able to improve student learning outcomes. This is evidenced by the percentage of student questionnaire assessment results of 88.45% which means that Matific games are very effective as interactive learning media. This research contributes to the field of education in developing mathematics skills, increasing student engagement, and reducing student anxiety through educational games that utilize technology in the teaching and learning process. Student involvement in the mathematics learning process is related to increased student learning outcomes. For this reason, it is hoped that mathematics will no longer be considered a difficult lesson by students

Metacommunication Versus Conversational Practices of Teaching Personnel at a Constituent Campus of a Southern Tagalog State University, the Philippines: A Study on Manifestation and Their Relationship

This study examines the intricacies of metacommunication and conversational practices of an incidental sample of 106 teaching personnel engaged in remote teaching at a constituent campus of a Southern Tagalog state university, the Philippines. The primary objective of this study is to measure the extent to which teaching personnel manifest metacommunication across different forms of communication, including verbal, non-verbal, and written expressions, and how they exhibit conversational behaviors during pedagogic interactions. These behaviors encompass openness, empathy, positivity, immediacy, interaction management, and expressiveness. The research also endeavors to test if a significant relationship exists between metacommunication and these conversational practices. Employing a correlational research design, a survey questionnaire, and utilizing statistical tools such as mean, standard deviation, and Pearson r to analyze the quantitative data collected, the findings reveal heightened levels of metacommunication and a prevalent presence of conversational practices among educators in the higher education context. Furthermore, the research identifies a correlation between metacommunication and conversational practices. In light of these findings, it is recommended that educators proactively nurture a positive and professional classroom environment while considering individualized student assessments. This approach can foster more constructive pedagogic interactions within the higher education teaching community while enhancing the learning experience for both educators and students. The study also emphasizes the vital link between metacommunication and conversational practices in education while illustrating its impact on communication quality, learning experiences, and societal dialogue for enhanced empathy and positivity for broader societal benefits.

Assessing the Impact of Minimum Learning Mastery Standard on the Effectiveness of Follow-Up Programs in Madrasa

This study aims to analyse the assessment and follow-up processes of Arab learning at Madrasah Aliyah using qualitative methods with a phenomenological approach. It involved 24 Arabic language teachers from Madrasah Aliyah in South Kalimantan. The findings indicated that Minimum Learning Mastery Standards (MLMS) were not adjusted to accommodate student characteristics, subject competencies, and educational unit conditions. Consequently, learning assessments became less credible, often serving merely to fulfil MLMS requirements. Both enrichment and remedial follow-up were perceived as formalities, lacking a basis in the analysis of student assessments, which undermined students' motivation to learn. Teachers encountered ethical dilemmas in assessment and decision-making processes, exacerbated by external pressures for students to meet MLMS benchmarks. The study emphasizes the importance of reducing external pressures in determining MLMS, enhancing teacher competence in adopting new assessment methods, and improving evaluation systems. These improvements are crucial for developing evidence-based structured enrichment and remedial programs

Commentary: ChatGPT-supported student assessment – can we rely on it?

Commentary: ChatGPT-supported student assessment – can we rely on it?

Utilization of Quiz Kreator in Student Achievement Assessment in Elementary School

Background. The world of education is inseparable from various learning components. The utilization of technology cannot be separated from the world of education. One of them is the use of Quiz Kreator for student achievement assessment in elementary schools. Quiz Kreator is one of the online applications used to create quizzes, including multiple choice quizzes and true false quizzes. Purpose. This study aims to determine how student achievement in elementary schools after using the Quiz Kreator application in the learning process. Method. The researcher used quantitative research methods, namely by distributing questionnaires to elementary school students. The questionnaire was distributed online. Results. The results showed that the use of Quiz Kreator in assessing student achievement in elementary schools has a positive impact on students. The use of Quiz Kreator as an assessment tool that is well designed and relevant to the material being taught, can improve student achievement. Quiz Kreator can provide assessment results automatically and accurately. This can also help teachers in assessing student achievement more objectively. Conclusion. the use of Quiz Kreator in assessing student achievement in elementary schools can be utilized well. The use of this Quiz Kreator application can improve student achievement in the learning process.

Self-Efficacy and Life Satisfaction in Adolescence: Testing the Presumed Role of Individualism–Collectivism

Previous studies suggest a positive association between self-efficacy and subjective well-being. However, these investigations depend on the dichotomy between East Asian and Western cultures, often without directly examining the influence of cultural orientation. This raises questions: How do the psychological benefits of adolescent self-efficacy vary across countries, and to what extent does this variance relate to countries’ cultural orientations? To address these questions, the current study analyzed a sample of 15-year-old students across 66 countries ( N = 427,584) drawn from the 2018 Programme for International Student Assessment (PISA) data. As expected, we found that higher self-efficacy was related to better life satisfaction among adolescents in every country studied. Notably, the beneficial role of self-efficacy varies based on cultural context: The relationship between self-efficacy and adolescent life satisfaction is stronger in individualistic than collectivistic countries. These findings suggest that cultural environment is important for understanding adolescent social-psychological well-being and potentially offer broader implications for global mental health initiatives.

Factors influencing students’ reading literacy in Morocco: A multilevel analysis

Morocco is a multilingual country with a diverse culture. When it participated in the Program for International Student Assessment (PISA) for the first time, its reading literacy scores ranked relatively low in the test. Employing hierarchical linear modeling (HLM), the present study examined the effects of both student- and school-level factors on students’ reading literacy in Morocco. Student-level (N = 5800) and school-level (N = 179) data were drawn from the PISA 2018. The results showed that students’ reading literacy differed significantly across schools, accounting for about 40.5% of the overall variation. Further, the results showed that at the student level, when the variables of gender and family indices (i.e., economic, social, and cultural status) were controlled, language spoken at home, understanding and remembering of meta-cognition, self-concept of reading, expected occupational status, adaptation to instruction, teacher support in test language lessons, and duration in early childhood education and care all had significant effects on students’ reading literacy. At the school level, school location, school type, school size, shortage of educational material, and proportion of highly educated teachers had a crucial influence on student reading literacy, either directly or indirectly. To date, the reasons for these effects have not been systematically investigated. Morocco was the only African country to take part in the PISA test and it would be worthwhile to explore the factors affecting reading literacy in this low-performing country. Further, the results may be applicable to some extent to low reading performance in other countries.

Station Numbers and Duration: Factors Affecting the Validity of OSCE - A Review Article

Context: Objective structured clinical examination (OSCE) is one of the student assessment methods currently used in both undergraduate and postgraduate medical education. This paper reviews evidence related to key factors influenced by the number and duration of OSCE stations. The aim of our study was to broaden current knowledge of the effective components of OSCE design. Although many OSCE designers have doubts about the optimal number and duration of OSCE stations, this issue has not been adequately addressed so far. Methods: The search was conducted through the databases of ScienceDirect, Eric, PubMed, Scopus, Ovid, and Google Scholar. English language papers, including original and review articles, without a time limit until 2022, were included. This review was conducted on papers selected using the keywords: Objective structured clinical examination, OSCE, duration of station, number of stations, utility, validity, reliability, cost, budget, finance, skill, competency. Results: The findings have been validated by scrutinizing OSCE-related skills, reliability, validity, and cost evaluations incorporating OSCE design. These results revealed that key factors to consider in OSCE design include skills, reliability, validity, and cost. Conclusions: Our findings could have a profound impact on the design of OSCE structures in medical education worldwide.

The Role of Students’ Assessment Literacies in Navigating University Assessment, GenAI, and Academic Integrity

Academic integrity concerns related to students’ use of technology have renewed calls for teaching, assessment, and learning best practices, including those that involve and empower students. Empowerment is a benefit of developing students’ assessment literacies, or how students contextually understand, plan, and undertake assessment and use assessment information to monitor and progress their learning. Informed by Bandura’s (1986) social cognitive theory and reflexivity (Dewey, 1933; Schön, 1983), a qualitative exploratory case study examined first-year university students’ experiences with assessment and the development of their assessment literacies. The findings highlighted student autonomy and empowerment benefits while stressing the importance of reflexivity and assessment literacies for both students and teachers. Teaching, assessment, and learning best practices commonly suggested to promote academic honesty in the GenAI context were also evident. Accordingly, this paper explores the role of students’ assessment literacies as part of these best practices, with implications for all levels of education.Keywords: student assessment literacies, academic integrity, GenAI, student empowerment, transition to university

School composition and academic achievement: The case of Russian-medium and Polish-medium schools in Lithuania

After Lithuania re-gained its independence, linguistic and cultural minority groups residing in the country had the right to be educated in non-Lithuanian-medium schools. Yet, the education of linguistic minority children has been a contentious topic in Lithuania for many years, and there is no conclusive evidence on how minority-language-medium schools in Lithuania perform academically, with national assessment suggesting that they perform worse than Lithuanian-speaking schools, and international assessment showing mixed results. Our research focuses on Russian- and Polish-medium schools and analyses the difference in academic performance among children attending Lithuanian-medium school and minority-language schools, as well as its reasons and social implications. Using the OECD Program for International Student Assessment (PISA) data, we find that minority-language children perform better when attending a school in which the language of instruction is the same as their home language.

The impact of the COVID-19 pandemic on higher education: Assessment of student performance in computer science.

The COVID-19 pandemic had radically changed higher education. The sudden transition to online teaching and learning exposed, however, some benefits by enhancing educational flexibility and digitization. The long-term effects of these changes are currently unknown, but a key question concerns their effect on student learning outcomes. This study aims to analyze the impact of the emergence of new models and teaching approaches on the academic performance of Computer Science students in the years 2019-2023. The COVID-19 pandemic created a natural experiment for comparisons in performance during in-person versus synchronous online and hybrid learning mode. We tracked changes in student achievements across the first two years of their engineering studies, using both basic (descriptive statistics, t-Student tests, Mann-Whitney test) and advanced statistical methods (Analysis of variance). The inquiry was conducted on 787 students of the Lublin University of Technology (Poland). Our findings indicated that first semester student scores were significantly higher when taught through online (13.77±2.77) and hybrid (13.7±2.86) approaches than through traditional in-person means as practiced before the pandemic (11.37±3.9, p-value < 0.05). Conversely, third semester student scores were significantly lower when taught through online (12.01±3.14) and hybrid (12.04±3.19) approaches than through traditional in-person means, after the pandemic (13.23±3.01, p-value < 0.05). However, the difference did not exceed 10% of a total score of 20 points. With regard to the statistical data, most of the questions were assessed as being difficult or appropriate, with adequate discrimination index, regardless of the learning mode. Based on the results, we conclude that we did not find clear evidence that pandemic disruption and online learning caused knowledge deficiencies. This critical situation increased students' academic motivation. Moreover, we conclude that we have developed an effective digital platform for teaching and learning, as well as for a secure and fair student learning outcomes assessment.

Mind the Gap, Please!

This mixed-methods study investigates the mismatch between student use of AI for academic tasks and teacher awareness in Saudi Arabian higher education. Surveys of 78 teachers and 243 students in English for Specific Purposes courses at public and private universities included Likert-scale items and an open-ended question on AI tools' benefits, challenges, and impact on learning and academic integrity. The study reveals a significant gap between teachers' perceptions of students' AI skills and the reality of AI integration, leading to discrepancies in judging student knowledge and assessment authenticity. To address these challenges, the manuscript proposes strategies, including targeted professional development for teachers, swift adoption of best practices for ethical use of generative AI in classrooms, and fostering open dialogue within institutions. This research provides insights to inform teaching practices, curriculum development, and policy-making in higher education's evolving landscape. Future research could benefit from more comprehensive sampling to enhance generalizability

COVERT SIMULTANEOUS POST-EDITING IN ONLINE ASSESSMENT OF STUDENTS’ SIGHT TRANSLATION

This first attempt aims to determine the extent of students’ covert use of machine translation (MT) in the online assessment of their sight translation, the strategies of such use, and its signs. The study is based on the analysis of target texts (TT) of specialised online sight translation from Ukrainian into English by 13 BA and 10 MA students. The procedure involved the comparison of the students' TTs with their MT counterparts. Signs of covert MT were found in 46% of the BA and 30% of the MA students’ translations. The main method of this covert MT use is "simultaneous post-editing", i.e., the immediate oral post-editing of the MT text generated by the students on their screens and hidden from the assessor, while they deliver their supposedly original TTs. Simultaneous post-editing strategies range from replacing individual lexemes with their synonyms, adding and deleting elements, changing the syntactic functions of words or phrases, rearranging sentence fragments, transforming their structure, to applying several of these strategies simultaneously. Other methods of concealment include alternating MT systems in translating the same source text, as well as artificially slowing down the process of reading the TT from the screen, accompanied by pauses in the relevant text fragments to perform certain mental operations. In order to increase objectivity, the author recommends a delayed assessment of students' online interpreting recordings. The research perspective is to study the didactic potential of simultaneous post-editing as a procedure for developing general interpreting skills.

Exploration of student nurse experiences of being mentored by practice supervisors/assessors in placement settings.

The Nursing and Midwifery Council changed its standards in 2018 regarding student learning and assessment on placements. Previously, students were allocated a mentor with whom they spent at least 40% of their time and who also assessed them; the new standards brought in the separate roles of practice supervisor and a practice assessor and abolished the 40% minimum, with the student being supported by a wider range of practitioners. While extensive literature examines the experiences of qualified staff supporting students, there is little evidence on the student experience. A qualitative approach using semi-structured interviews with student nurses from two universities in the south of England was used to explore their experiences. The students reported benefits of being supported by the wider healthcare team, said being taught and assessed by different people was beneficial and that they felt better prepared for assessments.

МААЛЫМАТТЫК-ТЕХНОЛОГИЯЛЫК КОМПЕТЕНТТҮҮЛҮКТҮ КАЛЫПТАНДЫРУУЧУ ТАПШЫРМАЛАРДЫ ТҮЗҮҮЧҮ WIZER.ME ИНТЕРАКТИВДИК ТИРКЕМЕСИНИН АРТЫКЧЫЛЫГЫ

The article is devoted to the formation of professional competence of futurecomputer science teachers. Through the formation of information technology competencies, students' creative thinking can be developed and their intellectual abilities can be revealed. After all, the use of innovative technologies, the use of interactive teaching methods is the main requirement of modern education. Assessment of students' knowledge Wizer.me A feature of the tasks created in the interactive application and an advantage over other applications is that you can send multiple tasks via the same link and send feedback in different formats. Completing assignments submitted electronically increases students' ability to work on a computer. Information technology competencies can be developed only through practice. Therefore, the tasks set by the teacher should be such that they can be performed in the form of practice. Wizer.me The ways and benefits of preparing tasks created in an interactive application are described in the article.

An Assessment of Undergraduate Students’ Perceptions of Communication Platforms and Content Used in Communicating Drugs and Substance Abuse: The Case of Laikipia University in Kenya

An Assessment of Undergraduate Students’ Perceptions of Communication Platforms and Content Used in Communicating Drugs and Substance Abuse: The Case of Laikipia University in Kenya

Addressing Missing Data Due to COVID-19: Two Early Childhood Case Studies

One part of COVID-19’s staggering impact on education has been to suspend or fundamentally alter ongoing education research projects. This article addresses how to analyze the simple but fundamental example of a multi-cohort study in which student assessment data for the final cohort are missing because schools were closed, learning was virtual, and/or assessments were canceled or inconsistently ­collected due to COVID-19. We argue that current best-practice recommendations for addressing missing data may fall short in such studies because the assumptions that underpin these recommendations are violated. We then provide a new, simple decision-making framework for empirical researchers facing this situation and provide two empirical examples of how to apply this framework drawn from early childhood studies, one a cluster randomized trial and the other a descriptive longitudinal study. Based on this framework and the assumptions required to address missing data, we advise against the standard recommendation of adjusting for missing outcomes (e.g., via imputation or weighting). Instead, we generally recommend changing the target quantity by restricting to fully observed cohorts or by pivoting to focusing on an alternative outcome.

ANALISIS KEMAMPUAN PEMECAHAN MASALAH MATEMATIKA MATERI BANGUN DATAR SISWA KELAS V SEKOLAH DASAR

The purpose of this study is to characterize and understand the mathematical problem-solving skills of fifth-grade students at SDN 1 Tanjung Sari, particularly with regard to narrative problems with flat forms. This study employs a qualitative descriptive methodology that focuses on close observation and in-depth examination of the research participants, who are SDN 1 Tanjung Sari fifth-grade pupils. Two primary methods were used in this study to gather data: assessments of students' mathematical problem-solving skills and interviews. The Miles and Huberman Model, which has three primary stages data reduction, data presentation, and conclusion drawing was used to conduct the data analysis. The technique of eliminating extraneous or useless data is known as data reduction. Data presentation is the process of arranging and displaying information in a way that is simple to understand. Drawing conclusions from study results entails analyzing data and drawing judgments. The study's findings indicate that pupils' average proficiency in solving mathematical problems involving flat shapes is 75.78, falling within the middle range. This indicates that although there is still need for development, pupils' grasp of the notion of flat forms is adequate. The study indicated that, when considering learning interest, students' average mathematical problem-solving skill was 87.22 for high learning interest students, 74.85 for moderate learning interest students, and 57.80 for low learning interest students. This demonstrates that students' aptitude for solving mathematical puzzles is greatly influenced by their learning interests. Overall, this study offers significant new information on how learning interests might influence students' ability to solve mathematical problems. Future instructional materials for more efficient learning can be developed using these findings as a foundation

The Impact of Realistic Mathematics Education-based Student Worksheet for Improving Students’ Mathematical Problem-Solving Skills

&lt;p&gt;&lt;span lang="EN-US"&gt;Mathematical problem-solving ability is a critical skill required to meet the challenges of the 21st century, making it imperative for Indonesian students to master these skills. However, international assessments have consistently shown that Indonesian students' competencies, particularly in mathematical problem-solving, remain low. Research attributes this deficiency to the lack of connections between mathematical concepts and real-life applications, which are essential for enhancing problem-solving skills. On the other hand, Realistic Mathematics Education (RME) is a learning approach that emphasizes the integration of real-world contexts in learning activities and has been shown to improve these skills. Therefore, this study aims to develop a student worksheet based on the RME approach to enhance students' problem-solving abilities. The development process followed the ADDIE model, which includes the stages of analysis, design, development, implementation, and evaluation. Various research and development instruments were employed, including validation by material and media experts, student assessments of the electronic worksheets, and pre-test and post-test evaluations. Data collection methods encompassed both non-test and test techniques. The results demonstrate that the developed student worksheets are valid, practical, and effective. The validity was confirmed by high average scores from material and media expert validators, categorizing the worksheets as valid. Practicality was supported by positive student assessments, placing the worksheets in the practical category. These findings indicate that the developed worksheets significantly enhance students' problem-solving abilities. This study provides empirical evidence supporting the effectiveness of the RME approach in improving mathematical problem-solving skills among Indonesian students. It also offers a theoretical and practical framework for advancing mathematics education in Indonesia, advocating for the adoption of learning approaches that better address the demands of the 21st century. Detailed analysis of the product's acceptability and impact will be discussed further in the paper.&lt;/span&gt;&lt;/p&gt;