Assessment In Higher Education Research Articles

A scoping review of challenges and opportunities of assessments in higher education

The post-Covid continuation of online classes and assessments in higher education at many institutions has necessitated re-evaluating assessment practices. This research article presents a scoping literature review on the challenges and innovative opportunities regarding assessments in higher education. The contextual factors of load-shedding, unavailability of Wi-Fi, the requirement for cheat-proof online assessment, and questions with ungoogleable answers or answers that ChatGPT could not provide underlined the importance of this topic. Thirty articles were analysed using the qualitative software tool, Atlas.ti. According to the literature, the main challenge is cheating with online assessments, and the best solution provided is oral presentations students’ work. This complex issue needs further research on combining contextual challenges, the credibility of assessments and the enhancement of 4IR workplace skills in one assessment model to support assessments in higher education.

What is the student experience of remote proctoring? A pragmatic scoping review

AbstractRemote or online proctoring (invigilating) is a technology primarily used to improve the integrity of online examinations. The use of remote proctoring increased significantly as the world switched to online assessment during the COVID‐19 pandemic. Remote proctoring received negative media attention, including concerns about user privacy, discrimination and the accuracy of automated systems for detecting and reporting cheating. However, it is unclear whether these media concerns fully reflect the experiences of students. Online assessment offers a number of potential advantages to learners and education providers, and it seems likely that it is here to stay. It is essential to fully understand the learner experience of remote proctoring, with a view to ensuring it is as effective as possible while meeting the needs of all stakeholders, especially those being proctored. We undertook a scoping review of research into the student experience of online proctoring, with a pragmatic focus, aimed at developing guidance for higher education providers, based on the student experience. We reviewed primary research studies which evaluated the student experience of the use of remote proctoring for summative assessment in Higher Education. We used the Education Research Information Center database (ERIC) and Google Scholar. 21 papers were identified, from which the positives and negatives of the student experience were extracted, along with the main recommendations from the research. These were then synthesised into a series of summary recommendations by thematic analysis, by a team of researchers that included students and academic staff. We found that student experience was largely negative, influenced by concerns over privacy, technological challenges, fairness and stress. Recommendations were to include the student voice in decisions about how and why to use remote proctoring and limiting the use of remote proctoring. Working with students as partners and limiting the use of remote proctoring where possible, are key to ensuring a positive student experience.

Life Cycle Assessment in Higher Education: Design and Implementation of a Teaching Sequence Activity

The latest studies show that to achieve the Sustainable Development Goals on education, there must be a focus on adequately training higher education students. In this work, we present a study about the Life Cycle Analysis of knowledge of products and processes of engineering students. This aspect is very relevant in engineering education since it has direct implications on sustainability. The first step was to identify what the learning problems were, and taking them into account, a specific teaching sequence was designed and implemented over three academic years. Two activities, on an increasing level of complexity, of the application of Life Cycle Assessment are shown in this paper. The first one is the Life Cycle Analysis comparison between two steel and polypropylene pieces. The second one is the Life Cycle Analysis comparison between three different ends of life of a polypropylene piece: mechanical recycling, incineration, and landfill. Data on the evolution of students’ marks while solving a “one step more difficult project” throughout these courses have been collected. The results show a generalized learning by the students about Life Cycle Analysis.

ChatGPT and Assessment in Higher Education: A Magic Wand or a Disruptor?

There is a current debate about the extent to which ChatGPT, a natural language AI chatbot, can disrupt processes in higher education settings. The chatbot is capable of not only answering queries in a human-like way within seconds but can also provide long tracts of texts which can be in the form of essays, emails, and coding. In this study, in the context of higher education settings, by adopting an experimental design approach, we applied ChatGPT-3 to a traditional form of assessment to determine its capabilities and limitations. Specifically, we tested its ability to produce an essay on a topic of our choice, created a rubric, and assessed the produced work in accordance with the designed rubric. We then evaluated the chatbot’s work by assessing ChatGPT’s application of its rubric according to a modified version of Paul’s (2005) Intellectual Standards rubric. Using Christensen et al.’s (2015) framework on disruptive innovations, our study found that ChatGPT was capable of completing the set tasks competently, quickly, and easily, like a “magic wand”. However, our findings also challenge the extent to which all of the ChatGPT’s demonstrated capabilities can disrupt this traditional form of assessment, given that there are aspects of its construction and evaluation that the technology is not yet able to replicate as a human expert would. These limitations of the chatbot can provide us with an opportunity for addressing vulnerabilities in traditional forms of assessment in higher education that are subject to academic integrity issues posed by this form of AI. We conclude the article with implications for teachers and higher education institutions by urging them to reconsider and revisit their practices when it comes to assessment.

A Systematic Umbrella Review on Computational Thinking Assessment in Higher Education

Computational Thinking (CT) is considered a core 21st century digital skill. The aspect of assessment is crucial and knowing what, who, when, how, and where to assess is important for assessment design. In this study, we conducted an umbrella review to gain insights regarding CT assessment in higher education. In total, we analyzed 11 reviews, focusing on: (1) bibliographical and methodological characteristics of the reviews; (2) aspects relevant of assessment design, including a) assessed constructs, b) applied assessment methodologies, and c) assessment contexts. Our findings suggest an increased attention on this topic. However, hardly any reviews reasoned the selection of their review methodology, and most of the reviews did not thoroughly examine existing reviews. Regarding assessment design aspects, most reviews did not confine their scope to higher education; however, findings on interventions and educational settings show commonalities. We identified 120 unique assessed constructs and around 10 types of assessment methods. Though a combined use of distinct assessment methods is suggested in reviews, guidelines for appropriate assessment design are yet to be constructed. Based on the findings, we argue that it is necessary to explore different combinations of assessment design in various contexts to construct assessment guidelines.

Building Academic Integrity and Capacity in Digital Assessment in Higher Education

The rapid spread of the COVID-19 pandemic in the first half of 2020 disrupted and changed higher education across the world, and into the future. Campuses were shut down, almost overnight. International and State borders were closed and business models that relied heavily on high-paying international students collapsed. University leaders and academics were forced to find new ways of attracting, engaging with, and retaining students. This paper describes a project that was undertaken in Australia in 2021 which investigated the implications of, and scope for online assessment in this ‘new virtual world’ of learning and teaching in higher education. After extensive research and consultation, the project developed a Digital Assessment Framework dubbed DASH C21, which stands for Digital Assessment Stretching Horizons for the 21st Century. The Framework is based on a set of underpinning principles and values; the Inputs. The Inputs feed into four Dimensions. These Dimensions are Practices and Pedagogies, Strategies, Emerging Technologies and Stretching Horizons. The Outputs are a series of authentic, innovative, experiential and forward looking, digital assessments, reinforced by academic integrity values. This paper will be of particular interest to higher education senior managers, academics, learning and teaching specialists, staff professional developers and curriculum designers. Keywords: Digital Assessment Framework

Learning Assessment in Noncredit Continuing Education

While program- and institution-level learning assessment in higher education has received substantial attention, much less emphasis has been placed on the assessment of learning in noncredit continuing education in higher education institutions. Learning assessment is sparse in this area because these learning experiences may be shorter in duration than credit courses, are commonly taught by field experts, and there are limits to the time and resources the higher education institution or other provider invests in conducting learning outcome assessment. This paper describes assessment recommendations in the noncredit continuing education space, with concrete examples in three areas: learning outcome statements, surveys with learning outcome-focused questions, and direct assessment of learning.

Impact of the COVID-19 Pandemic on Teaching, Learning, Assessment, and Wellbeing in Higher Education.

Lockdown restrictions and social distancing regulations enforced by governments worldwide to prevent COVID-19 transmission have caused momentous disruption to the global education sector. Educators and students across all institutions and levels had to suddenly adapt to a new reality where in-person teaching was replaced by hybrid or remote learning activities. This chapter aims to evaluate the impact of the pandemic on teaching, learning and assessment in higher education. It discusses the challenges presented by the shift to online teaching and the pedagogical strategies developed to foster student engagement and assess their progress in a remote learning setting. Moreover, this chapter explores the impact of the pandemic on wellbeing and mental health of students and academic staff. The last section draws on the lessons learned from the pandemic to identify areas of good practice that are likely to positively shape the post-pandemic higher education panorama.

Digital assessment in higher education of Nepal: preference and practice

Digital assessment in higher education of Nepal: preference and practice

UK Research Excellence Framework (2021) Reform and Implications for China’s Implications for Research Assessment in Higher Education

UK Research Excellence Framework (2021) Reform and Implications for China’s Implications for Research Assessment in Higher Education

Digital assessment in higher education of Nepal: preference and practice

Digital assessment in higher education of Nepal: preference and practice

“On the edge of glory and hanging on a moment of truth”: PgCAP in a rapidly changing and uncertain world

The last three years have seen rapid changes to learning, teaching and assessment in Higher Education. This paper shares our experiences of leading, teaching and reaccrediting a Postgraduate Certificate in Higher Education (PgCAP) during this time. The PgCAP, much like the staff enrolled on the course, has had to adapt, innovate, and experiment to meet the various challenges. This has included an unplanned move online, to a planned online approach, through to our current blended by design delivery method. Throughout we have sought to model best practice with the risks and rewards this brings. Our revised PgCAP was approved internally in 2022 and subsequently successfully reaccredited with Advance HE on the Professional Standards Framework (PSF). Some of this process was exciting: we felt at the forefront of changes to learning and teaching, to be charting new developments in technology and interaction which our learners could then use in their own teaching. But part of this process was also daunting, feeling we were one moment away from crashing and failing. We tried to learn from those failures and become comfortable working on the edge, with an ever-changing set of priorities and expectations (from ourselves, our learners, and our institution). Our case study: (1) reflects on the challenges, pressures and opportunities associated with PgCAP programmes to model best practice (even in times of crisis), (2) shares how our blended by design approach came about, how it works, and the feedback we have received from participants, (3) demonstrates how we refreshed our content, intended learning outcomes and assessments to map to the PSF 2023.

The Application of CIPP Model in the Evaluation of Teaching Quality of College Education in the Context of New Era

Abstract The flaws in the conventional teaching quality evaluation system that have always existed have not been fixed since the start of the new century. This study suggests a teaching assessment model for college education that utilizes the CIPP model since there is a pressing need for a model that can satisfy the demands of the modern educational environment. The investigation examines the relevance of both approaches to teaching quality evaluation in educational institutions by combining the advantages of CIPP and BP neural networks. The artificial neural network’s working mechanism is described, the weights within the BP learning algorithm are modified, and the first version of the teaching assessment model is inferred based on an analysis of the structure and function of neurons. The conceptual model of teaching quality assessment in higher education is intended to be completed by the model’s algorithm and framework. Investigate and analyze the teaching quality of S colleges and universities using the empirical analysis approach. The results of the empirical investigation show that the correlation coefficients of the 4 dimensions of teaching evaluation are above 0.6, with control between 0.3-0.8, and they have a strong correlation. The Cronbach’s alpha coefficients of the survey are all above 0.7, with very good reliability.

Pedagogical Assessment in Higher Education: The Importance of Training

The diversity of students reaching higher education, the skills required of the 21st-century citizen, the Bologna Declaration, and the pressure exerted by international organizations impose a pedagogical reconfiguration of teaching, learning, and assessment through the recognition of the pedagogical dimension as a component of teacher professional development. We present the results of a study conducted at a university in Portugal with the following objectives: identifying conceptions and practices of pedagogical assessment and determining the influence of pedagogical training on these conceptions and practices. An online questionnaire (pre- and post-test) was administered to 31 teachers who had taken part in a training course on pedagogical assessment. It was found that: nearly half of the teachers experience difficulties in pedagogical assessment, with fairness being the main issue; the most commonly used instruments are written tests, research assignments, and reports; around two-thirds of teachers change the way they assess students, with the nature of the curricular units being the most influential factor in this decision; and there has been a change in the concept of assessment, in which the strict idea of testing, measuring, and classifying students’ knowledge has been replaced by the gathering of information for decision-making about the teaching and learning process.

ФОРМУВАЛЬНЕ ОЦІНЮВАННЯ НАВЧАЛЬНИХ ДОСЯГНЕНЬ ЗДОБУВАЧІВ ВИЩОЇ ОСВІТИ НА ЗАНЯТТЯХ ХІМІЇ

The article identifies the main methodological approaches to formative assessment of higher education students’ learning achievements in chemistry teaching. Formative assessment, considered as assessment to improve learning, is envisaged by the concept of modern education, which determines a change in the approach to assessment. The use of this type of assessment in higher education does not have such a wide range of applications compared to general secondary education, but in recent years teachers have increasingly noted its advantages working with students. Higher education can use a variety of formative assessment methods to measure student progress and understanding. In chemistry teaching such methods may include self-assessment, chemical experiments and laboratory work, written work (laboratory reports, diagnostic work, etc.), tests, group work, individual consultations. These types of work can stimulate students’ activity and help them to develop collaborative and problem-solving skills. Formative assessment in higher education in the field of chemistry can include various methods and tools to determine students’ learning progress and skills development. This type of assessment, as a person-centred form of control, becomes a tool for continuous feedback in higher education, allowing teachers and students to stay in touch throughout the le arning process and to improve the level of knowledge acquisition and practical skills. It is important to ensure that assessment methods are varied to reflect different aspects of learning and skill development. It is also important to provide constructive feedback to encourage further improvement among higher education students.

Quality and Skill-based Assessment in Higher Education

Quality and Skill-based Assessment in Higher Education

Re-imagining assessment in higher education: Creating alternative pathways for inclusive and democratic assessments in Zambian higher education institutions

This paper interrogates emerging issues and assessment practices within higher education institutions in Zambia. It presents the reflections of a sample of lecturers and students from the country’s largest public university on their assessment experiences during and after the COVID-19 pandemic disruptions. Employing a qualitative research framework grounded in critical social theory, the study uncovers the constructions of assessment in higher education and how current assessment practices, particularly the focus on grades, undermine authentic learning experiences and learner motivation. Through in-depth interviews, participants challenge current practices and envision alternative approaches to higher education assessment that prioritize flexibility and creativity. This article gives a voice to the otherwise voiceless students and lecturers whose insights might be critical in transforming higher education assessments for student empowerment, equity, criticality, and lifelong learning.

Exploring alternative invigilated assessments in higher education

The use of educational technologies in course development, assessment, and delivery has undergone significant transformations in higher education institutions due to the Covid-19 pandemic. With universities worldwide offering an unprecedented number of online courses, the landscape of higher education has experienced both opportunities and challenges for learning designers, academics, and students. Among the challenges faced, proctoring online examinations has emerged as a pressing concern. Focusing on the context of a school where accreditation requirements demand invigilated assessments, this paper explores and proposes alternative invigilated assessment approaches across various modes of course delivery. This work-in-progress report provides insights into different alternative invigilated assessment options, offering practical instructions for implementing these assessment methods. By exploring these options, this paper aims to contribute to the broader discussion on assessment practices in higher education and better align with the needs of our students and academic programs as well as that of the accrediting bodies.

ChatGPT and university teaching, learning and assessment: some initial reflections on teaching academic integrity in the age of Large Language Models

Since its arrival in late 2022, ChatGPT has occupied the minds of academics, administrators and students. Reactions to the emergence of Large Language Models (LLMs) have varied but significant anxieties about their impact on assessment have arisen. To address these concerns, this article serves three purposes; firstly, it seeks to gauge the discourse surrounding Large Language Models (LLMs) focusing on ChatGPT. In doing so, it explores general and academic responses to the technology and the challenges/opportunities that have been identified. Secondly, and building on this, it provides an overview of ChatGPT in action and seeks to moderate fears raised by some of the extreme claims that have been made about the potential of this technology. Finally, the article uses a case study to discuss the introduction of this technology to a group of first-year undergraduate students, offering guidance on how the topic of LLMs might be broached. It concludes by suggesting that while the technology has the ability to offer assistance in the completion of academic assessment, it does not replace the higher thinking skills that are central to teaching, learning and assessment in higher education. In turn, arguing that these must be central to assessment practices.

Using Social Media for Peer Assessment in Higher Education: A Systematic Review of the Literature

The modern affordances of technology and social media networks' popularity enable unique educational opportunities. In this systematic review, our objective was to outline insights regarding the current use of social media for peer assessment in higher education. Specifically, what does the current research indicate are common characteristics, benefits, and challenges, and how can they guide future research and practice? We searched the OMNI information consortium consisting of 392 databases to gain insights. From 2,450 identified articles, we included 12 consisting of 702 participants in our review. The included articles are empirical and peer-reviewed, focusing on higher education and retrieved through the OMNI information consortium. The results were synthesized through a three-step integrated approach to afford the qualitative assimilation of our findings. Facebook and YouTube were the most commonly used platforms, while educational studies used social media for peer assessment most often. The articles referenced in our review primarily used mixed methods approaches and were of medium quality. We found benefits associated with attaining learning objectives while fostering the co-creation of knowledge, self-awareness, and motivation. In contrast, educators may encounter challenges with implementing peer assessment through social media related to technology issues and student behaviours. We outline further insights into our findings and practical recommendations in our discussion.