Assessment In Higher Education Research Articles

“On the edge of glory and hanging on a moment of truth”: PgCAP in a rapidly changing and uncertain world

The last three years have seen rapid changes to learning, teaching and assessment in Higher Education. This paper shares our experiences of leading, teaching and reaccrediting a Postgraduate Certificate in Higher Education (PgCAP) during this time. The PgCAP, much like the staff enrolled on the course, has had to adapt, innovate, and experiment to meet the various challenges. This has included an unplanned move online, to a planned online approach, through to our current blended by design delivery method. Throughout we have sought to model best practice with the risks and rewards this brings. Our revised PgCAP was approved internally in 2022 and subsequently successfully reaccredited with Advance HE on the Professional Standards Framework (PSF). Some of this process was exciting: we felt at the forefront of changes to learning and teaching, to be charting new developments in technology and interaction which our learners could then use in their own teaching. But part of this process was also daunting, feeling we were one moment away from crashing and failing. We tried to learn from those failures and become comfortable working on the edge, with an ever-changing set of priorities and expectations (from ourselves, our learners, and our institution). Our case study: (1) reflects on the challenges, pressures and opportunities associated with PgCAP programmes to model best practice (even in times of crisis), (2) shares how our blended by design approach came about, how it works, and the feedback we have received from participants, (3) demonstrates how we refreshed our content, intended learning outcomes and assessments to map to the PSF 2023.

The Application of CIPP Model in the Evaluation of Teaching Quality of College Education in the Context of New Era

Abstract The flaws in the conventional teaching quality evaluation system that have always existed have not been fixed since the start of the new century. This study suggests a teaching assessment model for college education that utilizes the CIPP model since there is a pressing need for a model that can satisfy the demands of the modern educational environment. The investigation examines the relevance of both approaches to teaching quality evaluation in educational institutions by combining the advantages of CIPP and BP neural networks. The artificial neural network’s working mechanism is described, the weights within the BP learning algorithm are modified, and the first version of the teaching assessment model is inferred based on an analysis of the structure and function of neurons. The conceptual model of teaching quality assessment in higher education is intended to be completed by the model’s algorithm and framework. Investigate and analyze the teaching quality of S colleges and universities using the empirical analysis approach. The results of the empirical investigation show that the correlation coefficients of the 4 dimensions of teaching evaluation are above 0.6, with control between 0.3-0.8, and they have a strong correlation. The Cronbach’s alpha coefficients of the survey are all above 0.7, with very good reliability.

Pedagogical Assessment in Higher Education: The Importance of Training

The diversity of students reaching higher education, the skills required of the 21st-century citizen, the Bologna Declaration, and the pressure exerted by international organizations impose a pedagogical reconfiguration of teaching, learning, and assessment through the recognition of the pedagogical dimension as a component of teacher professional development. We present the results of a study conducted at a university in Portugal with the following objectives: identifying conceptions and practices of pedagogical assessment and determining the influence of pedagogical training on these conceptions and practices. An online questionnaire (pre- and post-test) was administered to 31 teachers who had taken part in a training course on pedagogical assessment. It was found that: nearly half of the teachers experience difficulties in pedagogical assessment, with fairness being the main issue; the most commonly used instruments are written tests, research assignments, and reports; around two-thirds of teachers change the way they assess students, with the nature of the curricular units being the most influential factor in this decision; and there has been a change in the concept of assessment, in which the strict idea of testing, measuring, and classifying students’ knowledge has been replaced by the gathering of information for decision-making about the teaching and learning process.

ФОРМУВАЛЬНЕ ОЦІНЮВАННЯ НАВЧАЛЬНИХ ДОСЯГНЕНЬ ЗДОБУВАЧІВ ВИЩОЇ ОСВІТИ НА ЗАНЯТТЯХ ХІМІЇ

The article identifies the main methodological approaches to formative assessment of higher education students’ learning achievements in chemistry teaching. Formative assessment, considered as assessment to improve learning, is envisaged by the concept of modern education, which determines a change in the approach to assessment. The use of this type of assessment in higher education does not have such a wide range of applications compared to general secondary education, but in recent years teachers have increasingly noted its advantages working with students. Higher education can use a variety of formative assessment methods to measure student progress and understanding. In chemistry teaching such methods may include self-assessment, chemical experiments and laboratory work, written work (laboratory reports, diagnostic work, etc.), tests, group work, individual consultations. These types of work can stimulate students’ activity and help them to develop collaborative and problem-solving skills. Formative assessment in higher education in the field of chemistry can include various methods and tools to determine students’ learning progress and skills development. This type of assessment, as a person-centred form of control, becomes a tool for continuous feedback in higher education, allowing teachers and students to stay in touch throughout the le arning process and to improve the level of knowledge acquisition and practical skills. It is important to ensure that assessment methods are varied to reflect different aspects of learning and skill development. It is also important to provide constructive feedback to encourage further improvement among higher education students.

Quality and Skill-based Assessment in Higher Education

Quality and Skill-based Assessment in Higher Education

Re-imagining assessment in higher education: Creating alternative pathways for inclusive and democratic assessments in Zambian higher education institutions

This paper interrogates emerging issues and assessment practices within higher education institutions in Zambia. It presents the reflections of a sample of lecturers and students from the country’s largest public university on their assessment experiences during and after the COVID-19 pandemic disruptions. Employing a qualitative research framework grounded in critical social theory, the study uncovers the constructions of assessment in higher education and how current assessment practices, particularly the focus on grades, undermine authentic learning experiences and learner motivation. Through in-depth interviews, participants challenge current practices and envision alternative approaches to higher education assessment that prioritize flexibility and creativity. This article gives a voice to the otherwise voiceless students and lecturers whose insights might be critical in transforming higher education assessments for student empowerment, equity, criticality, and lifelong learning.

Exploring alternative invigilated assessments in higher education

The use of educational technologies in course development, assessment, and delivery has undergone significant transformations in higher education institutions due to the Covid-19 pandemic. With universities worldwide offering an unprecedented number of online courses, the landscape of higher education has experienced both opportunities and challenges for learning designers, academics, and students. Among the challenges faced, proctoring online examinations has emerged as a pressing concern. Focusing on the context of a school where accreditation requirements demand invigilated assessments, this paper explores and proposes alternative invigilated assessment approaches across various modes of course delivery. This work-in-progress report provides insights into different alternative invigilated assessment options, offering practical instructions for implementing these assessment methods. By exploring these options, this paper aims to contribute to the broader discussion on assessment practices in higher education and better align with the needs of our students and academic programs as well as that of the accrediting bodies.

ChatGPT and university teaching, learning and assessment: some initial reflections on teaching academic integrity in the age of Large Language Models

Since its arrival in late 2022, ChatGPT has occupied the minds of academics, administrators and students. Reactions to the emergence of Large Language Models (LLMs) have varied but significant anxieties about their impact on assessment have arisen. To address these concerns, this article serves three purposes; firstly, it seeks to gauge the discourse surrounding Large Language Models (LLMs) focusing on ChatGPT. In doing so, it explores general and academic responses to the technology and the challenges/opportunities that have been identified. Secondly, and building on this, it provides an overview of ChatGPT in action and seeks to moderate fears raised by some of the extreme claims that have been made about the potential of this technology. Finally, the article uses a case study to discuss the introduction of this technology to a group of first-year undergraduate students, offering guidance on how the topic of LLMs might be broached. It concludes by suggesting that while the technology has the ability to offer assistance in the completion of academic assessment, it does not replace the higher thinking skills that are central to teaching, learning and assessment in higher education. In turn, arguing that these must be central to assessment practices.

Using Social Media for Peer Assessment in Higher Education: A Systematic Review of the Literature

The modern affordances of technology and social media networks' popularity enable unique educational opportunities. In this systematic review, our objective was to outline insights regarding the current use of social media for peer assessment in higher education. Specifically, what does the current research indicate are common characteristics, benefits, and challenges, and how can they guide future research and practice? We searched the OMNI information consortium consisting of 392 databases to gain insights. From 2,450 identified articles, we included 12 consisting of 702 participants in our review. The included articles are empirical and peer-reviewed, focusing on higher education and retrieved through the OMNI information consortium. The results were synthesized through a three-step integrated approach to afford the qualitative assimilation of our findings. Facebook and YouTube were the most commonly used platforms, while educational studies used social media for peer assessment most often. The articles referenced in our review primarily used mixed methods approaches and were of medium quality. We found benefits associated with attaining learning objectives while fostering the co-creation of knowledge, self-awareness, and motivation. In contrast, educators may encounter challenges with implementing peer assessment through social media related to technology issues and student behaviours. We outline further insights into our findings and practical recommendations in our discussion.

Accounting Teaching, Research and Accreditation

Accreditation is becoming a widely accepted form of program assessment in higher education. The Association to Advance Association to Advance Collegiate Schools of Business (AACSB) is the dominant form or accreditation for both business programs in general and accounting programs specifically. With high research expectations, AACSB accreditation seems to place “teaching” institutions at a disadvantage in gaining accreditation compared to “research” institutions. Forcing “teaching” schools to adopt rigorous research standards may have detrimental consequences to teaching, which is at the very heart of “teaching” institutions. The benefits of AACSB accreditation need to be measured against the high cost of achieving this accreditation. Other means of signaling accounting program credibility, such as International Assembly for Collegiate Business Education (IACBE), may be a viable alternative to separate AACSB accounting program accreditation.

A Review and Reflection on Online Learning and Assessments in Higher Education after the Pandemic

The 2020 COVID-19 pandemic has pushed many higher education institutions to deliver courses using online mode due to the movement restrictions. However, many academicians were under-prepared. Now that the pandemic is over, it is time to reflect on these online teaching practices and consider their suitability and sustainability in this post-pandemic era. This study used a case study approach and examined blended and hybrid learning and online assessments and their use in higher education institutions. It adopted a crowdsourcing approach to gather the relevant literature and was backed by the reflection and experience of the academicians in a branch campus of an Australian university in Malaysia. This study suggests that academicians could still use blended and hybrid learning as an alternative but must upskill themselves. Furthermore, selective online assessments could still be used. This study would be helpful to academicians and policymakers in higher education when deciding the teaching mode and assessments in the post-pandemic era.

The Pros and Cons of Online Assessment in Higher Education

Nowadays, many universities and colleges use some combination of online and blended learning methods. Teachers need to re-evaluate assessment, student development, and instruction while working in non-traditional contexts. Questions like, "How does formative assessment work in an online learning environment?" and "How reliable and efficient is the assessment in achieving the set goals?" are examples of such concerns. It is of equal importance to consider how formative evaluation could enhance online pedagogical methods for instructors and students. The researchers in this study looks at the benefits of online formative assessment for teachers and their students. A mixed-methods survey was used to collect data regarding the formative assessment practices implemented in Google Classroom courses. Lecturers and students at a university made up the population. Several forms of formative evaluation make use of online tools, such as discussion forums and standardised tests. Greater student engagement, less time spent marking, and lower administrative expenses are a few of the more prominent benefits. There are additional benefits, such as more options for when and where to take the test. The key points are that students take a more active role in their own education and that teachers have the opportunity to create an environment where the focus is on both students and assessment by using tools like online formative assessment and formative feedback. In the context of online formative assessment, continuing trustworthy assessment tasks and interactive formative feedback are important components that will handle reasons and trustworthiness threats. Keywords: online formative assessments, student engagement, online pedagogical methods, learning, formative feedback, google classroom Proceedings Citation Format Ajogbeje, O.J. Boris, O.O. & Ekiugbo, U.E. (2023): The Pros and Cons of Online Assessment in Higher Education. Proceedings of the 37th iSTEAMS Multidisciplinary Cross-Border Conference. 30th October – 1st November, 2023. Academic City University College, Accra, Ghana. Pp 171-184. dx.doi.org/10.22624/AIMS/ACCRACROSSBORDER2023V2P2P33

Exploring the impact of language models, such as ChatGPT, on student learning and assessment

AbstractRecent developments in language models, such as ChatGPT, have sparked debate. These tools can help, for example, dyslexic people, to write formal emails from a prompt and can be used by students to generate assessed work. Proponents argue that language models enhance the student experience and academic achievement. Those concerned argue that language models impede student learning and call for a cautious approach to their adoption. This paper aims to provide insights into the role of language models in reshaping student learning and assessment in higher education. For that purpose, it probes the impact of language models, specifically ChatGPT, on student learning and assessment. It also explores the implications of language models in higher education settings, focusing on their effects on pedagogy and evaluation. Using the Scopus database, a search protocol was employed to identify 25 articles based on relevant keywords and selection criteria. The developed themes suggest that language models may alter how students learn and are assessed. While language models can provide information for problem‐solving and critical thinking, reliance on them without critical evaluation adversely impacts student learning. Language models can also generate teaching and assessment material and evaluate student responses, but their role should be limited to ‘play a specific and defined role’. Integration of language models in student learning and assessment is only helpful if students and educators play an active and effective role in checking the generated material's validity, reliability and accuracy. Propositions and potential research questions are included to encourage future research.

AI, Analytics and a New Assessment Model for Universities

As the COVID-19 pandemic recedes, its legacy has been to disrupt universities across the world, most immediately in developing online adjuncts to face-to-face teaching. Behind these problems lie those of assessment, particularly traditional summative assessment, which has proved more difficult to implement. This paper models the current practice of assessment in higher education as influenced by ten factors, the most important of which are the emerging technologies of artificial intelligence (AI) and learning analytics (LA). Using this model and a SWOT analysis, the paper argues that the pressures of marketisation and demand for nontraditional and vocationally oriented provision put a premium on courses offering a more flexible and student-centred assessment. This could be facilitated through institutional strategies enabling assessment for learning: an approach that employs formative assessment supported by AI and LA, together with collaborative working in realistic contexts, to facilitate students’ development as flexible and sustainable learners. While literature in this area tends to focus on one or two aspects of technology or assessment, this paper aims to be integrative by drawing upon more comprehensive evidence to support its thesis.

A Holistic Approach to Authentic Assessment

Authentic assessments require students to use the same skills, knowledge and attributes that they would use in a workplace context. Such assessments have positively affected the quality and depth of student learning, skills development, employability, and workplace readiness. Authentic assessments have also been heralded as a potential solution to minimise academic integrity issues caused by artificial intelligence software such as ChatGPT. Despite these benefits, substantial barriers exist to implementing authentic assessments in higher education. This article discusses the critical elements of authentic assessments and the steps involved in planning authentic assessments. This article is based on the author's professional experiences and reflections on implementing an authentic assessment initiative at a business school in a New Zealand University. Further information was obtained from document analysis, observations and informal conversations with colleagues. The article recommends that it is essential to develop a holistic approach at the programme level when designing authentic assessments.

From authentic assessment to authenticity in assessment: broadening perspectives

For over 30 years, the notion of authentic assessment in higher education has been adopted in academic practice, but it has managed to escape substantial critique. Although there have been multiple definitions and operationalisations of authentic assessment, current practice tends to foreground mimicking of work tasks. Authenticity cannot be completely unmoored from the reality of workplaces, the demands of the discipline, and the overall intended learning outcomes, however, a restricted view of how these aspects are represented in assessment can limit the sector’s ability to prepare graduates who can engage with and shape the changing world. This paper elaborates the multiple challenges that some conceptualisations of authentic assessment contribute to assessment planning, recognising that assessment design always requires compromise. Three theoretical perspectives on authenticity are introduced to open new possibilities for authenticity in assessment. These are (1) psychological authenticity; (2) ontological fidelity; and (3) practice theory perspectives. The final section discusses how learning design might offer a means to operationalise theory. The paper concludes by suggesting that authenticity in assessment continues to hold value for the sector beyond its current uses through stronger theoretical conceptualisation and operationalisation of authenticity.

ChatGPT and higher education assessments: More opportunities than concerns?

ChatGPT and higher education assessments: More opportunities than concerns?

Addressing Language Diversity in Early Years Mathematics: Proposed Classroom Practices through a Live Brief Assessment

There is a growing emphasis on the role of language in teaching and learning mathematics, most significantly in classrooms with increased language diversity. Consequently, teachers face considerable challenges in accommodating diverse needs and must employ strategies to support all students. It is, therefore, crucial to provide prospective teachers with opportunities to enhance their pedagogical approaches while raising their awareness of the relationship between language and mathematics. In this respect, Live Brief assessments in Higher Education, which involve students working on authentic projects/tasks from a school, may be a promising avenue. This research draws on the 19 Live Brief group presentations prepared by a total of 118 Year 1 prospective primary school teachers, specifically focusing on the language-related challenges faced by a local school in early years mathematics. The data encompassed prospective teachers’ proposed practices, including one-to-one, small group and whole class activities, that aimed to address language diversity. Data analysis was informed by Moschkovich’s three perspectives on the relation between language and teaching and learning mathematics, namely lexicon, register and situated-sociocultural perspectives. While a lexicon perspective was commonly evident in the activities, the manifestation of a situated socio-cultural perspective mainly in the one–to-one activities is noteworthy, given its social and discursive nature. Three themes encapsulated a range of practices suggested in the findings: explicit vocabulary teaching, different strategies of scaffolding and utilising multi-sensory approaches. While the lexicon and register perspectives were commonly evident, the situated socio-cultural perspective was much less commonly manifested in the practices. We offer implications to initial teacher education curriculum, future research and policies about teaching and learning mathematics.

Factors influencing assessment in higher education: Empirical evidence from physical education and fitness compulsory courses in Indonesia

The present study delves into the multifarious factors that underpin students' learning assessment in higher education. Through the utilisation of an exploratory sequential mixed methods design, the researchers scrutinise the evaluation of 5,564 students by 23 lecturers, taking into consideration 9 characteristics. To that end, ANOVA and T-test are employed to analyse the mandatory course, and three lecturers who embody distinct criteria are interviewed, and their responses are subjected to a thematic analysis. The results indicate that assessment results are significantly different based on lecturers' working experience (teaching experience [F= 20.1, p= 0.000] and age [F= 48.6, p= 0.000]), academic background (department [F= 33.8, p= 0.000] and skills [F= 30.17, p= 0.000]), and teaching load (credit unit (credit unit) [F= 48.7, p= 0.000], number of classes taught [F= 61.4, p= 0.000] and teaching partners [F= 79.3, p=0.000]). Meanwhile, there is no difference in assessment results based on lecturers' qualifications (certificates [t= -0.587, p= 0.557] and latest degree [F= 2.56, p= 0.074]). The qualitative data reveals that four crucial factors - idealism, mindset, grading standard, and perspective - account for the variance observed in compulsory courses. The study's results underscore the need for universities to devise pedagogical strategies based on lecturers' attributes, as these factors bear a direct impact on the attainment of the desired graduate profiles as reflected in students' academic performance in specific courses.

Examining the Professional Excellence Programme: Inducting University Teachers into the Higher Education System in South Africa

The obligation to increase the standard of instruction and learning falls on academic developers. A crucial part of academic staff development at institutions of higher learning is the induction of academics who are primarily subject matter specialists without the pedagogical abilities to teach effectively in the higher education environment. This qualitative essay investigated how the Professional Excellence Programme (PEP) might be utilised as an induction Short Learning Programme (SLP) for new academics. After finishing the brief SLP, the inductees were given a questionnaire to evaluate the modules (Teaching and Learning, Curriculum Development, and Assessment in Higher Education) and qualitative data was gathered. The study was framed by Wegner’s social learning theory. The research showed that the PEP programme can be an efficient programme to develop academics into university teachers. Since the SLP was accepted by all participants in the study, the study recommended that the Directorate of Teaching and Learning should develop the PEP programme into a credit-bearing postgraduate diploma in higher education at NQF Level 8, which is equivalent to an honours degree. Keywords: Professional excellence, Induction, University teacher, Transformative pedagogy, Academic developer