Assessment In Higher Education Research Articles

Linguistic characteristics of online academic forum posts across subregisters, L1 backgrounds, and grades

This study examines an under-explored interactive register of discipline-specific online academic forum posts in higher education. 881 academic forum posts written by postgraduate students were analysed, using an additive multi-dimensional (MD) analysis. Four dimensions of linguistic variation were compared across the two first language backgrounds (L1 Chinese and L1 English), three subregisters (application design, business scenario, and discussion), and grades. The results indicated that the forum posts written by two L1 backgrounds, three subregisters, and grades significantly differed in terms of dimensions of linguistic variation. The findings have important implications for writing instruction and assessment in higher education. One of the significant implications of the present study is that both first and second language writers need to have mastery of informational and elaborated discourse features (nouns, phrasal coordination) to write successful academic forum posts at graduate level. Writing instructors may provide successful model texts for relatively new registers so that L2 writers can meet the multiple demands of online academic forum posts, including interacting with peers and supporting their ideas with academic literature.

Assessment in Higher Education during the COVID-19 Pandemic: A Systematic Review

In the face of the COVID-19 pandemic, millions of students have been affected by the closure of educational institutions. This has forced a shift from face-to-face to distance education, facing numerous emergency educational measures, such as online assessment. This study aims to present a systematic review of the literature on the impact of assessment in higher education during the pandemic. The study has followed the methodology set out in the PRISMA statement, and includes 13 studies selected from a total of 51. The results indicate that faculty and students have faced numerous challenges in moving to virtual environments; on the faculty side the lack of training in online assessment techniques is the main problem, on the students’ side there is dishonesty and misconduct. However, it is concluded that continuous assessment, not focused on exams, but in a more qualitative way is the best way to assess at a distance.

Moodle Quizzes as a Continuous Assessment in Higher Education: An Exploratory Approach in Physical Chemistry

The use of Moodle quizzes as a continuous assessment and an integral part of the educational methodology in higher education has been analyzed in a case study of physical chemistry subject. Two types of quiz designed with different item types and different settings, called basic quiz (BQ) and thematic block quiz (TBQ), were elaborated making use of a question bank with more than 450 items. BQ has true/false items, while TBQ has randomly mixed items (multiple choice, numerical and matching). The effect of the type of quiz on the student scores is analyzed according to statistical and psychometric data such as the degree of participation, the facility index and the discrimination index of each item, and the average score, calculated according to the classical test theory. This allows us to discern which type of quiz has an enough quality to use it as an assessment tool. Moreover, the effect of this educational activity, developed during the last six academic years from 2014 to 2020, just before of the pandemic situation, is evaluated considering the scores of the students in the Ordinary Calls of exams and comparing them with previous courses taught with a traditional education based on master classes. The statistic results indicate that TBQs are more discriminative than BQs and could be used as an assessment tool, while BQs could be only useful as formative activity. Moodle quizzes turn out to be a reliable strategy for learning of contents in scientific matter, with a high participation in the knowledge tests, with good marks in the average score and a greater number of pass degrees in the Ordinary Calls.

The Imperfect Practice of Assessment in Higher Education

The Imperfect Practice of Assessment in Higher Education

Formative assessment and feedback for learning in higher education: A systematic review

AbstractFeedback is an integral part of education and there is a substantial body of trials exploring and confirming its effect on learning. This evidence base comes mostly from studies of compulsory school age children; there is very little evidence to support effective feedback practice at higher education, beyond the frameworks and strategies advocated by those claiming expertise in the area. This systematic review aims to address this gap. We review causal evidence from trials of feedback and formative assessment in higher education. Although the evidence base is currently limited, our results suggest that low stakes‐quizzing is a particularly powerful approach and that there are benefits for forms of peer and tutor feedback, although these depend on implementation factors. There was mixed evidence for praise, grading and technology‐based feedback. We organise our findings into several evidence‐grounded categories and discuss the next steps for the field and evidence‐informed feedback practice in universities. Context and implicationsRationale for this studyTo gain a better understanding of effective formative assessment and feedback approaches in higher education (HE). To promote a more evidence‐informed approach to teaching and learning in universities.Why the new findings matterThe findings highlight a small number of promising strategies for formative assessment and feedback in HE. They also draw attention to a lack of (quality) evidence in this area overall.Implications for policy‐makers and practitionersUniversities and their regulators/funders should be encouraging and supporting more, high‐quality research in this important area. Researchers in the field also need to look to developing more ambitious, higher‐quality studies which are likely to provide robust, causal conclusions about academic effectiveness (or other outcomes). Those involved in teaching and learning in university should use the findings to inform evidence‐informed approaches to formative assessment and feedback and to challenge approaches which do not appear to have foundations in strong evidence. Students could be made more aware of teaching and learning approaches that are likely to support their academic progress.

Analysing EMI assessment in higher education

This research article reveals current English as a Medium of Instruction (EMI) lecturers’ assessment practices in a medium-sized (i.e., 12,000 students) private university in Madrid, Spain. The investigation aims to analyse how EMI assessment is conducted; what are the most popular assessment tools that EMI lecturers use; and the role that English as a foreign language plays in EMI teaching. Moreover, this is a mixed-methods research investigation in which data were obtained throughout two tools: One questionnaire (Otto, 218) and two focus groups. All in all, the study clearly verifies that EMI lecturers are not trained enough in terms of EMI teaching in general, and assessment in particular. There are no significant differences between EMI and non-EMI assessment tools, apart from the fact that summative assessment mainly prevails over formative assessment. Final recommendations are provided regarding accurate EMI assessment practices after empirical evidence was gathered.

Digital Competence Assessment Methods in Higher Education: A Systematic Literature Review

The rapid increase in recent years in the number of different digital competency frameworks, models, and strategies has prompted an increasing popularity for making the argument in favor of the need to evaluate and assess digital competence. To support the process of digital competence assessment, it is consequently necessary to understand the different approaches and methods. This paper carries out a systematic literature review and includes an analysis of the existing proposals and conceptions of digital competence assessment processes and methods in higher education, with the aim of better understanding the field of research. The review follows three objectives: (i) describe the characteristics of digital competence assessment processes and methods in higher education; (ii) provide an overview of current trends; and, finally, (iii) identify challenges and issues in digital competence assessment in higher education with a focus on the reliability and validity of the proposed methods. On the basis of the findings, and as a result of the COVID-19 pandemic, digital competence assessment in higher education requires more attention, with a specific focus on instrument validity and reliability. Furthermore, it will be of great importance to further investigate the use of assessment tools to support systematic digital competence assessment processes. The analysis includes possible opportunities and ideas for future lines of work in digital competence evaluation in higher education.

Online assessment in higher education during Spanish confinement by COVID-19: The view of students

The purpose of this study is to describe how university students rate the evaluation systems and strategies that have been proposed for use in Higher Education during the period of COVID-19 confinement and online teaching as a result of the coronavirus crisis in Spain. For this purpose, we prepared a descriptive study by means of an online questionnaire, specifically designed on the basis of evaluation and qualification proposals made by REACU (Spain), ANECA (Spain), UNESCO, and the Spanish Ministry of Universities. The results obtained, after applying them to a sample of 1008 students from different universities in Spain, and covering most of the Autonomous Communities (17), indicate that students agree with and value the changes recommended by agencies and agree that the assessment should be flexible, diverse, formative and continuous. On the other hand, their experiences indicate that the Universities have not yet applied some of the suggested recommendations.

NATIONAL EDUCATION POLICY- 2020: RETHINKING ASSESSMENT IN HIGHER EDUCATION

The Government of India published, after independence, nation’s third policy on education on July 30, 2020. This policy on education titled as “National Education Policy- 2020” (NEP-2020). This much anticipated education policy is a widespread policy covering all level and aspects of education of the country. Part ‘Two’ of NEP- 2020 covered the area of higher education and detailed about the expectations in this area. For an economically developing country like India, where the demand for a quality skilled workforce is very high it becomes necessary to keep a check on the quality of education provided in the higher education system. Assessment plays a crucial role in improving the quality of education by giving feedback. Normally assessment is done as objectives of education are formulated. Any teaching-learning process is incomplete without a proper assessment mechanism. National Education Policy- 2020 is expecting and suggesting fundamental change in the traditional assessment system in higher education. This paper is an attempt to explore the important recommendations made by National Education Policy- 2020 on ‘Assessment’ in the area of higher education.

Student achievement emotions: Examining the role of frequent online assessment

The rapid inclusion of online assessment in higher education has left a void in investigating the relationship this form of assessment has with student emotions. This study examines the influence of frequent online assessment on student emotions in a university setting using a mixed-methods approach. Students' emotions in an online quiz and a traditional classroom test in a second-year mathematics course (n = 91) were analysed using both quantitative and qualitative approaches, through the lens of the control-value theory. The study used an adaptation of the Achievement Emotions Questionnaire (AEQ) to collect data on reported student emotions in both assessments, as well as qualitative data on student’s views of the frequent online assessment. Students reported higher levels of positive emotions and lower levels of negative emotions in an online quiz compared to the test, and we attempted to identify sources of these differences. The findings are discussed together with implications for habitualisation of assessment emotions. Practically grounded generalisations are outlined as opportunities for disrupting negative emotions and reaffirming positive emotions, which are suitable for implementation in higher education on a broad scale.
 Implications for practice or policy:
 
 For educators designing tertiary assessment aimed at promoting positive and reducing negative emotions, we advise incorporating features that students perceive as allowing them greater control over obtaining success.
 Specifically, we advise incorporating frequent low stakes online quizzes into tertiary courses.
 These present opportunities for students to habitualise positive assessment-related emotions, which correlate with performance and constructs such as self-efficacy.
 The Achievement Emotions Questionnaires (AEQ) can be adapted to investigate achievement emotions in different forms of assessment.

Dialogic assessment in the context of professional recognition: perspectives from the canoe

This paper seeks to spark a conversation as it concerns dialogue as an assessment tool and the processes which may be needed to support it. While its context is specific, focused on the use of dialogic assessment in HEA Fellowship schemes, it is suggested that the metaphor which emerged from a collective autoethnographic study has the potential to be of value more widely. Data from this study indicated that dialogic assessment might be likened to a canoe trip which requires careful planning and skillful execution. The five phases identified - designing the vessel, getting aboard, settling in/ settling down, navigating the space and forward-wash – are overviewed with the intention of provoking discussion in the academic practice community, drawing into the conversation individuals who are concerned with assessment for learning generally, and those who have particular interest in the potential of dialogic assessment which culminates in a summative judgement. As such it adds to the literature focused on assessment in higher education by drawing to the fore the conditions in which dialogic approaches can thrive for the individual being assessed, while also facilitating reciprocal learning.

Remote Assessment in Higher Education during COVID-19 Pandemic

Universities have made a compulsory shift to distance education due to the Covid-19 pandemic. All of the higher education instutitions in Turkey have completed 2019-2020 Spring semester using online tools. However, most of these institutions were not fully-prepared to have all of their courses online. Technical inadequencies, lack of qualified online tools, inexperience of instructors and students in distance education have emerged as major issues that instutitions have to face. In addition to all, a new question arised; which approaches will be used for assessment. This study aimed to seek the common assessment approaches used through pandemic, how students perceived the quality of the assessment and the pros and cons of using these practices. Additionally, we examined whether participants’ perceptions about quality of the assessment differ according to interaction with faculty members and use of online tests. Researchers employed survey design to reply four research questions and used a three-part instrument to collect qualitative and quantitative data. 486 students from 61 universities voluntarily participated in the study. Results indicated assignments are the mostly used tools and students are generally satisfied about the quality of the assessment practices. Another result is that students who interact with faculty members are more satisfied with the quality of the assessment practices. This emphasizes the importance of formative assessment and feedback in remote assessment. Further, students who took online tests are more satisfied with the quality of assessment. Suggestions were made for future research.

Online Formative Assessment in Higher STEM Education; A Systematic Literature Review

Online formative assessment in higher education Science Technology Engineering and Mathematics (STEM) is gaining attention in recent years based on the increasing use of online learning. This study, aimed at critically reviewing studies on online formative assessment in Higher education STEM between 2011 to 2020. The study adopted a qualitative research design to analyze studies based on specific themes. 1402 articles were systematically searched through Scopus, web of science, and google scholar databases. However, only 12 studies were included in this study after satisfying the inclusion criteria. All data analyses were done using the Endnote X9 reference manager. The findings reveal that, evidence about online tools used, theories used in the learning and assessment process, the domain of learning outcome assessed, assessment of practical skills, and form of assessment used have been implicitly described. However, the online formative assessments have shown great potential of yielding immediate feedback. Therefore, future studies can engage in a more extensive study on areas such as online assessment tools for assessing practical skills and strategies that can enhance the effectiveness of online formative assessment which encompasses all domains of learning outcome within STEM higher education.

Revisioning the potential of Freire’s principles of assessment: Influences on the art of assessment in open and online learning through blogging

ABSTRACT When the art of assessment in online and distributed learning is grounded in Freirean writings, instructors have the opportunity to craft a nuanced and layered learning environment where the potential for critical consciousness is enhanced through carefully codesigned assessment strategies. Patton (2017) summarized 10 pedagogical principles based on the writings of Freire, which he determined relevant as a result of their connection to critical pedagogy of evaluation. We explore a revisioning of those principles: using evaluative thinking to cultivate critical consciousness; learning resides in communities, not just individuals; critical pedagogy must be dialogical and interactive; assessment should integrate reflection, action, thinking, and emotion; and critical consciousness is co-intentional, focusing on process and product. We use them as a framework to describe what we call Freirean principles of assessment, through the application of student blogs within online and distributed assessment practices. Our intention is to share the potential of blogging, in connection with Freirean principles of assessment, when considering open assessment in higher education.

Assessment in higher education: voices of programme directors

This study examines the views of assessment of programme directors at a Portuguese public university (n = 60). Data were collected through a questionnaire which included closed and open-ended questions. The participants hold different professional categories and come from medical and health sciences, exact sciences, engineering and technology, social sciences and humanities. Data suggest the use of a variety of assessment methods, through a mix of learner-centred and traditional methods. The year of study, the type of course, the nature of the programmes and the institutional regulations were identified by the programme directors as factors that may influence the selection of the assessment methods. The participants considered assessment practices to be in general adequate, but there is room for improvement, namely through an integrated and interdisciplinary approach.

Informal academic networks and the value of significant social interactions in supporting quality assessment practices

ABSTRACT This research investigated social interactions within small significant networks across a range of higher education settings to determine their role in supporting improvements to assessment. Thirty-four academic staff from three higher education settings (Australia, Canada and Sweden) provided assessment change examples and drew network diagrams to explain their interactions. Significant social interactions were defined as engaged exchanges between people who trust and respect each other, around topics that hold common value. They led to an emotional response, promoted reflection and resulted in action and/or a shift in thinking. Significant social interactions were demonstrated to be effective in supporting changes in assessment practices. The qualitative findings were supplemented with quantitative investigation of the relational ties within the networks. The most significant relational ties related to changes in the assessment were the value of the interactions (d = .64) and the similarity between individuals (d = .50). Authors recommend that leaders in higher education heed lessons learned about how value was generated within networks and utilized for improvement activities. It is suggested that the following positive change-oriented behaviours be developed and actively encouraged: Building of diverse networks; appreciating reciprocity; forging trust; creation of time and space for significant social interactions; and external recognition of the shift toward quality assessment practices. This study builds on existing literature for improving teaching and assessment in higher education, and particularly highlights the benefits of informal academic networks and the potential for significant interactions as a mechanism for change toward a quality agenda.

A mixed method exploration of student perceptions of assessment in nursing and biomedicine

ABSTRACT Assessment in higher education requires a high level of accountability and responsibility and is a major influence on student learning but can be a source of stress for staff and students. This project aimed to evaluate first-year students’ conceptions of assessment in biomedical science and nursing to determine positive or negative trends and how these can be facilitated or mitigated. This mixed-methods study compared the conceptions of assessment between students in nursing and biomedical science students at one university, using the Conceptions of Assessment questionnaire. The results revealed that overall students in the two different areas of study had similar perceptions of assessment. Students were found to have positive conceptions of assessment which were identified as relating to their secondary education. Thematic analysis of students’ responses identified eight themes associated with their perception of what assessment is, and the associated limitations of assessment and the multi-faceted personal factors that affected students’ position towards assessment. This study recommends a shift in focus from assessment relating to accountability, towards assessment for learning to maintain students’ initial perceptions of assessment to ensure their experience aligns with their expectations. Transparent communication about assessment requirements and support for students to undertake assessment may mitigate students’ negative perceptions held towards assessment.

Technology-enhanced formative assessment in higher education: A voice from Indonesian EFL teachers

The integration of information communication and technology in language teaching has been intensely examined in literature works. However, the study which explicitly investigates the advancement of technology for language assessment in higher education level is still underexplored, particularly in a formative assessment area. To fill that gap, the present study aims at investigating the perceptions of EFL teachers towards technology-enhanced formative assessment and how they implement it in the classroom. This study employs a qualitative case study approach. Of three participants from different universities were voluntarily participated in a semi-structured interview. The interview seeks to investigate the perceptions of teachers towards technology-enhanced assessment, the roles of technology in formative assessment, and the impact of technology on language learning. The findings reveal that EFL teachers view formative assessment as well as technology in a positive perception. They admit that technology is a practical tool that has multiple roles and it is deemed as useful and meaningful platform for assessing students. Finally, technology-enhanced formative assessment gives an impact on students� performance, particularly on language accuracy. The further implications are discussed in this paper.�

Psychometric properties of the short-form CART: Investigating its dimensionality through a Mokken Scale analysis

Rationality is considered an important trait for functioning in modern society, as it is thought to be necessary for making judgments and decisions. Rationality aligns well with ambitions in higher education for teaching students to be critical thinkers and decision makers. The short-form Comprehensive Assessment of Rational Thinking (CART) might therefore be suitable for measuring this ability in higher education. Subtest total scores are used and interpreted as distinguishable units of measurement, representing single subconstructs within the concept of rationality. In this study, we explored whether the subtests can indeed be interpreted as unidimensional scales. We assessed the subtests’ dimensionality by performing a Mokken scale analysis using the performance data of 185 students of higher education on a Dutch translation of the short-form CART. For two subtests, all items formed a single ordinal scale. For three subtests, a subset of items formed a scale. For seven subtests, no items, nor any subset of items, formed a unidimensional scale. In its current form, then, not all short-form CART subtest scores could be meaningfully interpreted as measures of constituent parts of rationality, limiting its use for assessment in higher education.

Formative peer assessment in higher healthcare education programmes: a scoping review

ObjectivesFormative peer assessment focuses on learning and development of the student learning process. This implies that students are taking responsibility for assessing the work of their peers by giving and...