Student Evaluation Research Articles

Evaluating work placement supervisors’ ratings of Master’s in research psychology students at an open and distance e-learning institution in South Africa

This paper examines the dataset of work placement supervisors’ feedback from 2014 to 2017 on the skillset of Master in Research Psychology students during their first and second placement periods. A total of 47 placement feedback reports were analysed. The analysis included frequency counts and qualitative content analysis using Microsoft (MS) Excel software. The study reveals that placement supervisors place significant value on soft skills, notably a willingness to learn, and frequently rate students favourably on interpersonal skills. The results highlight the importance of viewing placement supervisors as co-educational partners. By evaluating supervisors' ratings of research psychology students on work placement holds significant value in improving educational programs, enhancing student outcomes, aligning with employer expectations, and contributing to the broader understanding of work-integrated learning in research psychology. For students, it entails identifying areas of strength and areas for improvement in their performance. For the university program, this feedback can inform teaching and learning approaches by providing insights into the specific skills, competencies, and knowledge that students need to develop during their program. It can also help tailor feedback and support by understanding supervisors' feedback, leading to more effective guidance and constructive feedback for students. For the placement organisations, the research can contribute to supervisor training and development, ensuring they have the necessary skills to guide and evaluate students, while also improving work placement design and coordination to align with program learning outcomes and provide meaningful experiences for students.

Recognition of Effective Co-Teaching Practices by Interdisciplinary Pre-Service Candidates

This study investigates the degree to which pre-service interdisciplinary groups of undergraduate education candidates recognize co-teaching skills and behaviors in practice. With the increasing emphasis on collaborative teaching models in contemporary educational settings, understanding how future educators perceive and identify effective co-teaching practices is crucial for enhancing educational preparation programs (EPPs). Using a mixed-methods approach, this study analyzed consensus ratings from an interdisciplinary assignment that asked candidates to work collaboratively while identifying best practices in co-teaching across example and non-example videos. Both quantitative and qualitative data were collected using student ratings and videos of group discussion for consensus scoring. Quantitative data were collected using consensus ratings for each indicator on the observation checklist. Qualitative data derived from video transcripts of the consensus rating sessions illuminated the process each group used and reasons each group provided for consensus ratings. The findings reveal varying degrees of recognition and understanding of co-teaching skills, highlighting both strengths and areas for improvement in the candidates’ ability to identify and apply these practices. This study provides valuable insights into the preparedness of pre-service educators for collaborative teaching environments and offers recommendations for integrating co-teaching competencies more effectively into EPPs.

Determining ideal practices for student course evaluations using a modified Delphi approach.

While approaches for utilizing student course evaluations (SCEs) have been discussed in the literature, there remain opportunities to identify ideal practices for SCEs. Thus, the objective of this project was to generate consensus on best practices in creating, administering, and using SCEs. A modified Delphi approach was utilized to generate a set of items based on the literature and prior work. Experts were identified from different roles, institution types, and geographic regions to participate in the panel. Consensus-building rounds were performed until no new ideas were introduced using an electronic survey platform. Data were analyzed descriptively each round. After the second round, 47 items met consensus. Key recommendations included enhanced training of students to provide feedback, transparency with students on how feedback is utilized, using SCEs as one element of data sources, and the importance of ensuring intentional approaches based on theoretical constructs used in the field of course evaluation. This Delphi study established consensus on approaches programs can use to optimize SCEs, according to experts from across the academy. Though some items are very specific, there are opportunities for individualization based on program priorities.

The Perceived Impact of Leadership Practices of Academic Leaders on Student Success in a Higher Education Institution in South Africa

The research reported on in this paper was motivated by the need to investigate student complaints in the higher education sector in South Africa regarding the poor quality of teaching and learning which has resulted in low student success rates in many institutions in the country. To mitigate poor student success rates, higher educational institutions in South Africa need to consider implementing effective leadership practices of academic leaders to support students in their academic journey. This study identified how academic leaders leadership practices are perceived by students in a higher education institution in South Africa, and to identify which leadership practices are more impactful in supporting student success. According to Hoadley, Christie and Ward (2009) and Hallinger (2011), leadership practices are indeed aligned to academic performance. Grajfoner (2024) suggests that effective academic leadership is a key contributor to attaining academic excellence. However, Bryman (2007: 14) asserts that “one of the key problems in Higher Education is that not enough is known about exactly what makes an effective leader and what, in turn, may make them ineffective”. The theoretical framework upon which the study is based was developed by Mukan, Hawryluk and Stolyarchuk (2015: 42), who suggest that “leadership is a derivative quality of people collaborating, co-operating and supporting each other. It is characterized by openness and is a dynamic, inclusive, collegial process that occurs in a particular context”. In this research, a quantitative study was conducted using a purposeful sample selected from the target population of students at a higher education institution in South Africa. The final sample included 78 undergraduate students from the selected institution. The analysis undertaken in the study revealed that perceived leadership practices of academic leaders do have an impact on student success and that student success is not based on any one element of leadership practice alone; instead there are various perceived dimensions of leadership practices that play a role in promoting student performance. The findings of the study highlighted three key leadership practices that impact on student success, namely engagement, support and communication.

Objective Structured Clinical Examination Perception Scale (OSCEPS) for Health Sciences Students: A Psychometric Evaluation Study.

Objective Structured Clinical Examinations (OSCE) is an objective assessment approach that enables the evaluation of students' practical skills by simulating real clinical scenarios. This scale is specifically designed to evaluate the attributes and characteristics of the OSCE from the perspective of health sciences students, thereby filling a crucial gap in the existing assessment methods. This research conducted a methodological design involving 220 students from the faculties of medicine and nursing between 2022 and 2023. Data were gathered using a "Descriptive Form" and "OSCEPS." Factor analyses were performed for research and validation to ascertain the scale's factorial structure. The factorial analysis was used to test the structural validity of the scale. A structure consisting of 19 items was developed. The Cronbach's alpha coefficient was 0.943. Fit indices resulting from the study were RMSEA = 0.084; GFI = 0.839; CFI = 0.902; IFI = 0.902; RFI = 0.824; NFI = 0.843; TLI = 0.889. This study proves that the OSCEPS is a highly reliable and valid scale with strong psychometric properties. It effectively assesses health sciences students' perceptions of OSCE, thereby enhancing the credibility and usefulness of this assessment tool.

Students’ ratings to evaluate effective teaching practices of secondary schools in Bangladesh

PurposeInternational studies have emphasised the importance of effective teaching for student learning. However, few studies have investigated teaching practices in Bangladesh. The purpose of the study set out to explore the mathematics teaching behaviour of secondary school level of Bangladesh.Design/methodology/approachA convenient sampling strategy was used to collect 502 grade nine students’ perceptions from 15 mathematics classes within Dhaka Metropolitan City (DMC). A valid and reliable student questionnaire was used where the students rated their mathematics teachers' teaching behaviours identified in the dynamic model of educational effectiveness (DMEE).FindingsThe findings from the quantitative analysis of the student evaluations revealed that the mathematics teachers demonstrated structuring, modelling, questioning, teacher–student interactions and teacher dealing with misbehaviours in their daily classroom teaching.Research limitations/implicationsA small sample of mathematics classes were chosen in the study; hence, the findings may not be totally representative nor generalisable to the population of secondary mathematics teachers within Dhaka, Bangladesh.Practical implicationsThe study conducted in Bangladesh contributes to the international dimension to educational effectiveness research. The findings from the study provide partial support for teaching factors and dimensions in DMEE (Creemers and Kyriakides, 2008), and emphasise the need for further studies, particularly in cross-cultural contexts.Originality/valueThis is the first study to evaluate teaching behaviours of secondary mathematics teachers through students’ perceptions in Bangladesh. It contributes important insights about teaching behaviours to inform the development of evidence-based policy and practice on quality teaching in the region.

Professionalism assessment of students in clinical education through Situational Judgment Test (SJT).

The study aims to assess the situational judgment capability of students in various professions, including medicine, surgical nursing, anesthesia nursing, and emergency medical technology, using a validated and adapted Situational Judgment Test (SJT). The cross-sectional study was conducted at Qom University of Medical Sciences in 2023-2024. The study consisted of two steps: (1) adaptation and validity assessment of the SJT in various health professions, and (2) evaluation of students' situational judgment capability using the adapted SJT. Participants included 207 students from surgical nursing, anesthesia nursing, medicine, and emergency medical technology departments, selected through stratified random sampling. The SJT included 10 constructed-response scenarios developed by Alkhuzaee and colleagues in 2022. The validation and adaptation process utilized consensus methods, and the SJT was modified to a selected response format based on a knowledge-based approach. Scores ranged from 0 to 30. Cohen's method and norm-referencing standard deviation were used to calculate a cut-off score. Data were analyzed using descriptive statistics (frequency, mean, standard deviation) and inferential statistics (independent t-test, ANOVA, and ANCOVA). The face and content validity of the adapted SJT with a selected-response format was confirmed by expert agreement. The reliability of the SJT was approved, with a Cronbach's Alpha of 0.81. The mean score of students' situational judgment in professionalism was 11.90 (SD 4.54). Students' professions significantly impacted their situational judgment scores (F (3.201) = 3.67, p = 0.01, Partial Eta Squared = 0.052). The adaption and validation of SJT with a selected response format were confirmed by experts who evaluated the situational judgment capabilities of students in different clinical professions. The reliability of the SJT was acceptable-Cohen's method as a standard-setting approach assisted in identifying students needing support and training. The moderate level of situational judgment capacity confirmed the development of the educational program for the improvement of non-cognitive and non-technical skills such as judgment and decision-making in the field of professionalism.

Hispanic peer effects on educational outcomes: evidence from Texas public universities

ABSTRACT I examine the effects of Hispanic peer composition on college students’ educational outcomes. Using a sample of freshmen cohorts from 1991 to 2002 at Texas public universities, I identify the Hispanic peer effects by exploiting the quasi-random variation in the share of Hispanic peers within majors and universities across cohorts. I find that an increase in the share of Hispanic peers decreases the early dropout rates of Hispanic students. The results also suggest that Hispanic peer effects reduce college dropout rates for non-STEM and male Hispanic students. This paper presents an academic channel through which the share of Hispanic peers positively affects student outcomes.

A case study on development of a spiral oral health curriculum for medical students.

Inadequate oral healthcare remains a critical public health issue in children and adults in the US affecting adverse social, psychological, economic, and health outcomes. Medical clinicians have a clear role in addressing oral health issues and improving outcomes. Oral health guidelines for health profession schools were developed by the Association of American Medical Colleges (AAMC) oral health core competencies, and the newer Center for Integration of Primary Care and Oral Health's (CIPCOH) Entrustable Professional Activities (EPAs). However, the majority of health professional school deans and residency directors in the US report they are not satisfied with the oral health knowledge and skills of their learners at graduation. To address this issue, faculty at the University of Massachusetts Chan Medical School (UMCMS) have worked for the past decade to develop and implement a true spiral curriculum building on lessons of knowledge, skills, and attitudes throughout the 4-year student experience. The current UMCMS curriculum involves most courses at the medical school, has community-based and interprofessional components, and is taught using multimedia. Most of the curriculum is mandatory with selective opportunities for those in specialty tracks or who are seeking more hands-on training. Our study evaluated the UMCMS curriculum using the AAMC and CIPCOH EPA guidelines. Findings show that all students receive training in 42 of 48 AAMC oral health competencies and seven of seven CIPCOH oral health EPAs with the opportunity to explore oral health further through elective courses. Assessments of students show they perform well and evaluation of the oral health curricula by students are positive. Although our oral health curriculum is robust, the next steps include expanding the evaluation of students to ensure they universally meet competencies. We expect that this case study can serve as a map for creating a generalizable, spiral curriculum for other medical schools.

Relationships between utilisation of human resources and academic performance in engineering at Technical and Vocational Institutions in Nakuru County, Kenya

The purpose of this article was to analyse the relationships between the utilisation of human resources and academic performance in engineering at technical and vocational institutions in Nakuru County, Kenya. The problem that the study addressed was the high failure rate of students in engineering. The study used a descriptive survey design utilising closed-ended questionnaires and interview schedules. The sample consisted of 331 students, 11 technicians, and 22 Administrators (11 Heads of Departments, 7 Deputy Principals, and 4 Principals). A proportionate sampling technique was used to obtain student samples per institution. Participants were selected through simple random sampling. The hypothesis was tested and established that there was a positive and statistically significant relationship between utilisation of human resources and academic performance in engineering (p=0.000<p=0.05), concluding that ineffective utilisation of human resources in the TVET institutions contributes to the observed low performance in engineering programs. The study recommended that institutions improve the coordination of practical sessions, enhance student-centred learning approaches, and invest in upgrading physical resources.

Extending access for all chemistry students with extended reality

Equal access to instructor’s time and attention in chemistry classes and laboratories can be a barrier experienced by students from historically excluded groups. An instructor’s own biases will determine the nature of their interaction with students, and even well-meaning instructors can interact with students in slightly different ways, which might prevent certain students from having access to all the available instructional resources for the class. This is an additive problem, which may or may not be recognized in peer and student evaluations, and an issue that might escape self-reflection even in educators that are committed to diversity, inclusion, and justice. This issue conflates both actual and perceived biases, introducing a complex dynamic between instructor and student. Extended reality (XR) provides an avenue to generate materials that can be used to enhance or replace classroom instruction with a great degree of realism. In this paper we will discuss the implementation of a set of virtual reality (VR) organic chemistry labs. We will show that XR learning tools are by their very nature accessible and inclusive of a wide variety of students and will provide evidence from student reflections that shows that students from historically excluded groups find the XR content offered in our virtual reality labs more personal than in-person activities covering the same material.

Facilitating Students' Cognitive Engagement in Online Asynchronous Discussion Within a Remote English Foreign Language Learning Environment

This study examined the cognitive presence of students in an asynchronous online discussion in the Second Language Acquisition (SLA) course. The course combined synchronous meetings through Zoom sessions to support student participation in asynchronous discussions. The study involved a cohort of 36 participants from the two remote extended campuses of Pattimura University in Maluku. Through content analysis, two key aspects were examined: (1) student participation rates, and (2) the extent of students’ cognitive presence within the discussions. The content analysis findings revealed that although each student made a minimum of two contributions per topic during online asynchronous discussions, they exhibited a moderately high level of cognition, incorporating problem recognition, exploration, integration, and solution, not only in individual messages but also in the overall exchange of information within the discussion thread. These findings suggest that a combination of synchronous meetings through Zoom sessions, tailored prompts, feedback, and social interactions enhances students' active engagement and utilization of cognitive skills in online asynchronous discussions. Keywords: online asynchronous discussion, English foreign language learning, cognitive presence

Performance evaluation of students’ hostel of the college of Agriculture and Environmental Science Kaduna State University, Nigeria

Performance evaluation of students’ hostel of the college of Agriculture and Environmental Science Kaduna State University, Nigeria

Themed Restaurant Examination to Improve Student’s Knowledge and Skills in Food and Beverage Management Class

The paper emphasizes the importance of practical knowledge and hands-on experiences in hospitality education, particularly in food and beverage management. Themed events provide a platform for students to apply their theoretical knowledge, develop practical skills, and face real-world challenges. The event, centered around the culinary heritage of Tuscany, showcased student creativity and attention to detail. The event was successful overall, with positive guest feedback and student committee evaluations. However, areas for improvement were identified, including coordination issues, delays, and food quality inconsistencies. These findings highlight the need for better planning, coordination, and attention to detail in future events. In conclusion, the event provided valuable experiential learning for hospitality management students, allowing them to apply knowledge, develop skills, and navigate challenges. While the event showcased student capabilities, areas for improvement were identified, emphasizing the importance of continuous enhancement in execution and attention to detail. This research contributes to understanding the effectiveness of themed events and experiential learning in hospitality education, informing future improvements in preparing students for internships and careers in the industry.

Predicting Student Dropout Rates in Higher Education: A Comparative Study of Machine Learning Algorithms

Recent years have seen a significant increase in study interest in the areas of predicting student performance, avoiding failure, and identifying the variables affecting student dropout. One important indicator in online and open distance learning courses is the student dropout rate. We purpose the naive bayes classification method to construct the student dropout prediction using naive bayes. This work examines the critical topic of forecasting student dropout rates in higher education using machine learning approaches, with a particular emphasis on the random forest algorithm and the naive bayes algorithm. The study's goal is to properly anticipate dropout rates using data mining methods and machine learning algorithms after conducting a thorough evaluation of existing literature and approaches. The systematic method consists of data collection from a Kaggle dataset, data preparation to solve class imbalance via SMOTE oversampling, and algorithm selection. Random forest and naive Bayes approaches outperform other machine learning algorithms in terms of accuracy, sensitivity, specificity, and precision. The study underscores the importance of considering diverse factors such as demographic data, socioeconomic factors, and academic performance in dropout prediction models. The implications of this research extend beyond academia, with the potential to inform proactive interventions and support systems, ultimately leading to improved student outcomes and institutional effectiveness. According to this paper, the paper outputs that for the binary classification on the data set used in this project has best performed with Naive Bayes and Random Forest Algorithm with SMOTE oversampling. Keywords- SMOTE oversampling, machine learning, Random forest, naive bayes.

Making sense of generative AI for assessments: Contrasting student claims and assessor evaluations

The rapid growth of generative AI usage in higher education has left educators looking urgently for insights into student usage and guidance on good practice. This case study examines an experiential exercise involving 118 postgraduate management students at a UK business school, where students were asked to write a 500-word reflection on their use of AI for a 2500-word essay-style assessment. Using sensemaking as a theoretical lens, we compare students' claims with assessors' evaluations of students' AI usage. Our findings indicate that students predominantly use generative AI for writing, paraphrasing, and rephrasing, rather than for fostering critical thinking or engaging in the more advanced stages of sensemaking, a level achieved by only one-tenth of the cohort. The consistency between this study's findings and pre-generative AI research suggests that higher education has yet to adapt adequately in ways to integrate AI to mitigate, rather than exacerbate, current sector deficiencies. We call on university leaders to develop institutional strategies that allow for effective and responsible integration of generative AI, and on educators to develop students' critical evaluation and academic writing skills that build on generative AI's affordances, with several specific recommendations made in this article.

Impact of pandemic-driven online education on student evaluation scores: A comparative study in natural sciences

ABSTRACT The COVID-19 pandemic necessitated the adoption of online systems by educational institutions for infection control. The widespread implementation of online systems presented an opportunity to assess the impact of online education. However, research into the perceptions of students who directly experienced these changes remained relatively underexplored. This study conducted a comparative analysis of student evaluation of teaching scores (SET) before and after the pandemic to examine the impact of accelerated online system adoption on student satisfaction. This study employed a quantitative research design, utilising Ordinary Least Squares regression for the analysis. The analysis utilised SET data from 49,201 students enrolled in the College of Natural Sciences of a top-ranking university in South Korea from 2018 to 2020. The results showed that theory courses that emphasised information delivery demonstrated minimal changes in evaluation scores. By contrast, laboratory courses requiring direct student engagement and controlled environments demonstrated decreased scores. Notably, mathematics, with a conducive online learning environment for laboratory courses, exhibited improved post-pandemic evaluations. Furthermore, the student evaluation of teaching scores decreased in chemistry classes that require restricted laboratory settings. These findings highlight the importance of considering instructional characteristics when integrating modern technologies into educational systems to effectively replace traditional lectures.

Assessing the students’ evaluations of educational quality (SEEQ) questionnaire in Oman higher education

Background One of the most popular tools that is used to evaluate education quality is the Student Evaluation of Education Quality (SEEQ). This local data study examined the SEEQ’s psychometric properties in Omani education, specifically its validity and reliability. Methods This was quantitative research to assess educational quality from the students’ viewpoint. The study was conducted at Muscat College from January to March 2024.Simple randomization implemented at the course level helped to choose the participants. All students registered in the specified courses were asked to take part after a random sample of the courses Muscat College offers throughout the study term was chosen. Five hundred fifty students completed the survey. AMOS was used to conduct confirmatory factor analysis (CFA), and PSS was used to evaluate the internal consistency (IBM Corp., 2024a, 2024b). Results CFA of the SEEQ indicated that the eight -factor solution best fit the data. Results also showed that the SEEQ has overall good-to-excellent reliability. The adapted scale was psychometrically sound, proving SEEQ’s applicability Conclusions This study proposes using SEEQ to measure Oman’s education quality.

Application of the online teaching model based on BOPPPS virtual simulation platform in preventive medicine undergraduate experiment.

As online teaching gains prevalence in higher education, traditional face-to-face methods are encountering limitations in meeting the demands of medical ethics, the availability of experimental resources, and essential experimental conditions. Consequently, under the guidance of the BOPPPS (bridge-in, objective, preassessment, participatory learning, postassessment, summary) teaching model, the application of virtual simulation platform has become a new trend. The purpose of this study is to explore the effect of BOPPPS combined with virtual simulation experimental teaching on students' scores and the evaluation of students' participation, performance and teachers' self-efficacy in preventive medicine experiment. Students from Class 1 and Class 2 of 2019 preventive medicine major in Binzhou Medical University were selected as the research objects. The experimental group (class 2) (n = 51) received the teaching mode combined with BOPPPS and virtual simulation platform, while the control group (class 1) (n = 49) received the traditional experimental teaching method. After class, the experimental report scores, virtual simulation scores, students' engagement scale (SES), Biggs questionnaires, and teachers' sense of self-efficacy (TSES) questionnaires were analyzed. The experimental report results demonstrated a significant increase in the total score of the experimental group and the scores of each of the four individual experiments compared to the control group (P < 0.05). To investigate the impact of the new teaching model on students' learning attitudes and patterns, as well as to evaluate teachers' self-efficacy, a questionnaire survey was administered following the course. The SES results showed that students in the experimental group had high performance scores on the two dimensions of learning methods and learning emotions (t = 2.476, t = 2.177; P = 0.015, P = 0.032). Furthermore, in the Biggs questionnaire, the total deep learning score of the experimental group was higher than that of the control group (t = 2.553, P = 0.012), and the deep learning motivation score of the experimental group was higher than that of the control group (t = 2.598, P = 0.011). The TSES questionnaire shows that most teachers think it is easier to manage students and the classroom and easier to implement teaching strategies under this mode. The combination of BOPPPS and the virtual simulation platform effectively enhances the experimental environment for students, thereby improving their academic performance, engagement and learning approach in preventive medicine laboratory courses.

An evaluation and comparative analysis of higher education health and sustainability: India’s performance and global

This study evaluates the health and sustainability of higher education systems in nine countries: the USA, UK, Australia, Germany, Canada, China, Brazil, India, and South Africa. Using a multi-level analysis model and principal component analysis (PCA), nine key factors—such as international student numbers, academic levels, and graduate employment rates—were identified, capturing over 90% of the cumulative impact on higher education systems. India, scoring 6.2036 initially, shows significant room for improvement. The study proposes policies to increase graduate employment, promote international faculty collaboration, and enhance India’s educational expenditure, which surpasses 9.8% of GDP. Post-policy simulations suggest India’s score could rise to 8.7432. The paper also addresses the impact of COVID-19 on global education, recommending a hybrid model and increased graduate enrollment in China to reduce unemployment by 5.4%. The research aims to guide sustainable development in higher education globally.