Tutor Evaluation Research Articles

Comparing expert tutor evaluation of reflective essays with marking by generative artificial intelligence (AI) tool

Comparing expert tutor evaluation of reflective essays with marking by generative artificial intelligence (AI) tool

Perceptions and attitudes of medical students towards student evaluation of teaching: A cross-sectional study

ABSTRACT Background Faculty evaluation surveys in the frame of student evaluation of teaching (SETs) are a widely utilized tool to assess faculty teaching. Although SETs are used regularly to evaluate teaching effectiveness, their sole use for making administrative decisions and as an indicator of teaching quality has been controversial. Methods A survey containing 22 items assessing demographics, perceptions, and factors for evaluating faculty was distributed to medical students at our institute. Statistical analyses were conducted using Microsoft Excel and R Software utilizing regression analysis and ANOVA tests. Results The survey received 374 responses, consisting of 191 (51.1%) male students and 183 (48.9%) female students. In all, 178 (47.5%) students considered the optimal time for providing faculty evaluation to be after the release of the exam results, compared to 127 (33.9%) students, who chose the after the exam but before the release of exam results option. When asked what happens whenever the tutor is aware of the SETs data, 273 (72.9%) and 254 (67.9%) students believed that it would influence the difficulty of the exam and the grading/curving of the exam results, respectively. Better teaching skills (93%, 348), being responsive and open to student feedback and suggestions (84.7%, 317), being committed to class time and schedule (80.1%, 300), and an easier exam (68.6%, 257) were considered important factors to acquire a positive evaluation by a considerable proportion of students. Fewer lectures (p < 0.05), decreased number of slides per lecture (p < 0.01), easier exam (p < 0.05), and giving clues to students about the exam (p < 0.05) were found to be very important to obtain a positive tutor evaluation by students. Conclusions Institutions ought to continue exploring areas for improvement in the faculty evaluation process while raising awareness among students about the importance and administrative implications of their feedback.

Online Tutorial And Webinar Tutorial Management On Distence Learning Process At Indonesia Open University

The Open University provides study assistance services to students in the form of a Tutorial program. The implementation of the Tutorial managed by the Tutor as a facilitator has not run optimally. This situation becomes the background of the research problem. The purpose of this research is to analyze the management of Tuton and Tuweb tutors. The theory used is in the form of management functions initiated by Terry. This research is a descriptive study with a qualitative approach that reveals the situation by describing the reality correctly and naturally in the distance learning procession. Data was collected through observation, interviews, documentation, and triangulation. The data obtained were then reduced, presented, and concluded. The results of the research generally reveal that management functions have been carried out but their implementation has not been fully implemented. Specific conclusions show (1) Planning: carrying out tutorial preparation meetings and tutor evaluations. (2) Organizing: determine the standardization of Tutors, standardization of recruitment, employment contracts, letters of assignment, and decrees for Tutors Tutons, and letters of assignments for Tutors Tuwebs. (3) Mobilization: organizing Tutor training and refreshment, Whatsapp Group communication, providing reminders and motivation, (4). Controlling: Tuton tutors do not have a routine control schedule yet. Tuweb tutors have a regular control schedule. (5) There are obstacles and solutions as well as future improvements. From these general and specific conclusions, the researcher recommends the Tutor management model to maximize the Tutor management which will have implications for improving the Tutor's performance in managing the Tutorial class.

A Feasibility Study for Utilizing a Peer-teaching Experiential Learning Activity to Alter Student Perceptions of Attributes Present in Effective Clinical Instructors

Purpose: Many physical therapists are requested to assume the role of a clinical instructor (CI) after only one year of clinical practice. The purposes of this study are to assess the feasibility of an activity that introduces students to the responsibilities of a CI and to determine if this activity had any impact on student perceptions of attributes that are present in an effective CI. Methods: Second year DPT students enrolled in a course that utilizes case-based learning and peer-teaching activities participated in this study. Participants completed the McGill University Clinical Tutor Evaluation survey both pre- and post-learning activity. Survey results were analyzed for mean composite scores, changes in survey items ranking, and statistically significant differences in survey item responses both pre- and post- activity. Results: Mean composite scores for the McGill survey as well as mean ranks for each of the 25 survey items were identified both pre and post activity. Statistically significant differences were found by comparing student responses from surveys taken pre- and post-activity. Conclusion: The results of this study suggest that a peer-teaching experiential learning activity was feasible for influencing student perceptions of important attributes of an effective CI. These findings indicate that incorporation of similar activities into DPT entry-level curricula may aid in educating students about the responsibilities of a CI.

Teaching Culturally Safe Care in Simulated Cultural Communication Scenarios During the COVID-19 Pandemic: Virtual Visits with Indigenous Animators.

Clinical learning activities involving Indigenous patient actors that specifically address the development of culturally safe care skills among medical students are important in order to improve health care for Indigenous people. In 2020, the COVID-19 pandemic led to strict physical distancing regulations and regional lockdowns that made the in-person delivery of Simulated Cultural Communication Scenarios (SCCS) with Indigenous patient actors impossible due to the disproportionate risk that public health emergencies pose for Indigenous communities. As the pandemic continued in 2021, we co-created a Virtual Visit approach to SCCS for the education of culturally safe care to pre-clerkship medical students. We report on student and tutor evaluation of these virtual sessions and contextualize our findings with our previous results delivering In-Person SCCSs. We found that Virtual Visit SCCS were highly effective in providing authentic exposure to and feedback from Indigenous patients. However, students rated their learning outcomes with Virtual Visit lower than the In-person approach to SCCS. We recommend formal training on interacting with patients in virtual care scenarios prior to Virtual Visit SCCS. We also found that exposure to SCCS with Indigenous animators has the potential to conjure up a diverse spectrum of sometimes unresolved negative feelings related to colonialism among students and tutors including discomfort, embarrassment, and anxiety. Our findings underscore the importance of resolving these sentiments within the safe environment of a classroom. To prepare Indigenous as well as non-Indigenous students and tutors adequately, it is important to acknowledge and critically deconstruct the embodiment of colonialism and Indigenous-settler relations when teaching physicians, as well as future physicians, preparedness for culturally safe care of Indigenous peoples.

Criterial framework for internal and external evaluation of the form tutor’s activity

Introduction. In modern conditions, the problem of setting the criteria for evaluating the effectiveness of the form tutors’ activity is becoming relevant in virtue of the importance of education and the absence of a unified methodology and techniques for evaluating the efficiency of the form tutor’s activity. The purpose of the study is to develop and substantiate the criterial framework for evaluating the efficiency of the form tutor’s activity. Materials and methods. A total of 230 form tutors from educational organisations representing 7 regions of the Russian Federation took part in the survey. The service record of 54% of the respondents was over 20 years, 30% – 11 to 20 years and 16% – less than 10 years. Methods: the key theoretical methods were system analysis, synthesis and generalisation of scholarly literature on the problem of developing the criteria and efficiency parameters of the form tutor’s activity, modelling the criterial framework of evaluation. The following was used as the main empirical methods: questioning of form tutors, method of observation, expert examination of the developed criterial framework. Results. A criterial framework for evaluation of efficiency of the form tutor’s activity, based on the selected theoretical and methodological foundations, was developed, being structured as three blocks: personality, process and efficiency. Certain criteria and of efficiency indicators were selected for each block with regard for the key invariant directions of the form tutor’s activity: work with the learner’s personality, learners’ stream, parents, subject teachers, social partners. It was revealed as a result of the empirical research that the most important component in the developed criterial framework, according to 41% of the respondents, is the efficiency block; it is followed in importance by the process block (39%) and the personality block (20%). The necessity to include invariant directions of the form tutor’s activity in each block was noted by 75% of the respondents. The rating results on the each block criteria showed that 67% of the respondents noted the foremost importance, when considering the processual aspect, of the criterion “Organisation and facilitation activity aimed at education and socialisation of learners in cooperation with all actors of the educational process” (KP-4); when considering the personality aspect, 75% of the respondents placed the criterion “Competence in organisational and pedagogical support of educational process” (KL-4) at the top. When assessing the criteria of the efficiency block, the respondents’ rating showed that 72% and 87% of the form tutors placed the criteria “level of cohesion of children’s team, parents, teachers, the staff, the level of development of children and adult community” (KR-6) and “level of learners’ mature experience as based on the system of values inherent in a Russian citizen” (KR-7), on the first place. Conclusions. The obtained results confirm the importance and necessity of creating a criterial framework that acts as an evaluation matrix of the form tutor’s activity efficiency. The personality, processes and efficiency aspects forming its basis take into account the complex of the form tutor’s invariant activity. The further research will be connected with the creation of methods for assessing efficiency of the form tutor’s activity and those related with automation of this process.

Psychometric Properties of Visual Indicators of Teaching and Learning Success "VITALS" Instrument for Evaluation of Clinical Teachers.

PurposeWe have previously developed an instrument for students’ evaluation of clinical teachers that we called Visual Indicators of Clinical Teaching and Learning Success (VITALS). This study measures the reliability of VITALS as an instrument for student evaluation of clinical tutors. Additionally, the study explores the minimum number of student raters necessary for an acceptable reliability, and provides evidence of construct validity of the evaluation scores.Materials and MethodsThis retrospective study included 1825 evaluation forms completed by medical students evaluating clinical tutors using the VITALS instrument. Reliability was measured by applying generalizability theory (G-theory) analysis using a two-facet design (raters and items). A D-study was used to determine the minimum number of raters required to achieve a reliability ≥0.80. Face validity was tested by measuring tutors’ degree of agreement with the items of the study instrument.ResultsThe overall G-coefficient was 0.89. The subject of measurement (clinical tutors’ scores) represented 15.8% of the variance across all tutors and items. The variance due to the interaction between raters (students) and tutors contributed to 43.5%, while the variance due to items was negligible. The remaining 40% of the variance was due to unexplained sources of error. The D-study demonstrated that a minimum of 12 raters (students) are required to achieve a reliability of 0.80. Finally, most of the clinical tutors agreed that all items in the instrument were appropriate.ConclusionWe demonstrate that VITALS exhibits good psychometric properties. There should be at least 12 students rating each clinical tutor to have an acceptable level of reliability for the study instrument. Face validity of the study instrument was evidenced by its high level of approval among clinical tutors.

Exploración del Comportamiento de un Instrumento para Evaluar la Función de Tutoría Académica en el Contexto de Escuelas Normales

This paper documents the process and results of an exploratory quantitative approach research exercise on the metric behavior of a questionnaire for the evaluation of university tutors applied in the context of a teacher training school.The work was supported by a questionnaire that evaluates the performance of university tutors under the student accompaniment model, composed of thirty items derived from three dimensions and five competencies. This instrument has been validated and tested in different Mexican higher education context. The results are oriented to a good behavior of the items for the evaluation of the tutors of teacher training school since the test presented a level of adjustment to the model, by items and by response categories. Part of the conclusions point to the importance of continuing to explore the evaluation of tutoring for the improvement of student accompaniment processes and the training of academic tutors, also perform more metric studies of the behavior of the items to improve the evaluation process.

Determinants of self-regulated learning skills: the roles of tutors and students.

Problem-based learning (PBL) is an instructional method that offers students the opportunity to develop self-regulatory strategies as an explicit learning outcome. As a multifaceted PBL environment, the guidance of tutors is important to students as they develop self-regulatory learning (SRL) skills and self-efficacy, the most focused motivational element in SRL. The present study examines the relationship between academic achievement and PBL self-efficacy levels, as well as the role played by tutors. A cross-sectional study was conducted with third- year medical students (n = 257; 75%). The SRL perception (SRLP) scale, the self-efficacy for PBL scale (SPBL), tutor evaluation scale (TES), and an achievement test were used to gather data in this study. In every scale, participant scores were higher than the midpoint, which is 3. There were positive correlations between SRL, self-efficacy, and the tutoring scores of tutors. As the correlation between SRLP and achievement was not significant, achievement was removed from the regression equation, and only SPBL and TES results were used. The results of the regression analysis indicated that SPBL and TES explained 36% of the variance. The level of self-efficacy in PBL predicted the students' SRL abilities, as did tutor evaluations. The findings show that students used their SRL skills and had beliefs about their ability to learn effectively in the PBL context. Both the tutors' tutoring skills and the students' self-efficacy made important contributions to improving the students' self-regulated learning skills.

Establishment and Implementation of a Whole-course Education Mode for Clinical Interns’ Professional Quality

In order to explore a high efficiency mode to cultivate clinical interns with outstanding professional quality. We performed a whole-course education on clinical interns of grade 2014 and 2016, focused on professional quality, in the People’s Hospital of Rizhao. All the interns underwent a theory test, the Objective Structured Clinical Examination (OSCE) and the tutor evaluation of students before graduate, which were compared with grade 2011 to 2013 cultivated through traditional method. The professional quality of clinical interns were improved significantly（P&lt;0.05）underwent the new training mode. The comprehensive professional quality has been effectively improved, especially about the theoretical knowledge, clinical skills, humanistic literacy, psychological quality and scientific research thinking. The whole-course training mode of interns' professional quality can effectively improve the interns' professional quality, which can be used as reference in other teaching hospitals.

Evaluation of the role of near-peer teaching in critical appraisal skills learning: a randomized crossover trial.

ObjectivesThe study sought to evaluate near-peer tutors’ teaching of critical appraisal skills to medical students as an aspect of Evidence-based Medicine. MethodsIn a randomized crossover trial, 241 students completing a Clinical Epidemiology and Evidence-based Medicine (CE-EBM) module in the Faculty of Medicine Universitas Indonesia (FMUI) were randomly assigned to intervention or control groups. During tutorial sessions, intervention group participants were assigned to near-peer tutors, who were newly graduated doctors, and those in the control groups were assigned to staff tutors. After two tutorial sessions, intervention and control groups exchanged tutors for the next two sessions. Outcomes were measured using written knowledge and skills multiple choice questions (MCQ) test, the Evidence-based Practice Confidence Scale (EPIC) and a student attitude questionnaire, along with student evaluation of tutors to evaluate the process. ResultsOn completion of the module, the written test scores of intervention group students were similar to those of the control group (t(239) = 1.553, p=0.122), as well as overall Evidence-based Practice Confidence Scale scores (F(2/170) = 0.179, p = 0.673) and attitude scores (t(219) =-0.676, p = 0.085). In the tutor evaluations, the students rated their near-peer tutored sessions as better than those tutored by staff in most respects. ConclusionsNear-peer tutors were as effective as and more readily accepted than staff tutors in teaching critical appraisal skills. These findings support the broader implementation of peer-teaching in other areas of medical education.

Formulation and preliminary application of the evaluation index for postgraduate tutor of clinical professional degree

The core of standardized training for residents is the cultivation of clinical practice ability, which is also the main content of the professional degree graduate training. With the integration of professional degree graduate training and standardized training of residents, the evaluation system of professional degree graduate tutors should be included in the quality index of graduate clinical skills training. Through the methods of document retrieval and expert consultation, the index structure, the examination content and the weight were set up, and the detailed rules for the evaluation of the professional degree graduate tutors were established to guide them strengthen the training of clinical skills for graduates and improve the cultivation quality of professional degree graduates. Key words: Clinical medicine; Professional degree; Graduate student; Tutor; Assessment; Index

Evaluation of Problem-Based Learning Tutors from Students’ Perspective

Evaluation of Problem-Based Learning Tutors from Students’ Perspective

Assessing the competences associated with a nursing Bachelor thesis by means of rubrics

BackgroundWriting a Bachelor thesis is the last step in obtaining a university degree. The thesis may be job- or research-orientated, but it must demonstrate certain degree-level competences. Rubrics are a useful way of unifying the assessment criteria. ObjectivesTo design a system of rubrics for assessing the competences associated with the Bachelor thesis of a nursing degree, to examine the system's reliability and validity and to analyse results in relation to the final thesis mark. DesignCross-sectional and psychometric study conducted between 2012 and 2014. SettingsNursing degree at a Spanish university. ParticipantsTwelve tutors who designed the system of rubrics. Students (n = 76) who wrote their Bachelor thesis during the 2013–2014 academic year. MethodsAfter deciding which aspects would be assessed, who would assess them and when, the tutors developed seven rubrics (drafting process, assessment of the written thesis by the supervisor and by a panel, student self-assessment, peer assessment, tutor evaluation of the peer assessment and panel assessment of the viva). We analysed the reliability (inter-rater and internal consistency) and validity (convergent and discriminant) of the rubrics, and also the relationship between the competences assessed and the final thesis mark. ResultsAll the rubrics had internal consistency coefficients >0.80. The rubric for oral communication skills (viva) yielded inter-rater reliability of 0.95. Factor analysis indicated a unidimensional structure for all but one of the rubrics, the exception being the rubric for peer assessment, which had a two-factor structure. The main competences associated with a good quality Bachelor thesis were written communication skills and the ability to work independently. ConclusionThe assessment system based on seven rubrics is shown to be valid and reliable. Writing a Bachelor thesis requires a range of degree-level competences and it offers nursing students the opportunity to develop their evidence-based practice skills.

Creating a Student-centered Learning Environment: Implementation of Problem-based Learning to Teach Microbiology to Undergraduate Medical Students.

IntroductionMedical education involves training necessary to become a physician or a surgeon. This includes various levels of training like undergraduate, internship, and postgraduate training. Medical education can be quite complex, since it involves training in pre-clinical subjects (anatomy, physiology, biochemistry), the para-clinical subjects (microbiology, pathology, pharmacology, and forensic medicine), and a discrete group of clinical subjects that include general medicine, surgery, obstetrics and gynaecology, ear, nose and throat specialization, paediatrics, cardiology, pulmonology, dermatology, ophthalmology, and orthopaedics, and many other clinical specializations and super specialities (cardio-thoracic surgery, neurosurgery, etc.). Training medical students involves both classroom teaching and practical applications. Classroom teaching is usually confined to didactic lectures, where the teacher unilaterally disseminates the information. This kind of teaching was recently noted to be not very effective in producing better quality medical graduates. The present study aims to introduce problem-based learning (PBL) to teach microbiology to undergraduate medical students and evaluate their perception towards such type of learning.MethodsA total of 159 students were included in the study. An informed and oral consent was obtained from each participant, and the study was approved by the institutional ethical committee. All the students included in the study were grouped into 14 groups of 11-13 students. Students were carefully grouped ensuring that each group had a good mix that included different levels of achievers. Students were given a detailed introduction to the exercise before they started it. A questionnaire that consisted of 11 points was given to the students and they were asked to give feedback (strongly disagree, disagree, agree to some extent, agree, strongly agree) both on the functioning of PBL and the tutor performance during PBL.ResultsThe study included a total of 159 students. Among the study participants, 55 (35%) were male and 104 (65%) were female. There was a positive response towards PBL being instrumental in improving cognitive skills as evidenced by the results (females (59%) and males (29%)) (p=0.191). We found that 61% females and 30% males felt that PBL was the best learning technique, as compared to traditional teaching (p=0.241). Most students were happy with the number of students in a group (females (63%) and males (34%)), but a few students felt that there would have been an improvement in the learning process if the groups were smaller (<10 students) (p=0.239). A positive response was given by the students regarding the feedback encouragement provided by the tutor (females (43%) and males (27%)) (p=0.253). Tutor evaluation by the students revealed some interesting observations, which include an agreement by most students that the tutor had completely avoided traditional teaching (females (55%), males (32%)) during the PBL sessions (p=0.001).ConclusionMost students liked PBL as it encouraged group discussions and presentations, which helped in retaining information and improving cognitive skills.

A Comparison of Experiences and Preferences Regarding Classroom and Tutoring Feedback among Chinese and Saudi Learners of English

&lt;p&gt;&lt;em&gt;This report studies ESL tutoring feedback to Chinese and Saudi students. The objective is to research the reasons of feedback differences and similarities, which include previous and current English learning styles, habits, purposes for receiving tutoring, and evaluations of tutors. Faced with L2 learners who come from different cultural backgrounds, it is helpful for instructors and tutors to know L2 students’ previous English learning experiences in their home countries so that instructors and tutors can adjust teaching or tutoring for each student. In addition, students who speak the same L1 have common problems of English learning due to their L1. In this way, ESL tutors not only tutor English skills, but also promote cultural awareness. Meanwhile, knowing students’ cultural background is necessary to give tutoring for each L2 learner. The present study aims to explore L2 learners’ feedback from previous and current English learning experiences and will help L2 instructors and tutors to know some basic knowledge about two different language groups.&lt;/em&gt;&lt;/p&gt;

Students' evaluation of tutors in distance education: a quasi-longitudinal study

The methods used for evaluating teacher performance aim at providing the university with an in-depth understanding of its academic staff. Improving teacher performance and enhancing their training so as to enable them to improve their teaching methods, is a common goal of academic institutions. In the case of the Hellenic Open University, the methodology used is mainly based on the evaluation of tutors by their students. The students are asked once a year to fill in an anonymous questionnaire and return it to the tutors' supervisor. Then all data is processed. The presented study used tutors' evaluation from five consecutive academic years. Analysis of the results showed that the tutors' evaluations remained relatively stable across the years. However, ratings were significantly higher for female tutors than for the male tutors. Students' participation in the evaluation, students' grades and students attendance in the face to face meetings were positively correlated with the students' ratings.

SOAP Methodology in General Practice/Family Medicine Teaching in Practical Context.

Medical records in General Practice/Family Medicine are an essential information support on the health status of the patient and a communication document between health professionals. The development of competencies in General Practice/Family Medicine during pre-graduation must include the ability to make adequate medical records in practical context. As of 2012, medicine students at the University of Beira Interior have been performing visits using the Subjective, Objective, Assessment and Plan - SOAP methodology, with a performance evaluation of the visit, with the aim to check on which Subjective, Objective, Assessment and Plan - SOAP aspects students reveal the most difficulties in order to define improvement techniques and to correlate patient grade with tutor evaluation. Analysing the evaluation data for the 2015 - 2016 school year at the General Practice/Family Medicine visit carried out by fourth year students in medicine, comparing the averages of each item in the Subjective, Objective, Assessment and Plan - SOAP checklist and the patient evaluation. In the Subjective, Objective, Assessment and Plan - SOAP, 29.7% of students are on the best grade quartile, 37.1% are on the best competencies quartile and 27.2% on the best patient grade quartile. 'Evolution was verified/noted' received the worst grades in Subjective, 'Record of physical examination focused on the problem of the visit' received the worst grades in Objective, 'Notes of Diagnostic reasoning / differential diagnostic' received de worst grades in Assessment and 'Negotiation of aims to achieve' received the worst grades in Plan. The best tutor evaluation is found in 'communication'. Only one single study evaluated student´s performance under examination during a visit, with similar results to the present one and none addressed the patient's evaluation. Students revealed a good performance in using the Subjective, Objective, Assessment and Plan - SOAP. The findings represent the beginning of the introduction of the Subjective, Objective, Assessment and Plan - SOAP to the students. This evaluation breaks ground towards better ways to teach the most difficult aspects.

Predicting Analysis of Data Mining Extraction Technique in Secondary Education

Objectives: To implement the data mining techniques to evaluate the performance evaluation of tutor and compare the results obtained by adopting several data mining techniques. Methods/Statistical Analysis: The details regarding the results of the students are taken as the base parameter for the performance evaluation of the tutor. The classification data mining techniques are utilized to study the data developed based on the students performance. Findings: By employing the various data mining classification techniques on the student result data to evaluate the performance of the instructor, efficiency of the work carried out by the instructor and also the way in which the instructor is approaching the students point of view is highly impactful on the students results can be given as the output based on the numerical generated by the classification techniques. Application/Improvements: The result generated by the classification techniques can be more accurate by providing more accurate input and considering the other factors that would affect the outcome of the technique.

Effectiveness of Crown Preparation Assessment Software As an Educational Tool in Simulation Clinic: A Pilot Study

The aim of this pilot study was to evaluate the feasibility of a new tooth preparation assessment software, Preppr, as an educational tool for dental students in achieving optimal parameters for a crown preparation. In February 2015, 30 dental students in their fourth year in a five-year undergraduate dental curriculum in New Zealand were randomly selected from a pool of volunteers (N=40) out of the total class of 85. The participants were placed into one of three groups of ten students each: Group A, the control group, received only written and pictorial instructions; Group B received tutor evaluation and feedback; and Group C performed self-directed learning with the aid of Preppr. Each student was asked to prepare an all-ceramic crown on the lower first molar typodont within three hours and to repeat the exercise three times over the next four weeks. The exercise stipulated a 1 mm finish line dimension and total convergence angles (TOC) between 10 and 20 degrees. Fulfillment of these parameters was taken as an acceptable preparation. The results showed that Group C had the highest percentage of students who achieved minimum finish line dimensions and acceptable TOC angles. Those students also achieved the stipulated requirements earlier than the other groups. This study's findings provide promising data on the feasibility of using Preppr as a self-directed educational tool for students training to prepare dental crowns.