Effect of faculty personality, rating styles, and learner traits on student assessment in medical education: A mixed-method study from the Aga Khan University, Karachi.

Abstract

Medical colleges invest considerable effort in developing assessment programs to effectively evaluate students across attributes of knowledge, skills, and behavior. While assessment by direct observation is designed to be objective, "soft characteristics" such as personality, demeanor of student, and assessor may make assessment more subjective. The effect of such attributes in medical education remains unclear and needs exploration. The objective of this study was to explore non-cognitive traits of assessor and learner to understand their roles in student assessment. A mixed-method study was conducted during March to June 2015. All clinical faculty members at the Aga Khan University were invited to participate in this study. A questionnaire was designed and completed by the study participants. Two focus group discussions (FGDs) with faculty members explored teacher and learner traits influencing student assessment. A documentary analysis of the yearly student feedback report with a focus on the section on assessment was also utilized. Data triangulation was achieved by combining three sets of data. Fifty-four (28%) clinical faculty members completed the questionnaire and 11 participated in the FGDs. About 68% reported rating students leniently. More than 50% reported their personality as a factor influencing assessment and 76% reported student appearance influencing assessment. The documentary analysis identified faculty personality and rating styles as key issues affecting the validity of student assessment during ongoing observation. In the FGDs, traits such as eagerness, intuition in students, and body language were reported to influence faculty members during the assessment. Softer attributes of trainer and trainee increase the subjectivity of student assessment. Ongoing faculty training and rater feedback are required for a robust and objective assessment.