Objective structured clinical evaluation as an assessment method for undergraduate chest physical therapy students: a cross-sectional study

Abstract

The Objective Structured Clinical Evaluation (OSCE) has been considered a reliable method for the evaluation of students' clinical skills in health sciences, but it has been rarely applied in the teaching of physical therapy. To assess the use of the OSCE as a tool to evaluate the abilities of undergraduate chest physical therapy students and to verify the internal consistency of the OSCE exam. Forty-seven students were evaluated using two types of exams: the traditional exam and the OSCE. Independent educators elaborated the exams. Each question (traditional) or station (OSCE) was given a score ranging from 0.0 to 2.0; being 10.0 the highest possible score of both exams. The relationship between the total score that were obtained from both exams was analyzed using Bland-Altman analysis and Pearson's correlation coefficient. The internal consistency of the OSCE stations was evaluated by four experienced chest physical therapists and it was tested using Cronbach's alpha. The students' average score on the OSCE ranged from 4.4 to 9.6. The internal consistency of the OSCE stations was considered good (0.7). The agreement between exams was analyzed, and it was determined that the exams are not comparable. Examiners also observed a low agreement between the two exams (r=-0.1; p=0.9). Our results showed that OSCE and traditional exams are not interchangeable. The OSCE exam had good internal consistency and is able to evaluate aspects that the traditional exam fails to evaluate.