SETTING PASSING SCORE FOR METERED DOSE INHALER (MDI) OSCE STATION: EXPERIENCE AT CENTER FOR ELABORATION COMPETENCY & INNOVATION IN CLINICAL SIMULATION (CECICS) OF PHAM NGOC THACH UNIVERSIRTY OF MEDICINE (PNT-UOM)

Abstract

Introduction: OSCE has been used increasingly in assessing learners globally. Standard Setting for OSCE is necessary to distinguish between a competent and an incompetent learner. This study was conducted to enhance the quality of assessment of the MDI OSCE for MS-2 at CECICS. Objective: 1. To describe steps in implementing Standard Setting for MDI Station; 2. To determine the content validity of the MDI checklist. Method: This is a cross-sectional study. To calculate the pass mark, we followed five steps of the Angoff method. To determine the content validity of the checklist, we calculated S-CVI, I-CVI and CVR. Result: We recruited a group of 8 SMEs who are qualified to define the required level of knowledge and skills of MCC. During the online orientation organized by CECICS’ Director, all items of checklist were clarified. To avoid the time-consuming process, each SME will only determine the percentage of MCC would answer the item correctly for the first 3 items. SMEs explained their decisions on each item and discussed to resolve the discrepancies when the difference between the lowest and highest scores are greater than 15%. All SMEs made their judgements for the remaining items after the meeting. One week later, the 2nd online meeting was organized to collect all the judgements and repeated all steps to collect MCC. Finally, we obtained the passing score of 81% for this station by averaging the total score of 8 SMEs. The calculated value of S-CVI/average, S-CVI/UA, and CVR were all equal to 1. The results provided good evidence of content validity. Conclusion: In this study, Angoff method has shown to be practical in providing defensible passing score for the MDI station. Besides that, MDI checklist has evidence to support the content validity. In the future, to achieve a higher standard in measuring performance assessment, the passing scores of all OSCE at CECICS should be determined by appropriate standard setting methods.