Evaluating a dental sleep apnea mini-residency program using the Kirkpatrick model.

Abstract

The aim of this retrospective study was to evaluate a Dental Sleep Medicine Mini-Residency (DSMMR) continuing education (CE) program using the Kirkpatrick model. After receiving ethical approval, data from participants in the 2019-2020 DSMMR CE course were included for the Kirkpatrick evaluation. The analysis was stratified and all the Kirkpatrick levels were integrated: level 1 (satisfaction) was assessed via Likert scale and open-ended questions; level 2 (learning) was evaluated using pretest and posttest knowledge data following Module 1 (M1) and an assessment of multiple-choice questions (MCQs) developed by participants; level 3 (behavior) was evaluated using Likert scale questions; and level 4 (results) was assessed via the percentage of participants who passed the American Board of Dental Sleep Medicine (ABDSM) examination on their first attempt. A total of 90 participants were included in the study. At least 83.1% of participants agreed/strongly agreed with positively worded statements about satisfaction. Knowledge scores significantly increased from pre-M1 to post-M1 (p<0.001); however, only 15.2% of MCQs were evaluated as well-formulated. At least 88.6% of participants agreed/strongly agreed with positively worded statements about transfer of knowledge/skills to their practice. 91.1% passed the ABDSM examination on their first attempt. The evaluation of the 2019-2020 DSMMR using the Kirkpatrick model suggests its overall positive impact as a training program. The Kirkpatrick model provided information that can be used to improve the quality of a program. Future studies should assess other dental CE programs using the Kirkpatrick model or another evaluation model.