The Effect of Judge Selection on Standard Setting Using the Mastery Angoff Method during Development of a Ventricular Assist Device Self-Care Curriculum

Abstract

BackgroundPatients and caregivers need to perform ventricular assist device (VAD) self-care safely to help prevent complications (e.g., infection). We developed a VAD self-care simulation-based mastery learning (SBML) curriculum. We determined optimal minimum passing scores (MPSs) and evaluated effects of judge selection. MethodsA multidisciplinary team created a VAD self-care SBML curriculum including simulated skills and knowledge examinations. Patients, caregivers, VAD coordinators, and physicians were expert judges who determined MPSs using the Mastery Angoff method. ResultsMPSs for the skills and knowledge examinations were high (range = 94%-99% and 97% correct, respectively). Judges closely agreed on MPSs. ConclusionsStakeholders set stringent MPSs for high-stakes VAD self-care.