Abstract
Mastery learning is an instructional approach in which educational progress is based on demonstrated performance, not curricular time. Learners practice and retest repeatedly until they reach a designated mastery level; the final level of achievement is the same for all, although time to mastery may vary. Given the unique properties of mastery learning assessments, a thoughtful approach to establishing the performance levels and metrics that determine when a learner has demonstrated mastery is essential.Standard-setting procedures require modification when used for mastery learning settings in health care, particularly regarding the use of evidence-based performance data, the determination of appropriate benchmark or comparison groups, and consideration of patient safety consequences. Information about learner outcomes and past performance data of learners successful at the subsequent level of training can be more helpful than traditional information about test performance of past examinees. The marginally competent "borderline student" or "borderline group" referenced in traditional item-based and examinee-based procedures will generally need to be redefined in mastery settings. Patient safety considerations support conjunctive standards for key knowledge and skill subdomains and for items that have an impact on clinical outcomes. Finally, traditional psychometric indices used to evaluate the quality of standards do not necessarily reflect critical measurement properties of mastery assessments. Mastery learning and testing are essential to the achievement and assessment of entrustable professional activities and residency milestones. With careful attention, sound mastery standard-setting procedures can provide an essential step toward improving the effectiveness of health professions education, patient safety, and patient care.
Highlights
Item Checked that all necessary equipment is available and ready to use Opened lumbar puncture kit carefully to maintain sterility Prepped insertion point with iodine swabs in concentric circles [Other checklist items, not shown here]
The bottom panel presents a hypothetical predictive performance data display for a mastery item-based standard-setting exercise for lumbar puncture; data based on performance of 34 residents
Summary
Item Checked that all necessary equipment is available and ready to use Opened lumbar puncture kit carefully to maintain sterility Prepped insertion point with iodine swabs in concentric circles [Other checklist items, not shown here] Residents who correctly performed the item, No (% )
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have