In 2018 a consensus report outlining residency curriculum and competency assessment for obstetric/gynecologic ultrasound was created by a multi-society collaboration with SMFM, AIUM, ACOG and others. To date, no studies demonstrate completion of this curriculum within an OBGYN residency. The goals of this study were to evaluate if standard residency training meets the outlined competencies and also to evaluate if use of obstetric ultrasound simulation increased competency. Between 2019-2020, we created a hands-on quiz on the Scantrainer ultrasound simulator (Figure 1) to test if PGY-3 & PGY-4 residents met the year specific competencies in the consensus report. The ultrasound quiz required them to scan, capture and correctly diagnose common fetal and uterine anomalies. In the same time period, the PGY-2 residents completed weekly simulator learning modules on the Scantrainer during their MFM rotation. At the beginning and end of the rotation they underwent a pre-& post-test quiz on the simulator to assess if ultrasound simulation helps increase competency to meet the PGY-2 level curriculum. Only 1 out of 17 PGY3 & PGY4 residents passed (scored >70%) the ultrasound quiz. Most could not accurately identify common cardiac, facial or congenital uterine malformations as outlined in the curriculum. The PGY2 post test scores were significantly higher than the pretest scores when compared using a paired two-tailed t-test (79% vs 43%; p< 0.05) with improvement in accuracy of biometry measurements, placental evaluations, cervical lengths and diagnosis of common abnormalities. Based on scores from our ultrasound quiz, standard ultrasound training at our institution did not meet the proposed expected knowledge of upper level residents by the competency curriculum. This suggests re-evaluation of current ultrasound training as well as review of the competency curriculum. We did find obstetric ultrasound simulation was an effective means to improve ultrasound skills and provides a tool for capturing and assessing resident knowledge.View Large Image Figure ViewerDownload Hi-res image Download (PPT)