Novice advanced practice registered nurses (RNs) experience decreased self-confidence, anxiety, and identity confusion in their first year of practice, which leads to poor job satisfaction and turnover. Advanced practice RN fellowship programs, developed to bridge the gap from the RN to the advanced practice role, lack standardized measures for program evaluation. A large Midwestern pediatric hospital's advanced practice nurse fellowship program lacks a structured program evaluation. A quasi-experimental evidence-based improvement project was implemented to evaluate fellowship program outcomes for novice nurse practitioner transition and retention. All novice advanced practice RNs (APRNs) were enrolled in the site's 12-month APRN fellowship program. The transition experiences of enrollees who completed the fellowship program were assessed using the novice nurse practitioner role transition scale. In addition, role transition scores were compared for two subgroups: fellows in acute care and fellows in primary care roles. Fellowship participant retention 1 year after hire was measured. Postintervention data showed that most fellowship graduates had a positive transition experience as evidenced by at least a 4.33/6.0 mean total novice nurse practitioner role transition score. There was not a statistically significant difference between the transition scores of the acute care fellows and primary care fellows. The APRN fellowship program was effective in promoting a successful role transition from RN to novice APRN. Similar APRN fellowship programs may benefit from using this tool for program evaluation.