PurposeMedicare established its Hospital Outpatient Quality Reporting Program (HOQRP) to promote and incentivize quality care and appropriate utilization in the hospital outpatient setting. The program includes “imaging efficiency” metrics evaluating appropriate utilization of imaging examinations. Our purpose was to evaluate the longitudinal performance of the nation’s hospitals on the HOQPR’s imaging efficiency metrics. MethodsData were obtained from CMS Hospital Compare for hospitals participating in the Medicare HOQRP during both initial (January 1, 2011, to December 31, 2011) and follow-up (July 1, 2015, to June 30, 2016) periods. The six reported imaging efficiency metrics were: MRI lumbar spine for low back pain, mammography follow-up rates, abdomen and chest CT double scans (imaging with and without intravenous contrast), cardiac imaging for preoperative risk assessment for low-risk surgery, and simultaneous use of brain and sinus CT. Differences in imaging efficiency metrics were calculated using fixed effects linear regression models. ResultsBaseline and follow-up data were available for 3,960 hospitals. Median changes were MRI lumbar spine for low back pain: +3.6% (range: −27.9% to +31.4%; P < .001); mammography follow-up: −0.3% (range: −69.5% to +62.6%; P = .03); double scan abdomen CT: −1.9% (range: −73.5% to +32.3%; P < .001); double scan chest CT: −0.4% (range: −73.2% to +28.0%; P < .001); preoperative cardiac imaging: −0.7% (range: −10.0% to +9.9%; P < .001); simultaneous brain and sinus CT: −0.9% (range: −11.8% to +7.8%; P < .001). ConclusionMedicare’s nationwide hospital outpatient imaging efficiency reporting initiative was associating with worse performance in lumbar spine MRI utilization and small improvements in double CT scans. Because quality metrics are increasingly imposed on health care providers, health service researchers will need to rigorously evaluate their effectiveness before and during early implementation.