Abstract
To assess the effect of changing survey questions on plan-level patient experience measures and ratings. 2015 Medicare Advantage CAHPS Survey respondents. Ninety three randomly selected beneficiaries in each of 40 MA plans received a revised (5.0) CAHPS survey; 38832 beneficiaries received version 4.0. Linear mixed-effect regression predicted CAHPS measures from fixed effects for survey version and beneficiary characteristics and random effects for plan and plan-by-version random slope. Response rates were 42 percent for both versions. Removal of "try to" from screeners increased the percentage of respondents eligible for follow-up questions. Version 5.0 caused a small increase (1-3 points on a 0-100 scale, P<0.05) in the mean of three altered measures and a moderate increase (>3 points) in one. There was a small statistically significant increase in two unaltered measures. These changes were uniform across plans, so there would be no expected change compared to results using the legacy survey in the score distributions other than uniform mean shifts, and no expected effect on summary measures. These analyses illustrate how to assess the impact of seemingly minor survey modifications for other national surveys considering changes and highlight the importance of screeners in instrument design.
Sign-in/Register to access full text options 
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a callDisclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.
