The Centers for Medicare & Medicaid Services' Five-Star Quality Rating System combines results from nursing home recertification surveys and complaint investigations into a single indicator for health inspections. This combination may mask complaint investigation results. To construct and compare star ratings specific to recertification surveys and specific to complaint investigations to discern whether they provide different information. In this quality improvement study, the Nursing Home Compare Five-Star Quality Rating System was used to calculate three 5-star ratings: 1 overall health inspection rating combining recertification survey scores and complaint investigation scores, 1 using only recertification scores, and 1 using only complaint investigation scores. The study included US nursing homes. The sample calculated star ratings for nursing homes in November 2017. This sample included all whose most recent recertification surveys occurred in 2016 up to and including November 2017, and those with 36 months of data from the ASPEN Complaints/Incidents Tracking System and the Certification and Survey Provider Enhanced Reports. Data analyses were completed on different days in 2022, depending on which questions were being addressed. Comparison of the 3 star rating distributions. The recertification survey and complaint investigation star ratings were compared with respect to the overall health investigation rating. The recertification and complaint star ratings were cross-tabulated. Among the 15 499 nursing homes, 19.8% had 1 overall health inspection star, 23.2% had 2, 23.2% had 3, 23.2% had 4, and 9.8% had 5 overall health inspection stars. Most had the same overall and recertification star ratings; for example, 79.4% had 5 overall stars and 5 recertification survey stars. However, overall and complaint-based star ratings were discordant, with a relatively large proportion of nursing homes (25.7%) having no complaint deficiencies and therefore high star ratings. In this quality improvement study assessing the 2 components of the Five-Star Quality Rating System, results of recertification surveys were largely similar to health inspection star ratings. However, recertification survey scores differed from complaint inspection scores, suggesting health inspection ratings may not reflect consumers' views of care, services, or other valued amenities. A complaint-focused metric may have utility. However, research is needed concerning the many nursing homes with no or very few complaint deficiencies.