Objective: To investigate the sexual relationship and sexual health of elderly patients with cardiovascular disease and their spouses, as well as to explore the relationship between sexual health and the quality of life. Methods: A total of 206 CHD patients and their spouses (N = 206) as well as 238 age- and gender-matched healthy people were recruited and investigated by using a self-designed sexual relationship and sexual health questionnaire and the SF-36 questionnaire; data analysis and comparison were carried out by using SPSS 22.0. Results: The scores of perceived health, marital satisfaction, sexual satisfaction, sexual function, and quality of life were all significantly different among elderly CVD patients, their spouses, and healthy people (F = 3.894, p < 0.05). There was a significant correlation between perceived health, marital satisfaction, sexual satisfaction, and sexual function with quality of life (p < 0.05). Conclusion: Sexual behavior is an important aspect of quality of life. The sexual relationship, sexual health, and quality of life of elderly patients with cardiovascular disease and their spouses were significantly lower than those of healthy people. It is recommended that more attention should be paid on the sexual relationship and sexual health of these patients and their spouses, with counselling offered when needed.