Aircraft noise is considered by many as the most burdensome part of aircraft operations. Communities neighbouring airports often express concerns about the possible health effects of chronic exposure to noise. To quantify the long-term effects of environmental noise exposure, researchers often use the metric of annoyance. Annoyance is widely considered to be the most well-corroborated health effect of aircraft noise and a moderating factor for other suspected health effects. Annoyance can also be correlated to average cumulative noise levels, such that higher levels of chronic noise likely evoke higher levels of annoyance within the population. Annoyance data is typically collected using extensive surveys and/or interviews, which are costly and time-consuming. In the absence of annoyance data, complaints are often used as a proxy for annoyance. This research used complaint, noise and annoyance data to demonstrate that complaints do not equate to annoyance, nor do they correlate to cumulative noise metrics. Thus, while complaint data may prove useful in analyzing short-term response to operations, it should not be relied upon for the assessment of long-term impacts from aircraft noise exposure, nor should it be used to direct noise and annoyance mitigation initiatives.