Increasing concern around perceived neurocognitive decline is increasing the number of referrals to specialists and anxiety for patients. We aimed to explore the likelihood of the "worried well" experiencing neurocognitive decline and developing a neurological diagnosis. A total of 166 "worried well" patients who attended the Rural and Remote Memory Clinic (RRMC) between 2004 and 2019 were included in this study. Demographic, health, social, and behavioral factors were measured at the initial visit. Mini-Mental State Examination (MMSE), Center for Epidemiologic Studies Depression Scale (CESD), and Functional Activities Questionnaire (FAQ) scores were measured and compared at initial assessment and at 1-year follow-up. MMSE scores over time were assessed with a mean follow-up of 2.95 years (SD 2.87). No statistically significant difference was seen in MMSE, CESD, or FAQ scores when comparing clinic day to 1-year follow-up, and no consistent pattern of MMSE score over time was seen. Of the 166 patients with subjective cognitive impairment (SCI) on initial assessment, 5 were diagnosed with Alzheimer's disease (AD) at 8.5, 3.5, 5, 3, and 1.75 years; 2 were diagnosed with MCI at 1 and 2 years; 1 was diagnosed with vascular cognitive impairment at 5 years; and 1 was diagnosed with frontotemporal dementia (FTD) at 0.5 years. The likelihood of a patient with SCI developing a neurological diagnosis is reassuringly low (9/166), but not irrelevant. This, along with the benefits of early diagnosis and treatment for dementia, leads us to believe that patients with SCI should still be seen in follow-up at least at the 1-year mark.