In 2019, mild vestibular function deficiency in elder populations was defined as presbyvestibulopathy (PVP) by the Classification Committee of the Bárány Society. The diagnostic criteria include tests for low-, mid-, and high-frequency vestibular function, represented by caloric testing, rotary chair testing, and head impulse testing, respectively. However, there is still a lack of large-scale reports supporting the relationship between vestibular function tests (VFTs) and aging. In this study, we evaluated whether each test is correlated with aging in the elderly population aged over 50. This study retrospectively enrolled 1043 subjects from a single university hospital database after excluding those with unilateral and bilateral vestibulopathy, central dizziness, and acute dizziness. Enrolled subjects had caloric canal paresis <20%, vHIT lateral canal gain >0.6, vHIT interaural difference <0.3, and age >50 years old. Significant negative correlations with age were identified in the vHIT (p < 0.001) and rotary chair test (RCT) 1.0 Hz gain (p = 0.030). However, the caloric test (p = 0.739 and 0.745 on the left and right sides, respectively) and RCT 0.12 Hz gain (p = 0.298) did not show a significant correlation with age. A total of 4.83% of subjects aged 70 years or older showed sub-normal vHIT gain that met the criteria of PVP, whereas only 0.50% of subjects aged 60 to 69 did. The prevalence of sub-normal caloric test results, however, was not significantly different between the two age groups (21.55% in the 60-69 age group and 26.59% in the >70 age group). The high-frequency range vestibular function seems vulnerable to aging, and this is more discernible at age >70 years. The weak correlation between age and low-frequency vestibular function tests, such as the caloric test and low-frequency rotary chair testing, suggests the need to revisit the diagnostic criteria for PVP.