Abnormalities in white matter (WM) may be a crucial physiologic feature of Alzheimer's disease (AD). However, neuroimaging's ability to visualize the underlying functional degradation of the WM region in AD is unclear. This study aimed to explore the differences in amplitude of low-frequency fluctuation (ALFF) and fractional ALFF (fALFF) in the WM region of patients with AD and healthy controls (HC) and to investigate further whether these values can provide supplementary information for diagnosing AD. Forty-eight patients with AD and 46 age-matched HC were enrolled and underwent resting-state functional magnetic resonance imaging and a neuropsychological battery assessment. We analyzed the differences in WM activity between the two groups and further explored the correlation between WM activity in the different regions and cognitive function in the AD group. Finally, a machine learning algorithm was adopted to construct a classifier in detecting the clinical classification ability of the values of ALFF/ALFF in the WM. Compared with HCs, patients with AD had lower WM activity in the right anterior thalamic radiation, left frontal aslant tract, and left forceps minor, which are all positively related to global cognitive function, memory, and attention function (all p < 0.05). Based on the combined WM ALFF and fALFF characteristics in the different regions, individuals not previously assessed were classified with moderate accuracy (75%), sensitivity (71%), specificity (79%), and area under the receiver operating characteristic curve (85%). Our results suggest that WM activity is reduced in AD and can be used for disease classification.