We investigated the association between amyloid-β deposition and white matter (WM) integrity as a determinant of brain glucose hypometabolism across the Alzheimer's disease (AD) spectrum. We assessed ninety-six subjects (27 cognitively normal, 49 mild cognitive impairment, and 20 AD dementia) who underwent [18F]FDG and [18F]Florbetapir positron emission tomography (PET) as well as magnetic resonance imaging (MRI) with diffusion tensor imaging. Among the regions with reduced fractional anisotropy (FA) in the AD group, we selected a voxel of interest in the angular bundle bilaterally for subsequent analyses. Using voxel-based interaction models at voxel level, we tested whether the regional hypometabolism is associated with FA in the angular bundle and regional amyloid-β deposition. In the AD patients, [18F]FDG hypometabolism in the striatum, mesiobasal temporal, orbitofrontal, precuneus, and cingulate cortices were associated with the interaction between high levels of [18F]Florbetapir standard uptake value ratios (SUVR) in these regions and low FA in the angular bundle. We found that the interaction between, rather than the independent effects of, high levels of amyloid-β deposition and WM integrity disruption determined limbic hypometabolism in patients with AD. This finding highlights a more integrative model for AD, where the interaction between partially independent processes determines the glucose hypometabolism.