Insulin resistance (IR) is of growing concern yet its association with white matter integrity remains controversial. We aimed to investigate the association between IR and white matter integrity in nondiabetic adults. This cross-sectional analysis was conducted based on the PolyvasculaR Evaluation for Cognitive Impairment and vaScular Events (PRECISE) study. A total of 1709 nondiabetic community-dwelling adults with available diffusion-weighted imaging based on brain magnetic resonance imaging and completed oral glucose tolerance test were included. IR was measured noninvasively by insulin sensitivity indices (ISI), including ISIcomposite and ISI0,120, as well as homeostasis model assessment of insulin resistance (HOMA-IR). White matter microstructure abnormalities were identified by diffusion-weighted imaging along with tract-based spatial statistical analysis to compare diffusion metrics between groups. The multivariable linear regression models were applied to measure the association between white matter microstructure abnormalities and IR. A total of 1709 nondiabetic individuals with a mean age of 60.8 ± 6.4 years and 54.1% female were included. We found that IR was associated with a significant increase in mean diffusivity, axial diffusivity, and radial diffusivity extensively in cerebral white matter in regions such as the anterior corona radiata, superior corona radiata, anterior limb of internal capsule, external capsule, and body of corpus callosum. The pattern of associations was more marked for ISIcomposite and ISI0,120. However, the effect of IR on white matter integrity was attenuated after, in addition, adjustment for history of hypertension and cardiovascular disease and antihypertensive medication use. Our findings indicate a significant association between IR and white matter microstructural abnormalities in nondiabetic middle-aged community residents, while these associations were greatly influenced by the history of hypertension and cardiovascular disease, and antihypertensive medication use. Further investigation is needed to clarify the role of IR in white matter integrity, whereas prophylactic strategies of maintaining a low IR status may ameliorate disturbances in white matter integrity. The data that support the findings of this study are available from the corresponding authors upon reasonable request.