Individuals born with very low birth weight (VLBW; < 1500 g) have a higher risk of reduced visual function and brain alterations. In a longitudinal cohort study, we assessed differences in visual outcomes and diffusion metrics from diffusion tensor imaging (DTI) at 3 tesla in the visual white matter pathway and primary visual cortex at age 26 in VLBW adults versus controls and explored whether DTI metrics at 26 years was associated with visual outcomes at 32 years. Thirty-three VLBW adults and 50 term-born controls was included in the study. Visual outcomes included best corrected visual acuity, contrast sensitivity, P100 latency, and retinal nerve fibre layer thickness. Mean diffusivity, axial diffusivity, radial diffusivity, and fractional anisotropy was extracted from seven regions of interest in the visual pathway: splenium, genu, and body of corpus callosum, optic radiations, lateral geniculate nucleus, inferior-fronto occipital fasciculus, and primary visual cortex. On average the VLBW group had lower contrast sensitivity, a thicker retinal nerve fibre layer and higher axial diffusivity and radial diffusivity in genu of corpus callosum and higher radial diffusivity in optic radiations than the control group. Higher fractional anisotropy in corpus callosum areas were associated with better visual function in the VLBW group but not the control group.