Term congenital heart disease (CHD) neonates display abnormalities of brain structure and maturation, which are possibly related to underlying patient factors, abnormal physiology and perioperative insults. Our primary goal was to delineate associations between clinical factors and postnatal brain microstructure in term CHD neonates using diffusion tensor imaging (DTI) magnetic resonance (MR) acquisition combined with complementary data-driven connectome and seed-based tractography quantitative analyses. Our secondary goal was to delineate associations between mild dysplastic structural brain abnormalities and connectome and seed-base tractography quantitative analyses. These mild dysplastic structural abnormalities have been derived from prior human infant CHD MR studies and neonatal mouse models of CHD that were collectively used to calculate to calculate a brain dysplasia score (BDS) that included assessment of subcortical structures including the olfactory bulb, the cerebellum and the hippocampus. Neonates undergoing cardiac surgery for CHD were prospectively recruited from two large centers. Both pre- and postoperative MR brain scans were obtained. DTI in 42 directions was segmented into 90 regions using a neonatal brain template and three weighted methods. Clinical data collection included 18 patient-specific and 9 preoperative variables associated with preoperative scan and 6 intraoperative (e.g., cardiopulmonary bypass and deep hypothermic circulatory arrest times) and 12 postoperative variables associated with postoperative scan. We compared patient specific and preoperative clinical factors to network topology and tractography alterations on a preoperative neonatal brain MRI, and intra and postoperative clinical factors to network topology alterations on postoperative neonatal brain MRI. A composite BDS was created to score abnormal findings involving the cerebellar hemispheres and vermis, supratentorial extra-axial fluid, olfactory bulbs and sulci, hippocampus, choroid plexus, corpus callosum, and brainstem. The neuroimaging outcomes of this study included (1) connectome metrics: cost (number of connections) and global/nodal efficiency (network integration); (2) seed based tractography methods of fractional anisotropy (FA), radial diffusivity, and axial diffusivity. Statistics consisted of multiple regression with false discovery rate correction (FDR) comparing the clinical risk factors and BDS (including subcortical components) as predictors/exposures and the global connectome metrics, nodal efficiency, and seed based- tractography (FA, radial diffusivity, and axial diffusivity) as neuroimaging outcome measures. A total of 133 term neonates with complex CHD were prospectively enrolled and 110 had analyzable DTI. Multiple patient-specific factors including d-transposition of the great arteries (d-TGA) physiology and severity of impairment of fetal cerebral substrate delivery (i.e., how much the CHD lesion alters typical fetal circulation such that the highest oxygen and nutrient rich blood from the placenta are not directed toward the fetal brain) were predictive of preoperative reduced cost (p < 0.0073) and reduced global/nodal efficiency (p < 0.03). Cardiopulmonary bypass time predicted postoperative reduced cost (p < 0.04) and multiple postoperative factors [extracorporeal membrane oxygenation (ECMO), seizures and cardiopulmonary resuscitation (CPR)] were predictive of postoperative reduced cost and reduced global/nodal efficiency (p < 0.05). Anthropometric measurements (weight, length, and head size) predicted tractography outcomes. Total BDS was not predictive of brain network topology. However, key subcortical components of the BDS score did predict key global and nodal network topology: abnormalities of the cerebellum predicted reduced cost (p < 0.0417) and of the hippocampus predicted reduced global efficiency (p < 0.0126). All three subcortical structures predicted unique alterations of nodal efficiency (p < 0.05), including hippocampal abnormalities predicting widespread reduced nodal efficiency in all lobes of the brain, cerebellar abnormalities predicting increased prefrontal nodal efficiency, and olfactory bulb abnormalities predicting posterior parietal-occipital nodal efficiency. Patient-specific (d-TGA anatomy, preoperative impairment of fetal cerebral substrate delivery) and postoperative (e.g., seizures, need for ECMO, or CPR) clinical factors were most predictive of diffuse postnatal microstructural dysmaturation in term CHD neonates. Anthropometric measurements (weight, length, and head size) predicted tractography outcomes. In contrast, subcortical components (cerebellum, hippocampus, olfactory) of a structurally based BDS (derived from CHD mouse mutants), predicted more localized and regional postnatal microstructural differences. Collectively, these findings suggest that brain DTI connectome and seed-based tractography are complementary techniques which may facilitate deciphering the mechanistic relative contribution of clinical and genetic risk factors related to poor neurodevelopmental outcomes in CHD.