Neurodevelopmental disabilities affect up to 50% of survivors of congenital heart disease (CHD). Language difficulties are frequently identified during preschool period and can lead to academic, social, behavioral, and emotional difficulties. Structural brain alterations are associated with poorer neurodevelopmental outcomes in patients with CHD during infancy, childhood, and adolescence. However, evidence is lacking about the functional brain activity in children with CHD and its relationship with neurodevelopment. This study therefore aimed to characterize brain responses during a passive story-listening task in 3-year-old children with CHD, and to investigate the relationship between functional brain patterns of language processing and neurodevelopmental outcomes. To do so, we assessed hemodynamic concentration changes, using functional near-infrared spectroscopy (fNIRS), and neurodevelopmental outcomes, using the Wechsler Preschool and Primary Scale of Intelligence – 4th Edition (WPPSI-IV), in children with CHD (n = 19) and healthy controls (n = 23). Compared to their healthy peers, children with CHD had significantly lower scores on the Verbal comprehension index (VCI), the Vocabulary acquisition index (VAI), the General ability index (GAI), and the Information and the Picture Naming subtests of the WPPSI-IV. During the passive story-listening task, healthy controls showed significant hemodynamic brain responses in the temporal and the temporal posterior regions, with stronger activation in the temporal posterior than in the temporal regions. In contrast, children with CHD showed reduced activation in the temporal posterior regions compared to controls, with no difference of activation between regions. Reduced brain responses in the temporal posterior regions were also correlated with lower neurodevelopmental outcomes in both groups. This is the first study that reveals reduced brain functional responses in preschoolers with CHD during a receptive language task. It also suggests that the temporal posterior activation could be a potential brain marker of cognitive development. These findings provide support for the feasibility of identifying brain correlates of neurodevelopmental vulnerabilities in children with CHD.