Abstract Over the first years of life, the brain undergoes substantial organization in response to environmental stimulation. In a silent world, it may promote vision by 1) recruiting resources from the auditory cortex and 2) making the visual cortex more efficient. It is unclear when such changes occur and how adaptive they are, questions that children with cochlear implants can help address. Here, we examined 7 to 18 years old children: 50 had cochlear implants, with delayed or age-appropriate language abilities, and 25 had typical hearing and language. High-density electroencephalography and functional near-infrared spectroscopy were used to evaluate cortical responses to a low-level visual task. Evidence for a weaker visual cortex response and less synchronized or less inhibitory activity of auditory association areas in the implanted children with language delays suggests that cross-modal reorganization can be maladaptive and does not necessarily strengthen the dominant visual sense.