Degraded sensory experience during critical periods of development can have adverse effects on brain function. In the auditory system, conductive hearing loss associated with childhood ear infections can produce long-lasting deficits in auditory perceptual acuity, much like amblyopia in the visual system. Here we explore the neural mechanisms that may underlie "amblyaudio" by inducing reversible monaural deprivation (MD) in infant, juvenile, and adult rats. MD distorted tonotopic maps, weakened the deprived ear's representation, strengthened the open ear's representation, and disrupted binaural integration of interaural level differences (ILD). Bidirectional plasticity effects were strictly governed by critical periods, were more strongly expressed in primary auditory cortex than inferior colliculus, and directly impacted neural coding accuracy. These findings highlight a remarkable degree of competitive plasticity between aural representations and suggest that the enduring perceptual sequelae of childhood hearing loss might be traced to maladaptive plasticity during critical periods of auditory cortex development.