BACKGROUND AND OBJECTIVES: Bacterial brain abscesses may have long-term clinical consequences, eg, mental fatigue or epilepsy, but long-term structural consequences to the brain remain underexplored. We asked if brain abscesses damage brain activity long term, if the extent of such damage depends on the size of the abscess, and if the abscess capsule, which is often left in place during neurosurgery, remains a site of inflammation, which could explain long-lasting symptoms in patients with brain abscess. METHODS: 2-[18F]-fluoro-2-deoxy-D-glucose positron emission tomography/computed tomography (FDG-PET/CT), electroencephalography, and MRI were performed 2 days to 9 years after neurosurgery for bacterial brain abscess. RESULTS: FDG-PET/CT revealed hypometabolism in the neocortex or cerebellum overlying the previous bacterial abscess in 38 of 40 patients. The larger the abscess, the greater was the extent of the subsequent hypometabolism (r = 0.63; p = 3 × 10−5). In 9 patients, the extent of subsequent hypometabolism seemed to coincide with the extent of peri-abscess edema in the acute phase. Follow-up MRI after ≥1 year in 9 patients showed focal tissue loss and gliosis. In 13 patients with abnormal electroencephalography recordings, abnormalities extended beyond the cerebral lobe affected by the abscess, indicating damage to wider brain networks. The abscess capsule had an FDG signal indicating inflammation only during the first week after neurosurgical pus drainage. CONCLUSION: The bigger a brain abscess is allowed to grow, the more extensive is the long-term focal reduction in brain activity. This finding emphasizes the need for rapid neurosurgical intervention. The abscess capsule does not display long-lasting inflammation and probably does not explain long-term symptoms after brain abscess.