This study aims to assess the relationship between computed tomography (CT) findings, during the acute phase of hospitalization, and long-term language impairment in people with traumatic brain injury (TBI). Another aim was to assess the receptive and expressive abilities of subjects with TBI based on the location of the injury. This is a retrospective observational study including 49 participants with TBI due to war injuries. The Arabic Diagnostic Aphasia Battery (A-DAB-1) was administered to the participants and the Helsinki CT score was computed to quantify brain damage. The results showed that the Helsinki CT score was negatively correlated with the total score of the A-DAB-1 (r = −0.544, p-value < 0.0001). Simple linear regression supported such findings and reflected an inversely proportional relationship between both variables (p-value < 0.0001). When compared with subjects having right hemisphere damage, subjects with left hemisphere and bilateral brain damage performed more poorly on language tasks respectively as follows: A-DAB-1 overall score (92.08-66.08-70.28, p-value = 0.021), Content of descriptive speech (9.57-6.69-7.22, p-value = 0.034), Verbal fluency (6.57-3.54-3.89, p-value = 0.002), Auditory comprehension (9.71-7.54-7.78, p-value = 0.039), Complex auditory commands (9.71-7.65-7.56, p-value = 0.043), Repetition (9.75-7.08-7.61, p-value = 0.036), Naming (9.93-7.15-8.11, p-value = 0.046). Following TBI, CT findings on admission can significantly predict long-term language abilities, with left side lesions inducing poorer outcomes.