Background/Objectives: This study explores the relationship between cognitive performance measured by the Symbol Digit Modality Test (SDMT) and the severity of self-reported head injury, traumatic brain injury (TBI), post-traumatic stress disorder (PTSD), depression, pain, and psychosocial dysfunction in a population of trauma-affected refugees. Refugees, especially those who have been subjected to torture, often face various difficulties, such as PTSD, depression and somatic disturbances (e.g., pain), which can significantly impact their day-to-day functioning. Methods: Participants included 141 adult refugees (38% women) with a mean age of 45.4 years (SD = 9.4) and 9.7 years (SD = 4.9) of education who were referred for treatment of post-traumatic distress to DIGNITY, Danish Institute Against Torture. Participants completed standardized self-report measures of PTSD, anxiety, depression, pain, and health-related disability and measures of trauma history, physical injuries including head injury and loss of consciousness, and the SDMT, a quick standardized performance-based measure of cognitive impairment. Results: Eighty-eight percent of participants evidenced signs of substantial cognitive impairment as indexed by lower SDMT scores. Those with a self-reported history of TBI, marked by loss of consciousness, exhibited lower SDMT scores and higher health-related disabilities. Severity of PTSD, depression, anxiety, and pain were highly correlated with lower SDMT scores. TBI history was not significantly associated with the severity of PTSD, depression, anxiety, or pain, suggesting a complex interplay among these factors. Conclusions: Cognitive impairments are prevalent in trauma-affected refugees, interacting with symptoms of post-traumatic stress and pain, likely explaining the high disability levels in this population. Further research should employ a broader range of cognitive measures and detailed investigations of head injury/TBI experiences to investigate their impact on overall functioning, treatment response, and longer-term outcomes. This study adds to a small but growing body of studies documenting cognitive impairments in trauma-affected refugees, highlighting the importance of addressing cognitive impairments in treatment for trauma-affected refugees, particularly those with histories of torture and TBI. Clinicians working with trauma-affected refugees should consider the assessment of cognitive difficulties as part of comprehensive care planning.