There is a lack of knowledge regarding the relationship between proneness to dimensional psychopathological syndromes and the underlying pathogenesis across major psychiatric disorders, i.e., Major Depressive Disorder (MDD), Bipolar Disorder (BD), Schizoaffective Disorder (SZA), and Schizophrenia (SZ). Lifetime psychopathology was assessed using the OPerational CRITeria (OPCRIT) system in 1,038 patients meeting DSM-IV-TR criteria for MDD, BD, SZ, or SZA. The cohort was split into two samples for exploratory and confirmatory factor analyses. All patients were scanned with 3-T MRI, and data was analyzed with the CAT-12 toolbox in SPM12. Psychopathological factor scores were correlated with gray matter volume (GMV) and cortical thickness (CT). Finally, factor scores were used for exploratory genetic analyses including genome-wide association studies (GWAS) and polygenic risk score (PRS) association analyses. Three factors (paranoid-hallucinatory syndrome, PHS; mania, MA; depression, DEP) were identified and cross-validated. PHS was negatively correlated with four GMV clusters comprising parts of the hippocampus, amygdala, angular, middle occipital, and middle frontal gyri. PHS was also negatively associated with the bilateral superior temporal, left parietal operculum, and right angular gyrus CT. No significant brain correlates were observed for the two other psychopathological factors. We identified genome-wide significant associations for MA and DEP. PRS for MDD and SZ showed a positive effect on PHS, while PRS for BD showed a positive effect on all three factors. This study investigated the relationship of lifetime psychopathological factors and brain morphometric and genetic markers. Results highlight the need for dimensional approaches, overcoming the limitations of the current psychiatric nosology.