Correctly distinguishing between benign and malignant pulmonary nodules can avoid unnecessary invasive procedures. However, existing models exhibit a deficiency in the study of fat regions. We aim to create a multimodal deep learning nomogram (DLN) using pulmonary nodule and intrathoracic fat (ITF) features to distinguish between benign and malignant nodules and further demonstrate that intrathoracic fat can enhance the performance of lung cancer prediction models. A segmentation methodology was devised for precisely delineating intranodular and perinodular region (IPN). The Swin Transformer was used for feature extraction. The least absolute shrinkage and selection operator (LASSO) regression was employed for feature selection. The nomogram integrating IPN and ITF signatures revealed better diagnostic accuracy than IPN signature alone (net reclassification improvement = 0.134, P<0.05, and integrated discrimination improvement = 0.078, P<0.05). In the internal test cohort, DLN obtained an area under the curve (AUC) of 0.913 (95 % CI: 0.870, 0.952). In the external test cohort, the AUC was 0.906 (95 % CI: 0.867, 0.938). There was no significant difference between the calibrated curve and perfectly calibrated curve in all cohorts (P>0.05). Decision curve analysis showed that the DLN was clinically useful. The DLN demonstrated substantial diagnostic value for distinguishing between benign and malignant pulmonary nodules. The incorporation of the ITF signature has enhanced the performance of DLN.