Objective. Medical imaging offered a non-invasive window to visualize tumors, with radiomics transforming these images into quantitative data for tumor phenotyping. However, the intricate web linking imaging features, clinical endpoints, and tumor biology was mostly uncharted. This study aimed to unravel the connections between CT imaging features and clinical characteristics, including tumor histopathological grading, clinical stage, and endocrine symptoms, alongside immunohistochemical markers of tumor cell growth, such as the Ki-67 index and nuclear mitosis rate. Approach. We conducted a retrospective analysis of data from 137 patients with pancreatic neuroendocrine tumors who had undergone contrast-enhanced CT scans across two institutions. Our study focused on three clinical factors: pathological grade, clinical stage, and endocrine symptom status, in addition to two immunohistochemical markers: the Ki-67 index and the rate of nuclear mitosis. We computed both predefined (2D and 3D) and learning-based features (via sparse autoencoder, or SAE) from the scans. To unearth the relationships between imaging features, clinical factors, and immunohistochemical markers, we employed the Spearman rank correlation along with the Benjamini-Hochberg method. Furthermore, we developed and validated radiomics signatures to foresee these clinical factors. Main results. The 3D imaging features showed the strongest relationships with clinical factors and immunohistochemical markers. For the association with pathological grade, the mean absolute value of the correlation coefficient (CC) of 2D, SAE, and 3D features was 0.3318 ± 0.1196, 0.2149 ± 0.0361, and 0.4189 ± 0.0882, respectively. While for the association with Ki-67 index and rate of nuclear mitosis, the 3D features also showed higher correlations, with CC as 0.4053 ± 0.0786 and 0.4061 ± 0.0806. In addition, the 3D feature-based signatures showed optimal performance in clinical factor prediction. Significance. We found relationships between imaging features, clinical factors, and immunohistochemical markers. The 3D features showed higher relationships with clinical factors and immunohistochemical markers.