Robustness Of Radiomic Features Research Articles

External Validation of Robust Radiomic Signature to Predict 2-Year Overall Survival in Non-Small-Cell Lung Cancer

Lung cancer is the second most fatal disease worldwide. In the last few years, radiomics is being explored to develop prediction models for various clinical endpoints in lung cancer. However, the robustness of radiomic features is under question and has been identified as one of the roadblocks in the implementation of a radiomic-based prediction model in the clinic. Many past studies have suggested identifying the robust radiomic feature to develop a prediction model. In our earlier study, we identified robust radiomic features for prediction model development. The objective of this study was to develop and validate the robust radiomic signatures for predicting 2-year overall survival in non-small cell lung cancer (NSCLC). This retrospective study included a cohort of 300 stage I–IV NSCLC patients. Institutional 200 patients’ data were included for training and internal validation and 100 patients’ data from The Cancer Image Archive (TCIA) open-source image repository for external validation. Radiomic features were extracted from the CT images of both cohorts. The feature selection was performed using hierarchical clustering, a Chi-squared test, and recursive feature elimination (RFE). In total, six prediction models were developed using random forest (RF-Model-O, RF-Model-B), gradient boosting (GB-Model-O, GB-Model-B), and support vector(SV-Model-O, SV-Model-B) classifiers to predict 2-year overall survival (OS) on original data as well as balanced data. Model validation was performed using 10-fold cross-validation, internal validation, and external validation. Using a multistep feature selection method, the overall top 10 features were chosen. On internal validation, the two random forest models (RF-Model-O, RF-Model-B) displayed the highest accuracy; their scores on the original and balanced datasets were 0.81 and 0.77 respectively. During external validation, both the random forest models’ accuracy was 0.68. In our study, robust radiomic features showed promising predictive performance to predict 2-year overall survival in NSCLC.

Emerging role of quantitative imaging (radiomics) and artificial intelligence in precision oncology.

Cancer is a fatal disease and the second most cause of death worldwide. Treatment of cancer is a complex process and requires a multi-modality-based approach. Cancer detection and treatment starts with screening/diagnosis and continues till the patient is alive. Screening/diagnosis of the disease is the beginning of cancer management and continued with the staging of the disease, planning and delivery of treatment, treatment monitoring, and ongoing monitoring and follow-up. Imaging plays an important role in all stages of cancer management. Conventional oncology practice considers that all patients are similar in a disease type, whereas biomarkers subgroup the patients in a disease type which leads to the development of precision oncology. The utilization of the radiomic process has facilitated the advancement of diverse imaging biomarkers that find application in precision oncology. The role of imaging biomarkers and artificial intelligence (AI) in oncology has been investigated by many researchers in the past. The existing literature is suggestive of the increasing role of imaging biomarkers and AI in oncology. However, the stability of radiomic features has also been questioned. The radiomic community has recognized that the instability of radiomic features poses a danger to the global generalization of radiomic-based prediction models. In order to establish radiomic-based imaging biomarkers in oncology, the robustness of radiomic features needs to be established on a priority basis. This is because radiomic models developed in one institution frequently perform poorly in other institutions, most likely due to radiomic feature instability. To generalize radiomic-based prediction models in oncology, a number of initiatives, including Quantitative Imaging Network (QIN), Quantitative Imaging Biomarkers Alliance (QIBA), and Image Biomarker Standardisation Initiative (IBSI), have been launched to stabilize the radiomic features.

The impact of inter-observer variation in delineation on robustness of radiomics features in non-small cell lung cancer

Artificial intelligence and radiomics have the potential to revolutionise cancer prognostication and personalised treatment. Manual outlining of the tumour volume for extraction of radiomics features (RF) is a subjective process. This study investigates robustness of RF to inter-observer variation (IOV) in contouring in lung cancer. We utilised two public imaging datasets: ‘NSCLC-Radiomics’ and ‘NSCLC-Radiomics-Interobserver1’ (‘Interobserver’). For ‘NSCLC-Radiomics’, we created an additional set of manual contours for 92 patients, and for ‘Interobserver’, there were five manual and five semi-automated contours available for 20 patients. Dice coefficients (DC) were calculated for contours. 1113 RF were extracted including shape, first order and texture features. Intraclass correlation coefficient (ICC) was computed to assess robustness of RF to IOV. Cox regression analysis for overall survival (OS) was performed with a previously published radiomics signature. The median DC ranged from 0.81 (‘NSCLC-Radiomics’) to 0.85 (‘Interobserver’—semi-automated). The median ICC for the ‘NSCLC-Radiomics’, ‘Interobserver’ (manual) and ‘Interobserver’ (semi-automated) were 0.90, 0.88 and 0.93 respectively. The ICC varied by feature type and was lower for first order and gray level co-occurrence matrix (GLCM) features. Shape features had a lower median ICC in the ‘NSCLC-Radiomics’ dataset compared to the ‘Interobserver’ dataset. Survival analysis showed similar separation of curves for three of four RF apart from ‘original_shape_Compactness2’, a feature with low ICC (0.61). The majority of RF are robust to IOV, with first order, GLCM and shape features being the least robust. Semi-automated contouring improves feature stability. Decreased robustness of a feature is significant as it may impact upon the features’ prognostic capability.

Impact of Parallel Acquisition Technology on the Robustness of Magnetic Resonance Imaging Radiomic Features.

The aim of this study was to investigate the impact of integrated parallel acquisition technology (iPAT) on the robustness of magnetic resonance imaging radiomic features. A phantom and 6 healthy volunteers were scanned on a clinical 3-T system using T1-weighted (S1), T1-weighted fluid-attenuated (S2), T2-weighted fluid-attenuated (S3), and T2-weighted (S4); 2 iPAT flavors (generalized autocalibration partially parallel acquisitions and modified sensitivity encoding [mSENSE]) and their different acceleration factors R. Radiomic features were extracted, and their robustness was assessed using coefficient of variation (CV), and differences between sequences and region of interest (ROI) were evaluated using the χ2 test. One volunteer was excluded because of movement during imaging acquisition. Generalized autocalibration partially parallel acquisitions provided more radiomic features with excellent robustness than mSENSE. Radiomic features with excellent robustness, unaffected by iPAT across different sequences and ROIs, in 92 radiomic features for phantom and healthy volunteers are 6.5% and 2.2%. For phantom, difference in the robustness degree between 4 sequences/P-ROIs was significant according to χ2 test; S2 and S3 could provide more excellent robust radiomic features than S1 and S4, and P-ROI3 filled with the biggest polystyrene particles could provide the most radiomic features with excellent robustness than the other P-ROIs. For healthy volunteers, only the difference in the degree of robustness between the 4 V-ROIs was significant, and V-ROI3 in white matter region of the left frontal lobe, which was located at periphery in image, could provide the most robust radiomic features compared with other V-ROIs. Integrated parallel acquisition technology had a significant impact on the robustness of radiomic features. Generalized autocalibration partially parallel acquisitions delivered a more robust substrate for radiomic analyses than mSENSE.

Robustness of radiomic features in magnetic resonance imaging for patients with glioblastoma: Multi-center study.

Background and purposeRadiomics offers great potential in improving diagnosis and treatment for patients with glioblastoma multiforme. However, in order to implement radiomics in clinical routine, the features used for prognostic modelling need to be stable. This comprises significant challenge in multi-center studies. The aim of this study was to evaluate the impact of different image normalization methods on MRI features robustness in multi-center study.MethodsRadiomics stability was checked on magnetic resonance images of eleven patients. The images were acquired in two different hospitals using contrast-enhanced T1 sequences. The images were normalized using one of five investigated approaches including grey-level discretization, histogram matching and z-score. Then, radiomic features were extracted and features stability was evaluated using intra-class correlation coefficients. In the second part of the study, improvement in the prognostic performance of features was tested on 60 patients derived from publicly available dataset.ResultsDepending on the normalization scheme, the percentage of stable features varied from 3.4% to 8%. The histogram matching based on the tumor region showed the highest amount of the stable features (113/1404); while normalization using fixed bin size resulted in 48 stable features. The histogram matching also led to better prognostic value (median c-index increase of 0.065) comparing to non-normalized images.ConclusionsMRI normalization plays an important role in radiomics. Appropriate normalization helps to select robust features, which can be used for prognostic modelling in multicenter studies. In our study, histogram matching based on tumor region improved both stability of radiomic features and their prognostic value.

Impact of GAN-based lesion-focused medical image super-resolution on the robustness of radiomic features

Robust machine learning models based on radiomic features might allow for accurate diagnosis, prognosis, and medical decision-making. Unfortunately, the lack of standardized radiomic feature extraction has hampered their clinical use. Since the radiomic features tend to be affected by low voxel statistics in regions of interest, increasing the sample size would improve their robustness in clinical studies. Therefore, we propose a Generative Adversarial Network (GAN)-based lesion-focused framework for Computed Tomography (CT) image Super-Resolution (SR); for the lesion (i.e., cancer) patch-focused training, we incorporate Spatial Pyramid Pooling (SPP) into GAN-Constrained by the Identical, Residual, and Cycle Learning Ensemble (GAN-CIRCLE). At 2times SR, the proposed model achieved better perceptual quality with less blurring than the other considered state-of-the-art SR methods, while producing comparable results at 4times SR. We also evaluated the robustness of our model’s radiomic feature in terms of quantization on a different lung cancer CT dataset using Principal Component Analysis (PCA). Intriguingly, the most important radiomic features in our PCA-based analysis were the most robust features extracted on the GAN-super-resolved images. These achievements pave the way for the application of GAN-based image Super-Resolution techniques for studies of radiomics for robust biomarker discovery.

Prediction of Human Papillomavirus (HPV) Association of Oropharyngeal Cancer (OPC) Using Radiomics: The Impact of the Variation of CT Scanner.

Simple SummaryRecent studies exploring the application of radiomics features in medicine have shown promising results. However, variation in imaging parameters may impact the robustness of these features. Feature robustness may then in turn affect the prediction performance of the machine learning models built upon these features. While numerous studies have tested feature robustness against a variety of imaging parameters, the extent to which feature robustness affects predictions remains unclear. A particularly notable application of radiomics in clinical oncology is the prediction of Human Papillomavirus (HPV) association in Oropharyngeal cancer. In this study we explore how CT scanner type affects the performance of radiomics features for HPV association prediction and highlight the need to implement precautionary approaches so as to minimize this effect.Studies have shown that radiomic features are sensitive to the variability of imaging parameters (e.g., scanner models), and one of the major challenges in these studies lies in improving the robustness of quantitative features against the variations in imaging datasets from multi-center studies. Here, we assess the impact of scanner choice on computed tomography (CT)-derived radiomic features to predict the association of oropharyngeal squamous cell carcinoma with human papillomavirus (HPV). This experiment was performed on CT image datasets acquired from two different scanner manufacturers. We demonstrate strong scanner dependency by developing a machine learning model to classify HPV status from radiological images. These experiments reveal the effect of scanner manufacturer on the robustness of radiomic features, and the extent of this dependency is reflected in the performance of HPV prediction models. The results of this study highlight the importance of implementing an appropriate approach to reducing the impact of imaging parameters on radiomic features and consequently on the machine learning models, without removing features which are deemed non-robust but may contain learning information.

Robustness of radiomic features in CT images with different slice thickness, comparing liver tumour and muscle

Radiomic image features are becoming a promising non-invasive method to obtain quantitative measurements for tumour classification and therapy response assessment in oncological research. However, despite its increasingly established application, there is a need for standardisation criteria and further validation of feature robustness with respect to imaging acquisition parameters. In this paper, the robustness of radiomic features extracted from computed tomography (CT) images is evaluated for liver tumour and muscle, comparing the values of the features in images reconstructed with two different slice thicknesses of 2.0 mm and 5.0 mm. Novel approaches are presented to address the intrinsic dependencies of texture radiomic features, choosing the optimal number of grey levels and correcting for the dependency on volume. With the optimal values and corrections, feature values are compared across thicknesses to identify reproducible features. Normalisation using muscle regions is also described as an alternative approach. With either method, a large fraction of features (75–90%) was found to be highly robust (< 25% difference). The analyses were performed on a homogeneous CT dataset of 43 patients with hepatocellular carcinoma, and consistent results were obtained for both tumour and muscle tissue. Finally, recommended guidelines are included for radiomic studies using variable slice thickness.

Robustness of radiomic features in magnetic resonance imaging: review and a phantom study

Radiomic analysis has exponentially increased the amount of quantitative data that can be extracted from a single image. These imaging biomarkers can aid in the generation of prediction models aimed to further personalized medicine. However, the generalizability of the model is dependent on the robustness of these features. The purpose of this study is to review the current literature regarding robustness of radiomic features on magnetic resonance imaging. Additionally, a phantom study is performed to systematically evaluate the behavior of radiomic features under various conditions (signal to noise ratio, region of interest delineation, voxel size change and normalization methods) using intraclass correlation coefficients. The features extracted in this phantom study include first order, shape, gray level cooccurrence matrix and gray level run length matrix. Many features are found to be non-robust to changing parameters. Feature robustness assessment prior to feature selection, especially in the case of combining multi-institutional data, may be warranted. Further investigation is needed in this area of research.

CT radiomics and PET radiomics: ready for clinical implementation?

Today, rapid technical and clinical developments result in an increasing number of treatment options for oncological diseases. Thus, decision support systems are needed to offer the right treatment to the right patient. Imaging biomarkers hold great promise in patient-individual treatment guidance. Routinely performed for diagnosis and staging, imaging datasets are expected to hold more information than used in the clinical practice. Radiomics describes the extraction of a large number of meaningful quantitative features from medical images, such as computed tomography (CT) and positron emission tomography (PET). Due to the non-invasive nature and ability to capture 3D image-based heterogeneity, radiomic features are potential surrogate markers of the cancer phenotype. Several radiomic studies are published per day, owing to encouraging results of many radiomics-based patient outcome models. Despite this comparably large number of studies, radiomics is mainly studied in proof of principle concept. Hence, a translation of radiomics from a hot topic research field into an essential clinical decision-making tool is lacking, but of high clinical interest. Herein, we present a literature review addressing the clinical evidence of CT and PET radiomics. An extensive literature review was conducted in PubMed, including papers on robustness and clinical applications. We summarize image-modality related influences on the robustness of radiomic features and provide an overview of clinical evidence reported in the literature. Today, more evidence has been provided for CT imaging, however, PET imaging offers the promise of direct imaging of biological processes and functions. We provide a summary of future research directions, which needs to be addressed in order to successfully introduce radiomics into clinical medicine. In comparison to CT, more focus should be directed towards harmonization of PET acquisition and reconstruction protocols, which is important for transferable modelling. Both CT and PET radiomics are promising pre-treatment and intra-treatment biomarkers for outcome prediction. Most studies are performed in retrospective setting, however their validation in prospective data collections is ongoing.

Impact of different b-value combinations on radiomics features of apparent diffusion coefficient in cervical cancer.

Background The impact of variable b-value combinations on apparent diffusion coefficient (ADC)-based radiomics features has not been fully addressed in literature. Purpose To investigate the correlation between radiomics features extracted from ADC maps and various b-value combinations in cervical cancer. Material and Methods Diffusion-weighted images (b-values: 0, 600, 800, and 1000 s/mm2) of 20 patients with cervical cancer were included. Tumors were identified with the largest transversal cross-section and manually segmented by radiologist. For each b-value combination, 92 radiomics features were extracted and coefficient of variance (CV) was used to evaluate the robustness of radiomics features with different b-value combinations. Features with CV &gt; 5% were normalized by the mean feature variation across the group. Results Out of a total of 92 radiomics features, 18 were classified as robust features with CV ≤5%. Among the rest (CV &gt; 5%), 11, 23, and 40 features demonstrated 5%&lt; CV ≤10%, 10%&lt; CV ≤20%, and CV &gt; 20%, respectively. A subset of features in each category (CV &gt; 5%) showed strong correlation with the b-value combination variation, including 44% (7/16) features in gray level co-occurrence matrix, 62% (8/13) features in gray level dependence matrix, 64% (9/14) features in first order, 50% (8/16) features in gray level run length matrix, 57% (8/14) features in gray level size matrix, and 20% (1/5) features in neighborhood gray-tone difference matrix. Conclusions Variations in b-value combinations demonstrated impact on radiomics features extracted from ADC maps for cervical cancer. The radiomics features with CV &lt;5% can be considered as robust features and are recommended to be used in multicenter radiomics studies.