3D Gray Level Co-occurrence Matrix Research Articles

Tumor classification algorithm via parallel collaborative optimization of single- and multi-objective consistency on PET/CT

Malignant tumors still have a high incidence and mortality rate worldwide. Pathological examination remains the clinical gold standard for tumor diagnosis. However, some patients cannot undergo pathological examination due to advanced age and special lesion location. Therefore, making full use of PET/CT to assist doctors in tumor classification has important clinical significance. Since category labels are calibrated according to pathological images, it is difficult to obtain effective pathological category features directly using PET-CT image modeling. In response to this problem, this paper proposes a novel tumor classification algorithm. This method fully utilizes multi-gray-level 3D gray-level co-occurrence matrix and the proposed rough and fine constraint network under the constraint loss of rough and fine labels. Based on single- and multi-objective consistency, a parallel collaborative optimization method is proposed, including category consistency loss and feature specificity loss. To reduce the interference of redundant features, an improved Boruta feature selection method using multiple classifiers and multiple steps is proposed. The final result is obtained through a conditional weighted voting function. The proposed method shows excellent performance in both the submodels and the fusion model. We validated the proposed tumor classification method on three datasets and achieved good performance with the accuracy of 0.80–0.85 and F1-score of 0.78–0.88. The results indicate that the proposed method has good performance and generalization ability.

Label-free identification of human coronary atherosclerotic plaque based on a three-dimensional quantitative assessment of multiphoton microscopy images.

The rupture of coronary atherosclerotic plaque (CAP) and the resulting intracoronary thrombosis account for most acute coronary syndromes. Thus, the early identification and risk assessment of CAP is crucial for timely medical intervention. In this study, we propose a quantitative and label-free method for human CAP identification using multiphoton microscopy (MPM) and three-dimensional (3D) image analysis techniques. By detecting the intrinsic MPM signals, the microstructures of collagen and elastin fibers within normal and CAP-lesioned human coronary artery walls were imaged. Using a 3D gray level co-occurrence matrix method and 3D weighted vector summation algorithm, quantitative indicators that characterize the spatial texture and orientation features of the fibers were extracted. We demonstrate that these indicators show superior accuracy and repeatability over 2D texture features in CAP discrimination. Furthermore, by combining the 3D microstructural indicators, a support vector machine model that classifies CAP from the normal arterial wall with an accuracy of >97% was established. In conjunction with advances in multiphoton endoscopy, the proposed method shows great potential in providing a quantitative, label-free, and real-time tool for the early identification and risk assessment of CAP in the future.

3D gray level co-occurrence matrix and its application to identifying collapsed buildings

With the remarkable progress in access to remote sensing imagery data, nowadays research very often utilizes more than one image. We are often able to use multitemporal, hyperspectral, and/or full polarization of microwave radar images. In addition, it has become the general consensus that texture analysis plays an important role in remote sensing. It has been found in several publications that texture analysis was applied to each layer separately; however, this procedure requires a significant amount of computation and produces a massive volume of data. One alternative, and perhaps a better procedure, is to arrange the images into a multi-layered structure and perform texture analysis within some sort of three-dimensional domain. This manuscript extends the concepts of the gray level of co-occurrence matrix (GLCM) texture analysis applied for a single image to a multi-layered set of images, referred to in this paper as 3DGLCM. We then presented an interpretation of the 3DGLCM within the context of building damage identification. A set of 3DGLCM-based features were computed and evaluated as well. As a result, it was observed that some texture features have certain similarities with other methods proposed in previous studies, whereas other features have not been used before. Furthermore, this paper evaluates the performance of the Support Vector Machine (SVM) classifier in learning and detecting collapsed buildings using 3DGLCM-based features. Thus, the empirical evaluation focuses on the identification of collapsed buildings caused by the 2011 Tohoku earthquake and tsunami, where individual polarized TerraSAR-X intensity images are used to compute the texture features, and the collapsed buildings caused by the 2016 Kumamoto earthquake, where LIDAR-based digital surface models are used to compute the texture features. Extensive datasets consisting of building damage states that have been visually inspected by local authorities and research teams are used to set up the training and testing subsets. Furthermore, the proposed texture features are compared with features commonly used to identify collapsed buildings. The study concludes that an SVM trained with 3DGLCM-based features identifies collapsed buildings with high accuracy and outperforms an SVM trained with common features used in previous studies.

PS02.210: EVALUATION OF PREDICTION SYSTEM IN TREATMENT EFFECT AND PROGNOSIS OF ESOPHAGEAL CANCER BASED ON RADIOEPIGENOMICS THEORY

Abstract Background We tried integrated analysis of epigenomic information (Epigenomics) and image information (Radiomics) as Ragioepigenomics for esophageal cancer. Methods 1, Expression analysis of miR, evaluation as prognostic predictor (Epigenomics), 2, Image information analysis (Radiomics): a, Normalization of contrast CT images, feature quantities by 3D gray level co-occurrence matrix extraction. b, Normalization of SUV of FDG-PET image. Extraction of feature quantity by 3D gray level co-occurrence matrix. c, Image analysis of features. 3, Integrated analysis of Epigenomics and Radiomics information: We analyzed the relationship between miR expression level and variables obtained from image analysis. Results As a result of Cox regression by the selection method using elastic net, three variables were selected from contrast CT, and the results of both were consistent. Furthermore, when the survival curve and the log rank test were performed by the Kaplan-Meier method for the cluster shade high value group and the low value group, a significant difference was observed in the 2 groups. Conclusion A multimodal approach so called Radioepigenomics, which is a system for analyzing molecular information from image analysis will be applied to future Precision Medicine. Disclosure All authors have declared no conflicts of interest.

Non-rigid registration of multi-phase liver CT data using fully automated landmark detection and TPS deformation

In case of the complicated anatomical structure of the liver, landmark points on a three dimensional (3D) liver surface is hardly distinguished as corresponding pairs visually and automated landmark placing will be extremely time saving for liver registration. This paper presents a fully automated landmark detection method to register livers on multi-phase computed tomography (CT) images. Edge texture features and Support Vector Machine (SVM) are applied to detect the discriminated landmarks of the liver, including both surface and internal points. Using the information of liver shape, 3D gray level co-occurrence matrix is calculated into texture features, from which the most informatics there features are selected by our optimization algorithm for choosing a sub-set of features from a high dimensional feature set. Then automated landmarks detection begins at scanning surface points on the pre-contrast and portal venous phase images, where positive outputs of the SVM classifier are regarded as initial candidates and final candidates are obtained by eliminating false positives (FPs). Finally, relied on the detected landmarks, thin plate splines (TPS) algorithm is used to register livers. Five surface landmarks, together with internal landmarks of the liver center from every 25 mm slice interval, can be detected automatically with sensitivity of 88.33% and accuracy of 98.5%. Surface-based mean error (SME) is decreased from 3.80 to 2.87 mm on average, while SME value has increased 32.4 and 8.0% on average respectively when comparing with the rigid and B-spline methods. The results demonstrate that edge textures and SVM classifier are effective in the automated landmark detection. Together with TPS algorithm, fully automated liver registration is able to be achieved on multi-phase CT images.

SU-F-R-20: Image Texture Features Correlate with Time to Local Failure in Lung SBRT Patients

Purpose: To explore possible correlation between CT image-based texture and histogram features and time-to-local-failure in early stage non-small cell lung cancer (NSCLC) patients treated with stereotactic body radiotherapy (SBRT).Methods and Materials: From an IRB-approved lung SBRT registry for patients treated between 2009–2013 we selected 48 (20 male, 28 female) patients with local failure. Median patient age was 72.3±10.3 years. Mean time to local failure was 15 ± 7.1 months. Physician-contoured gross tumor volumes (GTV) on the planning CT images were processed and 3D gray-level co-occurrence matrix (GLCM) based texture and histogram features were calculated in Matlab. Data were exported to R and a multiple linear regression model was used to examine the relationship between texture features and time-to-local-failure. Results: Multiple linear regression revealed that entropy (p=0.0233, multiple R2=0.60) from GLCM-based texture analysis and the standard deviation (p=0.0194, multiple R2=0.60) from the histogram-based features were statistically significantly correlated with the time-to-local-failure. Conclusion: Image-based texture analysis can be used to predict certain aspects of treatment outcomes of NSCLC patients treated with SBRT. We found entropy and standard deviation calculated for the GTV on the CT images displayed a statistically significant correlation with and time-to-local-failure in lung SBRT patients.

3D Gray Level Co-Occurrence Matrix Based Classification of Favor Benign and Borderline Types in Follicular Neoplasm Images

Since the efficiency of treatment of thyroid disorder depends on the risk of malignancy, indeterminate follicular neoplasm (FN) images should be classified. The diagnosis process has been done by visual interpretation of experienced pathologists. However, it is difficult to separate the favor benign from borderline types. Thus, this paper presents a classification approach based on 3D nuclei model to classify favor benign and borderline types of follicular thyroid adenoma (FTA) in cytological specimens. The proposed method utilized 3D gray level co-occurrence matrix (GLCM) and random forest classifier. It was applied to 22 data sets of FN images. Furthermore, the use of 3D GLCM was compared with 2D GLCM to evaluate the classification results. From experimental results, the proposed system achieved 95.45% of the classification. The use of 3D GLCM was better than 2D GLCM according to the accuracy of classification. Consequently, the proposed method probably helps a pathologist as a prescreening tool.

3D texture analysis in renal cell carcinoma tissue image grading.

One of the most significant processes in cancer cell and tissue image analysis is the efficient extraction of features for grading purposes. This research applied two types of three-dimensional texture analysis methods to the extraction of feature values from renal cell carcinoma tissue images, and then evaluated the validity of the methods statistically through grade classification. First, we used a confocal laser scanning microscope to obtain image slices of four grades of renal cell carcinoma, which were then reconstructed into 3D volumes. Next, we extracted quantitative values using a 3D gray level cooccurrence matrix (GLCM) and a 3D wavelet based on two types of basis functions. To evaluate their validity, we predefined 6 different statistical classifiers and applied these to the extracted feature sets. In the grade classification results, 3D Haar wavelet texture features combined with principal component analysis showed the best discrimination results. Classification using 3D wavelet texture features was significantly better than 3D GLCM, suggesting that the former has potential for use in a computer-based grading system.

Parametrization of textural patterns in123I-ioflupane imaging for the automatic detection of Parkinsonism

A novel approach to a computer aided diagnosis system for the Parkinson's disease is proposed. This tool is intended as a supporting tool for physicians, based on fully automated methods that lead to the classification of (123)I-ioflupane SPECT images. (123)I-ioflupane images from three different databases are used to train the system. The images are intensity and spatially normalized, then subimages are extracted and a 3D gray-level co-occurrence matrix is computed over these subimages, allowing the characterization of the texture using Haralick texture features. Finally, different discrimination estimation methods are used to select a feature vector that can be used to train and test the classifier. Using the leave-one-out cross-validation technique over these three databases, the system achieves results up to a 97.4% of accuracy, and 99.1% of sensitivity, with positive likelihood ratios over 27. The system presents a robust feature extraction method that helps physicians in the diagnosis task by providing objective, operator-independent textural information about (123)I-ioflupane images, commonly used in the diagnosis of the Parkinson's disease. Textural features computation has been optimized by using a subimage selection algorithm, and the discrimination estimation methods used here makes the system feature-independent, allowing us to extend it to other databases and diseases.

Texture analysis of ultrahigh field T2*‐weighted MR images of the brain: Application to Huntington's disease

To develop a framework for quantitative detection of between-group textural differences in ultrahigh field T2*-weighted MR images of the brain. MR images were acquired using a three-dimensional (3D) T2*-weighted gradient echo sequence on a 7 Tesla MRI system. The phase images were high-pass filtered to remove phase wraps. Thirteen textural features were computed for both the magnitude and phase images of a region of interest based on 3D Gray-Level Co-occurrence Matrix, and subsequently evaluated to detect between-group differences using a Mann-Whitney U-test. We applied the framework to study textural differences in subcortical structures between premanifest Huntington's disease (HD), manifest HD patients, and controls. In premanifest HD, four phase-based features showed a difference in the caudate nucleus. In manifest HD, 7 magnitude-based features showed a difference in the pallidum, 6 phase-based features in the caudate nucleus, and 10 phase-based features in the putamen. After multiple comparison correction, significant differences were shown in the putamen in manifest HD by two phase-based features (both adjusted P values=0.04). This study provides the first evidence of textural heterogeneity of subcortical structures in HD. Texture analysis of ultrahigh field T2*-weighted MR images can be useful for noninvasive monitoring of neurodegenerative diseases.

자궁경부암 진단을 위한 3차원 세포핵 질감 특성값 유의성 평가에 관한 연구

본 연구의 목적은 세포핵의 3차원 염색질 질감 특성값이 암의 진행정도를 인식하는데 있어 유용한 특성값인지 평가하는데 있다. 특히, 제안한 방법이 악성이라고 진단된 세포진 도말 표본에서 정상으로 보이는 세포의 염색질 패턴에서의 미세한 차이를 인식할 수 있는지 살펴보고자 한다. 분류등급 정상(Normal), 저등급 편평 상피내 병변(LSIL, Low grade Squamous Intraepithelial Lesion), 고등급 편평 상피내 병변(HSIL, High grade Squamous Intraepithelial Lesion)에서 각각 100개씩의 세포 볼륨데이터로부터 3차원 GLCM(Gray Level Co occurrence Matrix)에 기반한 질감 특성값과 3차원 Wavelet 변환에 기반한 질감 특성값을 추출하고 분류기를 생성한 후 각 분류기에 대한 분류정확도를 비교하였으며, 2차원 세포진 영상에서의 세포핵 질감 특성값과 비교하기 위해 동일한 실험 볼륨데이터의 투영된 2차원 영상을 이용하여 같은 방법으로 2차원 세포핵 질감 특성값을 추출하고 분류기를 생성한 후 분류정확도를 비교하였다. 2차원 세포핵 질감 특성값과의 비교연구에서 3차원 세포핵 질감 특성값이 등급별 분류에 있어 보다 효율적인 것을 확인 할 수 있었으며 이는 3차원 염색질 질감 특성값이 자궁경부 세포의 정량화에 대한 정확성과 재현성을 개선할 수 있음을 의미한다. The aim of this study is to evaluate whether 3D nuclear chromatin texture features are significant in recognizing the progression of cervical cancer. In particular, we assessed that our method could detect subtle differences in the chromatin pattern of seemingly normal cells on specimens with malignancy. We extracted nuclear texture features based on 3D GLCM(Gray Level Co occurrence Matrix) and 3D Wavelet transform from 100 cell volume data for each group (Normal, LSIL and HSIL). To evaluate the feasibility of 3D chromatin texture analysis, we compared the correct classification rate for each of the classifiers using them. In addition to this, we compared the correct classification rates for the classifiers using the proposed 3D nuclear texture features and the 2D nuclear texture features which were extracted in the same way. The results showed that the classifier using the 3D nuclear texture features provided better results. This means our method could improve the accuracy and reproducibility of quantification of cervical cell.