Image Classification Performance Research Articles

DMCCT: Dual-Branch Multi-Granularity Convolutional Cross-Substitution Transformer for Hyperspectral Image Classification

In the field of hyperspectral image classification, deep learning technology, especially convolutional neural networks, has achieved remarkable progress. However, convolutional neural network models encounter challenges in hyperspectral image classification due to limitations in their receptive fields. Conversely, the global modeling capability of Transformers has garnered attention in hyperspectral image classification. Nevertheless, the high computational cost and inadequate local feature extraction hinder its widespread application. In this study, we propose a novel fusion model of convolutional neural networks and Transformers to enhance performance in hyperspectral image classification, namely the dual-branch multi-granularity convolutional cross-substitution Transformer (DMCCT). The proposed model adopts a dual-branch structure to separately extract spatial and spectral features, thereby mitigating mutual interference and information loss between spectral and spatial data during feature extraction. Moreover, a multi-granularity embedding module is introduced to facilitate multi-scale and multi-level local feature extraction for spatial and spectral information. In particular, the improved convolutional cross-substitution Transformer module effectively integrates convolution and Transformer, reducing the complexity of attention operations and enhancing the accuracy of hyperspectral image classification tasks. Subsequently, the proposed method is evaluated against existing approaches using three classical datasets, namely Pavia University, Kennedy Space Center, and Indian Pines. Experimental results demonstrate the efficacy of the proposed method, achieving significant classification results on these datasets with overall classification accuracies of 98.57%, 97.96%, and 96.59%, respectively. These results establish the superiority of the proposed method in the context of hyperspectral image classification under similar experimental conditions.

Employing Different Algorithms of Lightweight Convolutional Neural Network Models in Image Distortion Classification

The majority of applications use automatic image recognition technologies to carry out a range of tasks. Therefore, it is crucial to identify and classify image distortions to improve image quality. Despite efforts in this area, there are still many challenges in accurately and reliably classifying distorted images. In this paper, we offer a comprehensive analysis of models of both non-lightweight and lightweight deep convolutional neural networks (CNNs) for the classification of distorted images. Subsequently, an effective method is proposed to enhance the overall performance of distortion image classification. This method involves selecting features from the pretrained models’ capabilities and using a strong classifier. The experiments utilized the kadid10k dataset to assess the effectiveness of the results. The K-nearest neighbor (KNN) classifier showed better performance than the naïve classifier in terms of accuracy, precision, error rate, recall and F1 score. Additionally, SqueezeNet outperformed other deep CNN models, both lightweight and non-lightweight, across every evaluation metric. The experimental results demonstrate that combining SqueezeNet with KNN can effectively and accurately classify distorted images into the correct categories. The proposed SqueezeNet-KNN method achieved an accuracy rate of 89%. As detailed in the results section, the proposed method outperforms state-of-the-art methods in accuracy, precision, error, recall, and F1 score measures.

Performance Optimization of Convolutional Neural Networks in Image Classification

With the development of deep learning, CNNs have become mainstream in image classification. However, CNN performance is affected by factors like loss function choice and optimization algorithm. This paper aims to improve CNN performance in image classification by optimizing SGD. Firstly, we analyze different loss functions and propose a suitable optimization strategy. Second, we explore SGD and its variants' roles in CNN training, focusing on accelerating convergence and improving accuracy. Experiments show the proposed scheme effectively enhances CNN performance, providing a reliable solution for image classification. This study supports CNN applications in image recognition and lays a foundation for exploring more efficient optimization methods.

Adaptive classification of artistic images using multi-scale convolutional neural networks

The current art image classification methods have low recall and accuracy rate issues . To improve the classification performance of art images, a new adaptive classification method is designed employing multi-scale convolutional neural networks (CNNs). Firstly, the multi-scale Retinex algorithm with color recovery is used to complete the enhancement processing of art images. Then the extreme pixel ratio is utilized to evaluate the image quality and obtain the art image that can be analyzed. Afterward, edge detection technology is implemented to extract the key features in the image and use them as initial values of the item to be trained in the classification model. Finally, a multi-scale convolutional neural network (CNN) is constructed by using extended convolutions, and the characteristics of each level network are set. The decision fusion method based on maximum output probability is employed to calculate different subclassifies’ probabilities and determine the final category of an input image to realize the art image adaptive classification. The experimental results show that the proposed method can effectively improve the recall rate and precision rate of art images and obtain reliable image classification results.

Multi-granularity self-attention mechanisms for few-shot Learning

Few-shot learning aims to classify novel data categories with limited labeled samples. Although metric-based meta-learning has shown better generalization ability as a few-shot classification method, it still faces challenges in handling data noise and maintaining inter-sample distance stability. To address these issues, our study proposes an innovative few-shot learning approach to enhance image features' global and local semantic representation. Initially, our method employs a multiscale residual module to facilitate extracting multi-granularity features within images. Subsequently, it optimizes the fusion of local and global features using the self- attention mechanism inherent in the Transformer module. Additionally, a weighted metric module is integrated to improve the model's resilience against noise interference. Empirical evaluations on CIFAR-FS and MiniImageNet few-shot datasets using 5-way 1-shot and 5-way 5-shot scenarios demonstrate the effectiveness of our approach in capturing multi-level and multi-granularity image representations. Compared to other methods, our method improves accuracy by 2.63% and 1.27% for 5-shot scenes on these two datasets. The experimental results validate the efficacy of our model in significantly enhancing few-shot image classification performance.

Fusion model of gray level co-occurrence matrix and convolutional neural network faced for histopathological images.

The image recognition of cancer cells plays an important role in diagnosing and treating cancer. Deep learning is suitable for classifying histopathological images and providing auxiliary technology for cancer diagnosis. The convolutional neural network is employed in the classification of histopathological images; however, the model's accuracy may decrease along with the increase in network layers. Extracting appropriate image features is helpful for image classification. In this paper, different features of histopathological images are represented by extracting features of the gray co-occurrence matrix. These features are recombined into a 16 × 16 × 3 matrix to form an artificial image. The original image and the artificial image are fused by summing the softmax output. The histopathological images are divided into the training set, validation set, and testing set. Each training dataset consists of 1500 images, while the validation dataset and test dataset each consist of 500 images. The results indicate that the effectiveness of our fusion model is demonstrated through significant improvements in accuracy, precision, recall, and F1-score, with an average accuracy reaching 99.31%. This approach not only enhances the classification performance of tissue pathology images but also holds promise for advancing computer-aided diagnosis in cancer pathology.

Supervised structure learning

This paper concerns structure learning or discovery of discrete generative models. It focuses on Bayesian model selection and the assimilation of training data or content, with a special emphasis on the order in which data are ingested. A key move—in the ensuing schemes—is to place priors on the selection of models, based upon expected free energy. In this setting, expected free energy reduces to a constrained mutual information, where the constraints inherit from priors over outcomes (i.e., preferred outcomes). The resulting scheme is first used to perform image classification on the MNIST dataset to illustrate the basic idea, and then tested on a more challenging problem of discovering models with dynamics, using a simple sprite-based visual disentanglement paradigm and the Tower of Hanoi (cf., blocks world) problem. In these examples, generative models are constructed autodidactically to recover (i.e., disentangle) the factorial structure of latent states—and their characteristic paths or dynamics.

Detection and diagnosis of diabetic eye diseases using two phase transfer learning approach.

Early diagnosis and treatment of diabetic eye disease (DED) improve prognosis and lessen the possibility of permanent vision loss. Screening of retinal fundus images is a significant process widely employed for diagnosing patients with DED or other eye problems. However, considerable time and effort are required to detect these images manually. Deep learning approaches in machine learning have attained superior performance for the binary classification of healthy and pathological retinal fundus images. In contrast, multi-class retinal eye disease classification is still a difficult task. Therefore, a two-phase transfer learning approach is developed in this research for automated classification and segmentation of multi-class DED pathologies. In the first step, a Modified ResNet-50 model pre-trained on the ImageNet dataset was transferred and learned to classify normal diabetic macular edema (DME), diabetic retinopathy, glaucoma, and cataracts. In the second step, the defective region of multiple eye diseases is segmented using the transfer learning-based DenseUNet model. From the publicly accessible dataset, the suggested model is assessed using several retinal fundus images. Our proposed model for multi-class classification achieves a maximum specificity of 99.73%, a sensitivity of 99.54%, and an accuracy of 99.67%.

Cross-Domain Image Classification via Multimodal Augmentations and Bacterial Foraging Optimization

Identification of diseases from body scans requires design of pre-processing, filtering, segmentation, feature representation, classification & post-processing operations. Existing deep learning-based classification models use context-specific segmentation followed by convolutions or transformer-based classification techniques. However, the majority of these models do not perform correlative analysis between different disease types. This limitation restricts their scalability and applicability in clinical scenarios. To address these limitations, this research work proposed IMAC-MOC, a model that integrates multimodal augmentations to enhance performance in cross-domain and multi-organ image classification. The proposed model initially collects large-scale scans at organ-level like MRI, CT scan, Kidney Scans, etc. and represents them via multimodal feature sets. These feature maps are combined and processed via a Bacterial Foraging Optimizer (BFO) which assists in identification of high variance inter-class feature sets.

Exploring the power of KANs: Overcoming MLP limitations in complex data analysis

In the field of artificial intelligence, the requirements of models that can adeptly explore informative features of complex data sets has led to the emergence of advanced neural network architectures. Beyond the perceptron-based architectures that are currently in widespread use, a variety of innovative and cutting-edge designs have been proposed. This paper thoroughly explores the critical role of Kolmogorov-Arnold Networks (KAN) in overcoming the limitations of traditional Multilayer Perceptron (MLP) models, particularly highlighting KANs significant advantages in handling complex nonlinear and high-dimensional data. By analyzing the mathematical foundations and neural network architecture of KAN, and comparing it with MLP, the paper demonstrates KANs outstanding performance in time series analysis and image classification. The research indicates that KAN has distinct advantages in addressing high-dimensional nonlinear data. The paper also summarizes the current research progress on KAN and discusses its enormous potential in future machine learning and real-world applications, pointing out possible future research directions.

A Dynamic Multi‐Output Convolutional Neural Network for Skin Lesion Classification

ABSTRACTSkin cancer is a pressing global health issue, with high incidence and mortality rates. Convolutional neural network (CNN) models have been proven to be effective in improving performance in skin lesion image classification and reducing the medical burden. However, the inherent class imbalance in training data caused by the difficulty of collecting dermoscopy images leads to categorical overfitting, which still limits the effectiveness of these data‐driven models in recognizing few‐shot categories. To address this challenge, we propose a dynamic multi‐output convolutional neural network (DMO‐CNN) model that incorporates exit nodes into the standard CNN structure and includes feature refinement layers (FRLs) and an adaptive output scheduling (AOS) module. This model improves feature representation ability through multi‐scale sub‐feature maps and reduces the inter‐layer dependencies during backpropagation. The FRLs ensure efficient and low‐loss down‐sampling, while the AOS module utilizes a trainable layer selection mechanism to refocus the model's attention on few‐shot lesion categories. Additionally, a novel correction factor loss is introduced to supervise and promote AOS convergence. Our evaluation of the DMO‐CNN model on the HAM10000 dataset demonstrates its effectiveness in multi‐class skin lesion classification and its superior performance in recognizing few‐shot categories. Despite utilizing a very simple VGG structure as the sole backbone structure, DMO‐CNN achieved impressive performance of 0.885 in BACC and 0.983 in weighted AUC. These results are comparable to those of the ensemble model that won the ISIC 2018 challenge, highlighting the strong potential of DMO‐CNN in dealing with few‐shot skin lesion data.

FBENet: Feature-Level Boosting Ensemble Network for Hashimoto's Thyroiditis Ultrasound Image Classification.

Distinguishing Hashimoto's thyroiditis (HT) lesions from ordinary thyroid tissues is difficult with ultrasound images. Challenges in achieving high performance of HT ultrasound image classification include the low resolution, blurred features and large area of irrelevant noise. To address these problems, we propose a Feature-level Boosting Ensemble Network (FBENet) for HT ultrasound image classification. Specifically, to capture the features of suspicious HT lesions efficiently, an Ensemble Feature Boosting Module (EFBM) is introduced into the feature-level ensemble to boost the blurred features. Then, the spatial attention mechanism is adopted in backbone models to improve the feature focusing performance and representation ability. Furthermore, feature-level ensemble technique is employed in the training process to achieve more comprehensive feature representation ability. Experimentally, FBENet was trained on 6,503 HT ultrasound images, and tested on 1,626 HT ultrasound images with 82.92% accuracy and 89.24% AUC on average.

Advanced Global Prototypical Segmentation Framework for Few-Shot Hyperspectral Image Classification.

With the advancement of deep learning, related networks have shown strong performance for Hyperspectral Image (HSI) classification. However, these methods face two main challenges in HSI classification: (1) the inability to capture global information of HSI due to the restriction of patch input and (2) insufficient utilization of information from limited labeled samples. To overcome these challenges, we propose an Advanced Global Prototypical Segmentation (AGPS) framework. Within the AGPS framework, we design a patch-free feature extractor segmentation network (SegNet) based on a fully convolutional network (FCN), which processes the entire HSI to capture global information. To enrich the global information extracted by SegNet, we propose a Fusion of Lateral Connection (FLC) structure that fuses the low-level detailed features of the encoder output with the high-level features of the decoder output. Additionally, we propose an Atrous Spatial Pyramid Pooling-Position Attention (ASPP-PA) module to capture multi-scale spatial positional information. Finally, to explore more valuable information from limited labeled samples, we propose an advanced global prototypical representation learning strategy. Building upon the dual constraints of the global prototypical representation learning strategy, we introduce supervised contrastive learning (CL), which optimizes our network with three different constraints. The experimental results of three public datasets demonstrate that our method outperforms the existing state-of-the-art methods.

Stochastic image spectroscopy: a discriminative generative approach to hyperspectral image modelling and classification

This paper introduces a new latent variable probabilistic framework for representing spectral data of high spatial and spectral dimensionality, such as hyperspectral images. We use a generative Bayesian model to represent the image formation process and provide interpretable and efficient inference and learning methods. Surprisingly, our approach can be implemented with simple tools and does not require extensive training data, detailed pixel-by-pixel labeling, or significant computational resources. Numerous experiments with simulated data and real benchmark scenarios show encouraging image classification performance. These results validate the unique ability of our framework to discriminate complex hyperspectral images, irrespective of the presence of highly discriminative spectral signatures.

Unsupervised Object Cosegmentation Method Devoted to Image Classification

Rich heterogeneous data provided by social networks can be very big, which imposes considerable challenges for object extraction and image classification. Therefore, the objective of this work is to propose an unsupervised object cosegmentation method that could be notably efficient to improve image classification performance. The main goal of cosegmentation is to extract the salient common objects within each image. To this end, we propose to minimize an energy function based on the Markov Random Field using the saliency detection, while considering linear dependence of generated foreground histograms of the input image collection. In fact, the saliency detection is processed in two steps. In each image, we detect salient objects, by considering appearance similarity and spatial distributions of image pixels. Then, fuzzy quantification is used to correct the belonging of pixels to the foreground objects. Finally, an iterative optimization permits to enhance the final segmentation results. The proposed method has been validated as a preprocessing step for image classification. Indeed, to enhance cosegmentation-based classification performance, we have applied a semi-supervised object classification based on ensemble projection. Qualitative and quantitative evaluations of the proposed cosegmentation and classification techniques on the iCoseg, CDS and Oxford Flowers 17 datasets demonstrate the effectiveness of the proposed framework.

Implicit Sharpness-Aware Minimization for Domain Generalization

Domain generalization (DG) aims to learn knowledge from multiple related domains to achieve a robust generalization performance in unseen target domains, which is an effective approach to mitigate domain shift in remote sensing image classification. Although the sharpness-aware minimization (SAM) method enhances DG capability and improves remote sensing image classification performance by promoting the convergence of the loss minimum to a flatter loss surface, the perturbation loss (maximum loss within the neighborhood of a local minimum) of SAM fails to accurately measure the true sharpness of the loss landscape. Furthermore, its variants often overlook gradient conflicts, thereby limiting further improvement in DG performance. In this paper, we introduce implicit sharpness-aware minimization (ISAM), a novel method that addresses the deficiencies of SAM and mitigates gradient conflicts. Specifically, we demonstrate that the discrepancy in training loss during gradient ascent or descent serves as an equivalent measure of the dominant eigenvalue of the Hessian matrix. This discrepancy provides a reliable measure for sharpness. ISAM effectively reduces sharpness and mitigates potential conflicts between gradients by implicitly minimizing the discrepancy between training losses while ensuring a sufficiently low minimum through minimizing perturbation loss. Extensive experiments and analyses demonstrate that ISAM significantly enhances the model’s generalization ability on remote sensing and DG datasets, outperforming existing state-of-the-art methods.

C3NN: Cosmological Correlator Convolutional Neural Network an Interpretable Machine-learning Framework for Cosmological Analyses

Modern cosmological research in large-scale structure has witnessed an increasing number of machine-learning applications. Among them, convolutional neural networks (CNNs) have received substantial attention due to their outstanding performance in image classification, cosmological parameter inference, and various other tasks. However, many models based on CNNs are criticized as “black boxes” due to the difficulties in relating their outputs intuitively and quantitatively to the cosmological fields under investigation. To overcome this challenge, we present the Cosmological Correlator Convolutional Neural Network (C3NN)—a fusion of CNN architecture and cosmological N-point correlation functions (NPCFs). We demonstrate that its output can be expressed explicitly in terms of the analytically tractable NPCFs. Together with other auxiliary algorithms, we can open the “black box” by quantitatively ranking different orders of the interpretable outputs based on their contribution to classification tasks. As a proof of concept, we demonstrate this by applying our framework to a series of binary classification tasks using Gaussian and log-normal random fields and relating its outputs to the NPCFs describing the two fields. Furthermore, we exhibit the model’s ability to distinguish different dark energy scenarios (w 0 = −0.95 and −1.05) using N-body simulated weak-lensing convergence maps and discuss the physical implications coming from their interpretability. With these tests, we show that C3NN combines advanced aspects of machine learning architectures with the framework of cosmological NPCFs, thereby making it an exciting tool to extract physical insights in a robust and explainable way from observational data.

Output Regularization With Cluster-Based Soft Targets.

While supervised learning of over-parameterized neural networks achieved state-of-the-art performance in image classification, it tends to over-fit the labeled training samples to give inferior generalization ability. Output regularization deals with over-fitting by using soft targets as additional training signals. Although clustering is one of the most fundamental data analysis tools for discovering general-purpose and data-driven structures, it has been ignored in existing output regularization approaches. In this article, we leverage this underlying structural information by proposing Cluster-based soft targets for Output Regularization (CluOReg). This approach provides a unified way for simultaneous clustering in embedding space and neural classifier training with cluster-based soft targets via output regularization. By explicitly calculating a class relationship matrix in the cluster space, we obtain classwise soft targets shared by all samples in each class. Results of image classification experiments under various settings on a number of benchmark datasets are provided. Without resorting to external models or designed data augmentation, we get consistent and significant reductions in classification error compared with other approaches, demonstrating that cluster-based soft targets effectively complement the ground-truth label.

A mutual reconstruction network model for few-shot classification of histological images: addressing interclass similarity and intraclass diversity.

The automated classification of histological images is crucial for the diagnosis of cancer. The limited availability of well-annotated datasets, especially for rare cancers, poses a significant challenge for deep learning methods due to the small number of relevant images. This has led to the development of few-shot learning approaches, which bear considerable clinical importance, as they are designed to overcome the challenges of data scarcity in deep learning for histological image classification. Traditional methods often ignore the challenges of intraclass diversity and interclass similarities in histological images. To address this, we propose a novel mutual reconstruction network model, aimed at meeting these challenges and improving the few-shot classification performance of histological images. The key to our approach is the extraction of subtle and discriminative features. We introduce a feature enhancement module (FEM) and a mutual reconstruction module to increase differences between classes while reducing variance within classes. First, we extract features of support and query images using a feature extractor. These features are then processed by the FEM, which uses a self-attention mechanism for self-reconstruction of features, enhancing the learning of detailed features. These enhanced features are then input into the mutual reconstruction module. This module uses enhanced support features to reconstruct enhanced query features and vice versa. The classification of query samples is based on weighted calculations of the distances between query features and reconstructed query features and between support features and reconstructed support features. We extensively evaluated our model using a specially created few-shot histological image dataset. The results showed that in a 5-way 10-shot setup, our model achieved an impressive accuracy of 92.09%. This is a 23.59% improvement in accuracy compared to the model-agnostic meta-learning (MAML) method, which does not focus on fine-grained attributes. In the more challenging, 5-way 1-shot setting, our model also performed well, demonstrating a 18.52% improvement over the ProtoNet, which does not address this challenge. Additional ablation studies indicated the effectiveness and complementary nature of each module and confirmed our method's ability to parse small differences between classes and large variations within classes in histological images. These findings strongly support the superiority of our proposed method in the few-shot classification of histological images. The mutual reconstruction network provides outstanding performance in the few-shot classification of histological images, successfully overcoming the challenges of similarities between classes and diversity within classes. This marks a significant advancement in the automated classification of histological images.

Machine learning for predicting cognitive decline within five years in Parkinson's disease: Comparing cognitive assessment scales with DAT SPECT and clinical biomarkers.

Parkinson's disease (PD) is an age-related neurodegenerative condition characterized mostly by motor symptoms. Although a wide range of non-motor symptoms (NMS) are frequently experienced by PD patients. One of the important and common NMS is cognitive impairment, which is measured using different cognitive scales. Monitoring cognitive impairment and its decline in PD is essential for patient care and management. In this study, our goal is to identify the most effective cognitive scale in predicting cognitive decline over a 5-year timeframe initializing clinical biomarkers and DAT SPECT. Machine Learning has previously shown superior performance in image and clinical data classification and detection. In this study, we propose to use machine learning with different types of data, such as DAT SPECT and clinical biomarkers, to predict PD-CD based on various cognitive scales. We collected 330 DAT SPECT images and their clinical data in baseline, years 2,3,4, and 5 from Parkinson's Progression Markers Initiative (PPMI). We then designed a 3D Autoencoder to extract deep radiomic features (DF) from DAT SPECT images, and we then concatenated it with 17 clinical features (CF) to predict cognitive decline based on Montreal Cognitive Assessment (MoCA) and The Movement Disorder Society-Unified Parkinson's Disease Rating Scale (MDS-UPDRS-I). The utilization of MoCA as a cognitive decline scale yielded better performance in various years compared to MDS-UPDRS-I. In year 4, the application of the deep radiomic feature resulted in the highest achievement, with a cross-validation AUC of 89.28, utilizing the gradient boosting classifier. For the MDS-UPDRS-I scale, the highest achievement was obtained by utilizing the deep radiomic feature, resulting in a cross-validation AUC of 81.34 with the random forest classifier. The study findings indicate that the MoCA scale may be a more effective predictor of cognitive decline within 5 years compared to MDS-UPDRS-I. Furthermore, deep radiomic features had better performance compared to sole clinical biomarkers or clinical and deep radiomic combined. These results suggest that using the MoCA score and deep radiomic features extracted from DAT SPECT could be a promising approach for identifying individuals at risk for cognitive decline in four years. Future research is needed to validate these findings and explore their utility in clinical practice.