Networks For Image Classification Research Articles

Improving Computer-Aided Medical Diagnosis Using Generative Adversarial Networks for Carotid Artery Ultrasound Image Data Augmentation and Classification

Cardiovascular diseases are a leading cause of death globally, making early detection of atherosclerosis critical for prevention. Carotid artery ultrasound imaging is a common diagnostic tool; however, the limited availability of labelled medical images hinders the training of deep learning models. This study examines generative adversarial networks (GANs) for data augmentation and classification of carotid artery Doppler images to improve computer-aided medical diagnosis. Four convolutional neural networks (CNNs) – AlexNet, VGGNet, GoogleNet, and CifarNet – are evaluated for their classification performance on original and extended datasets. AlexNet outperforms the other models, achieving a classification accuracy of 94.18% on the extended dataset. The GAN implementation for data augmentation and overfitting reduction demonstrates the potential of generative models in enhancing the performance of deep learning models in medical image analysis, particularly in the "common artery carotid" class. This research contributes to understanding GANs as a valuable tool for data augmentation and classification in the context of carotid artery ultrasound images.

MBSI-Net: Multimodal Balanced Self-Learning Interaction Network for Image Classification

MBSI-Net: Multimodal Balanced Self-Learning Interaction Network for Image Classification

A novel multi-task learning network for skin lesion classification based on multi-modal clues and label-level fusion

In this paper, we propose a multi-task learning (MTL) network based on the label-level fusion of metadata and hand-crafted features by unsupervised clustering to generate new clustering labels as an optimization goal. We propose a MTL module (MTLM) that incorporates an attention mechanism to enable the model to learn more integrated, variable information. We propose a dynamic strategy to adjust the loss weights of different tasks, and trade off the contributions of multiple branches. Instead of feature-level fusion, we propose label-level fusion and combine the results of our proposed MTLM with the results of the image classification network to achieve better lesion prediction on multiple dermatological datasets. We verify the effectiveness of the proposed model by quantitative and qualitative measures. The MTL network using multi-modal clues and label-level fusion can yield the significant performance improvement for skin lesion classification.

An efficient Fusion-Purification Network for Cervical pap-smear image classification

Background and Objectives:In cervical cell diagnostics, autonomous screening technology constitutes the foundation of automated diagnostic systems. Currently, numerous deep learning-based classification techniques have been successfully implemented in the analysis of cervical cell images, yielding favorable outcomes. Nevertheless, efficient discrimination of cervical cells continues to be challenging due to large intra-class and small inter-class variations. The key to dealing with this problem is to capture localized informative differences from cervical cell images and to represent discriminative features efficiently. Existing methods neglect the importance of global morphological information, resulting in inadequate feature representation capability. Methods:To address this limitation, we propose a novel cervical cell classification model that focuses on purified fusion information. Specifically, we first integrate the detailed texture information and morphological structure features, named cervical pathology information fusion. Second, in order to enhance the discrimination of cervical cell features and address the data redundancy and bias inherent after fusion, we design a cervical purification bottleneck module. This model strikes a balance between leveraging purified features and facilitating high-efficiency discrimination. Furthermore, we intend to unveil a more intricate cervical cell dataset: Cervical Cytopathology Image Dataset (CCID). Results:Extensive experiments on two real-world datasets show that our proposed model outperforms state-of-the-art cervical cell classification models. Conclusions:The results show that our method can well help pathologists to accurately evaluate cervical smears.

An Analysis of Convolutional Neutral Network for Image Classification

Abstract: Convolutional Neural Networks (CNNs) have emerged as a powerful tool for image classification tasks, owing to their ability to automatically learn hierarchical representations from raw pixel data. This paper presents a comprehensive analysis of CNNs for image classification, focusing on their architecture, training process, and performance evaluation metrics. The study investigates various CNN architectures, including AlexNet, GoogLeNet, and ResNet, highlighting their respective strengths and weaknesses in different scenarios. Moreover, the paper explores the impact of hyperparameters such as network depth, filter size, and pooling strategies on classification accuracy and computational efficiency. Furthermore, the training process of CNNs, encompassing data preprocessing, augmentation techniques, and optimization algorithms, is scrutinized to elucidate best practices for achieving optimal performance. Additionally, the paper discusses commonly used evaluation metrics such as accuracy, precision, recall, and F1-score, elucidating their interpretation and significance in assessing model performance. Through a systematic review of existing literature and experimental validation, this analysis aims to provide insights into the underlying mechanisms of CNNs for image classification tasks. Finally, the paper outlines future research directions, emphasizing the need for exploring novel architectures, optimizing hyperparameters, and enhancing interpretability and robustness of CNN models. Overall, this study contributes to a deeper understanding of CNNs for image classification and provides valuable guidance for practitioners and researchers in the field.

Feature disentanglement based domain adaptation network for cross-scene coastal wetland hyperspectral image classification

At present, domain adaptation (DA) methods have made noteworthy advancements in cross-scene hyperspectral image (HSI) classification. Their success largely hinges on the alignment of distributions between source and target domains, which is a critical step in extracting domain-invariant features. However, this intense focus on domain-invariant feature extraction frequently leads to the neglect of class-discriminative features, limiting their utility in cross-scene coastal wetland classification, where the nuanced identification of different classes is crucial. In this paper, a feature disentanglement based domain adaptation network (FDDAN) is proposed to disentangle and exclude domain-specific features and class-invariant features, thereby obtaining class-specific domain-invariant features for classification tasks. Specifically, a transformer and convolution fusion-based feature extraction network is designed to capture global–local mixed features. To align domain distributions and learn shared features, two corresponding disentanglers separate domain-invariant features and domain-specific features from mixed features. Furthermore, to allow domain-invariant features containing purer category discriminative information, class-invariant features are also segregated. In addition, an adversarial learning strategy between three features is utilized to simultaneously enhance the transferability and discriminability of domain-invariant features. The effectiveness of FDDAN is demonstrated by the experimental results obtained from three cross-scene unmanned aerial vehicle datasets collected in coastal wetlands and a publicly available dataset. We will make our datasets and source code publicly available upon acceptance of the paper.

Review of Convolutional Neural Network Models and Image Classification

With the arrival of the era of big data and the improvement of computing power, deep learning has swept the world. Traditional image classification methods are difficult to deal with the huge image data, and cannot meet the requirements of people on the accuracy and speed of image classification, the image classification method based on convolutional neural network breaks through the bottleneck of the traditional image classification method, and becomes the mainstream algorithm of image classification, how to effectively use convolutional neural network to classify images has become a hot spot of research in the field of computer vision at home and abroad. In this paper, we review the research background, significance and current research status of convolutional neural network model and image classification, study two image classification methods based on ResNet and ShuffleNet, and provide a comprehensive review of the construction methods and characteristics of the two deep convolutional neural network model structures, and finally compare and analyse the performance of the two classification models.

Machine Learning for Depression Detection on Web and Social Media

Depression, a significant psychiatric disorder, affects individuals' physical well-being and daily functioning. This focused analysis provides a comprehensive exploration of contemporary research conducted between 2012 and 2023 that delves into the utilization of sophisticated machine learning methodologies aimed at identifying correlates of depression within social media content. Our study meticulously dissects various data sources and performs a comprehensive examination of different machine learning algorithms cited in the researched articles and literature, aiming to pinpoint an approach that can enhance detection accuracy. Furthermore, we have scrutinized the use of varied data from social media platforms and pinpointed emerging trends, notably spotlighting novel applications of artificial neural networks for image processing and classification, along with advanced gait image models. Our results offer essential direction for future research focused on enhancing detection precision, acting as a valuable reference for academic and industry scholars in this field.

PathNet: a novel multi-pathway convolutional neural network for few-shot image classification from scratch

PathNet: a novel multi-pathway convolutional neural network for few-shot image classification from scratch

Automatic reconstruction of closely packed fabric composite RVEs using yarn-level micro-CT images processed by convolutional neural networks (CNNs) and based on physical characteristics

Micro-CT scanning is an advanced technique to reconstruct inner architectures for RVEs of fabric composites. Currently, however, there exist few automatic approaches to separate closely packed yarns in the micro-CT images with economical resolution that can only identify yarns but not individual fibers. To tackle this issue, an innovative method has been developed in this work to identify cross-section area of the yarns via deep-learning-based image segmentation, and then reconstruct 3D geometry model of the composites containing local fiber orientations. The image segmentation was achieved through semantic segmentation by U-Net with validation accuracy of 87 % counted by mIOU and object detection by YOLO v8 with validation accuracy of 99.5 % counted by mAP50. Micro-CT slices with different morphological characteristics were divided into three groups via a ResNet50-based image classification network and selected in ratio to form the training datasets for U-Net and YOLO v8 with high representativity and efficiency. Extraction of individual cross-sections of weft and warp yarns were conducted only using the micro-CT scanning from one angle of view to reduce scanning cost and yarn-to-yarn penetration error. An algorithm considering physical constraints of the yarns was also completed to estimate local fiber orientations with maximum error of 18.065°, nearly 50 % smaller than the existing method.

Exploring deep echo state networks for image classification: a multi-reservoir approach

Echo state networks (ESNs) belong to the class of recurrent neural networks and have demonstrated robust performance in time series prediction tasks. In this study, we investigate the capability of different ESN architectures to capture spatial relationships in images without transforming them into temporal sequences. We begin with three pre-existing ESN-based architectures and enhance their design by incorporating multiple output layers, customising them for a classification task. Our investigation involves an examination of the behaviour of these modified networks, coupled with a comprehensive performance comparison against the baseline vanilla ESN architecture. Our experiments on the MNIST data set reveal that a network with multiple independent reservoirs working in parallel outperforms other ESN-based architectures for this task, achieving a classification accuracy of 98.43%. This improvement on the classical ESN architecture is accompanied by reduced training times. While the accuracy of ESN-based architectures lags behind that of convolutional neural network-based architectures, the significantly lower training times of ESNs with multiple reservoirs operating in parallel make them a compelling choice for learning spatial relationships in scenarios prioritising energy efficiency and rapid training. This multi-reservoir ESN architecture overcomes standard ESN limitations regarding memory requirements and training times for large networks, providing more accurate predictions than other ESN-based models. These findings contribute to a deeper understanding of the potential of ESNs as a tool for image classification.

ImSpect: Image-driven self-supervised learning for surgical margin evaluation with mass spectrometry.

Real-time assessment of surgical margins is critical for favorable outcomes in cancer patients. The iKnife is a mass spectrometry device that has demonstrated potential for margin detection in cancer surgery. Previous studies have shown that using deep learning on iKnife data can facilitate real-time tissue characterization. However, none of the existing literature on the iKnife facilitate the use of publicly available, state-of-the-art pretrained networks or datasets that have been used in computer vision and other domains. In a new framework we call ImSpect, we convert 1D iKnife data, captured during basal cell carcinoma (BCC) surgery, into 2D images in order to capitalize on state-of-the-art image classification networks. We also use self-supervision to leverage large amounts of unlabeled, intraoperative data to accommodate the data requirements of these networks. Through extensive ablation studies, we show that we can surpass previous benchmarks of margin evaluation in BCC surgery using iKnife data, achieving an area under the receiver operating characteristic curve (AUC) of 81%. We also depict the attention maps of the developed DL models to evaluate the biological relevance of the embedding space CONCLUSIONS: We propose a new method for characterizing tissue at the surgical margins, using mass spectrometry data from cancer surgery.

Evaluation of Shallow Convolutional Neural Network in Open-World Chart Image Classification

Evaluation of Shallow Convolutional Neural Network in Open-World Chart Image Classification

Attention 3D central difference convolutional dense network for hyperspectral image classification.

Hyperspectral Images (HSI) classification is a challenging task due to a large number of spatial-spectral bands of images with high inter-similarity, extra variability classes, and complex region relationships, including overlapping and nested regions. Classification becomes a complex problem in remote sensing images like HSIs. Convolutional Neural Networks (CNNs) have gained popularity in addressing this challenge by focusing on HSI data classification. However, the performance of 2D-CNN methods heavily relies on spatial information, while 3D-CNN methods offer an alternative approach by considering both spectral and spatial information. Nonetheless, the computational complexity of 3D-CNN methods increases significantly due to the large capacity size and spectral dimensions. These methods also face difficulties in manipulating information from local intrinsic detailed patterns of feature maps and low-rank frequency feature tuning. To overcome these challenges and improve HSI classification performance, we propose an innovative approach called the Attention 3D Central Difference Convolutional Dense Network (3D-CDC Attention DenseNet). Our 3D-CDC method leverages the manipulation of local intrinsic detailed patterns in the spatial-spectral features maps, utilizing pixel-wise concatenation and spatial attention mechanism within a dense strategy to incorporate low-rank frequency features and guide the feature tuning. Experimental results on benchmark datasets such as Pavia University, Houston 2018, and Indian Pines demonstrate the superiority of our method compared to other HSI classification methods, including state-of-the-art techniques. The proposed method achieved 97.93% overall accuracy on the Houston-2018, 99.89% on Pavia University, and 99.38% on the Indian Pines dataset with the 25 × 25 window size.

Residual cosine similar attention and bidirectional convolution in dual-branch network for skin lesion image classification

Skin cancer is one of the most serious threats to human health among skin lesions. Computer-aided diagnosis methods can assist patients in identifying and detecting skin lesion types early, thereby enabling corresponding treatments. In this paper, we propose a dual-branch neural network model Conformer with Residual Cosine Similarity Attention and Bidirectional Convolutional fusion strategy, named RCSABC-Conformer. The core of this network structure comprises three parts: a Convolutional Neural Network (CNN) branch with Residual Cosine Similarity Attention (RCSA), a Transformer branch, and a Feature Couple Unit with Bidirectional Convolutional strategy (BC-FCU). The RCSA module calculates the cosine similarity value between the feature map generated by the convolutional operation and the feature map of the residual edge to assess whether their semantic information is similar. The semantic information of similar parts is weighted by exponential normalization to enhance the network's memory of similar features of the same type of skin lesion. The BC-FCU module interactively fuses local features and global representations of skin lesion images with different resolutions in the two branches. Specifically, when the global representations is integrated into local features, we introduce a new bidirectional convolution strategy to extract the feature map from both forward and backward directions, and then select the element with the smaller feature value from the two directions to fuse into local features. In this way, we can minimize the interference of the artifact features extracted by the Transformer branch on the CNN branch. In addition, taking advantage of the Transformer branch's capacity to construct global representations, our model can learn contextual semantic information of normal skin and lesion areas to enhance model robustness. We conducted experiments on three datasets, consisting of clinical and dermoscopic skin lesion images, as well as a hybrid of both. The experimental results show that RCSABC-Conformer outperforms both advanced and classical classification methods in terms of classification accuracy across all three datasets, without requiring an increase in the number of parameters and computational complexity. Compared with the baseline model, the classification accuracy of our proposed method improves by 2.40%, 5.39%, and 4.44% on the three datasets, respectively. To the best of our knowledge, this is the first study to apply an interactive fusion dual-branch network for multi-disease classification on different modalities of skin lesion databases. Code will be available at https://github.com/AlenLi817/RCSABC-Conformer.

Transverse-layer partitioning of artificial neural networks for image classification

Transverse-layer partitioning of artificial neural networks for image classification

Hyperparameter Optimization Using Hyperband in Convolutional Neural Network for Image Classification of Indonesian Snacks

Abstract. Indonesia is known for its traditional food both domestically and abroad. Several cakes are included in favorite traditional foods. Of the many types of cakes that exist, it is visually easy to recognize by humans, but computer vision requires special techniques in identifying image objects to types of cakes. Therefore, to recognize objects in the form of images of cakes as one of Indonesian specialties, a deep learning algorithm technique, namely the Convolutional Neural Network (CNN) can be used. Purpose: This study aims to find out how the Convolutional Neural Network (CNN) works by optimizing the hyperband hyperparameter in the classification process and knowing the accuracy value when hyperband is applied to the optimal hyperparameter selection process for classifying Indonesian snack images. Methods/Study design/approach: This study optimizes the hyperparameter Convolutional Neural Network (CNN) using Hyperband on the Indonesian cake dataset. The dataset is 1845 images of Indonesian snacks which consists of 1523 training data, 162 validation data and 160 testing data with 8 classes. In training data, the dataset is divided by 82% on training data, 9% validation, and 9% testing. Result/Findings: The best hyperparameter value produced is 480 for the number of dense neurons 2 and 0.0001 for the learning rate. The proposed method succeeded in achieving a training value of 87.53%, for the validation process it was obtained 66.8%, the testing process was obtained 79.37%. Results obtained from model training of 50 epochs. Novelty/Originality/Value: Previous research focused on the application and development of algorithms for the classification of Indonesian snacks. Therefore, optimizing hyperparameters in a Convolutional Neural Network (CNN) using Hyperband can be an alternative in selecting the optimal architecture and hyperparameters.

A Study for Design of Lightweight Dense Connection Network on Hyperspectral Image Classification

The characteristics of hyperspectral remote sensing images such as inconspicuous feature representativeness, single feature level, and complex information content, can lead to unstable classification results. We propose a lightweight dense network model that injects channel attention in the form of dense connections between network layers (DSE-DN) for the classification of hyperspectral images. In the DSE-DN network, principal component analysis (PCA) is applied to reduce redundancy in the hyperspectral images. Subsequently, a densely connected network is constructed, incorporating channel attention mechanisms through dense connections to enhance the analysis of spectral image features. Finally, the processed hyperspectral images are classified using a fully interconnected layer. We assess two classical hyperspectral datasets and construct 2DCNN, 3DCNN, ResNet, and the network that injects channel attention layer by layer to compare with DSE-DN. The experimental results indicate the utility of the DSE-DN network in hyperspectral image classification and its superiority over other networks.

Multi-task multi-objective evolutionary network for hyperspectral image classification and pansharpening

Multi-task learning has commonly been used and performed well at joint visual perception tasks. Hyperspectral pansharpening (HP) and hyperspectral classification (HC) tasks extract high-frequency information to enhance edges and classify samples, offering potential for performance improvements in multi-task learning. However, differences between tasks can make it challenging to balance their performances. To address this challenge, this paper proposes a multi-task multi-objective evolutionary network (DMOEAD) for joint learning of HC and HP. A multi-task sufficiency-and-diversity sampling method is designed to unify the heterogeneity of sample construction between two types of tasks. Two types of task-specific networks are constructed to decompose high-frequency information. Further, a collaborative learning module is designed to dynamically learn complementary high-frequency information from another task in different layers. To be compatible with the optimization direction of two types of tasks, multi-task optimization is realized using a deep multi-objective evolutionary algorithm (DMEO). In the DMEO, the set of parameters of the DMOEAD is regarded as an individual. A deep mutation operator is designed and used for network optimization, which accelerates large-scale network parameter searching. The DMEO can coordinate the differences between multiple tasks and provide a set of Pareto network parameter solutions. Finally, the experimental results demonstrate that the proposed method can significantly enhance the performance of both pansharpening and classification tasks.

Cross-Layer and Cross-Sample Feature Optimization Network for Few-Shot Fine-Grained Image Classification

Recently, a number of Few-Shot Fine-Grained Image Classification (FS-FGIC) methods have been proposed, but they primarily focus on better fine-grained feature extraction while overlooking two important issues. The first one is how to extract discriminative features for Fine-Grained Image Classification tasks while reducing trivial and non-generalizable sample level noise introduced in this procedure, to overcome the over-fitting problem under the setting of Few-Shot Learning. The second one is how to achieve satisfying feature matching between limited support and query samples with variable spatial positions and angles. To address these issues, we propose a novel Cross-layer and Cross-sample feature optimization Network for FS-FGIC, C2-Net for short. The proposed method consists of two main modules: Cross-Layer Feature Refinement (CLFR) module and Cross-Sample Feature Adjustment (CSFA) module. The CLFR module further refines the extracted features while integrating outputs from multiple layers to suppress sample-level feature noise interference. Additionally, the CSFA module addresses the feature mismatch between query and support samples through both channel activation and position matching operations. Extensive experiments have been conducted on five fine-grained benchmark datasets, and the results show that the C2-Net outperforms other state-of-the-art methods by a significant margin in most cases. Our code is available at: https://github.com/zenith0923/C2-Net.