Image Classification Research Articles

Balancing Performance and Interpretability in Medical Image Analysis: Case study of Osteopenia.

Multiple studies within the medical field have highlighted the remarkable effectiveness of using convolutional neural networks for predicting medical conditions, sometimes even surpassing that of medical professionals. Despite their great performance, convolutional neural networks operate as black boxes, potentially arriving at correct conclusions for incorrect reasons or areas of focus. Our work explores the possibility of mitigating this phenomenon by identifying and occluding confounding variables within images. Specifically, we focused on the prediction of osteopenia, a serious medical condition, using the publicly available GRAZPEDWRI-DX dataset. After detection of the confounding variables in the dataset, we generated masks that occlude regions of images associated with those variables. By doing so, models were forced to focus on different parts of the images for classification. Model evaluation using F1-score, precision, and recall showed that models trained on non-occluded images typically outperformed models trained on occluded images. However, a test where radiologists had to choose a model based on the focused regions extracted by the GRAD-CAM method showcased different outcomes. The radiologists' preference shifted towards models trained on the occluded images. These results suggest that while occluding confounding variables may degrade model performance, it enhances interpretability, providing more reliable insights into the reasoning behind predictions. The code to repeat our experiment is available on the following link: https://github.com/mikulicmateo/osteopenia .

Hyperspectral image classification based on adaptive spectral feature decoupling with global local feature fusion network

Hyperspectral image classification based on adaptive spectral feature decoupling with global local feature fusion network

A Comprehensive Study on the Robustness of Image Classification and Object Detection in Remote Sensing: Surveying and Benchmarking

A Comprehensive Study on the Robustness of Image Classification and Object Detection in Remote Sensing: Surveying and Benchmarking

Using Machine Learning for Endoscopic Detection of Low-Grade Subglottic Stenosis: A Proof of Principle.

The current study trains, tests, and evaluates a deep learning algorithm to detect subglottic stenosis (SGS) on endoscopy. A retrospective review of patients undergoing microlaryngoscopy-bronchoscopy was performed. A pretrained image classifier (Resnet50) was retrained and tested on 159 images of airways taken at the glottis, 106 normal-sized airways, and 122 with SGS. Data augmentation was performed given the small sample size to prevent overfitting. Overall model accuracy was 73.3% (SD: 3.8). Precision and recall for stenosis were 77.3% (SD: 4.0) and 72.7 (SD: 4.0). F1 score for the detection of stenosis was 0.75 (SD: 0.04). Precision and recall for normal-sized images were lower at 69% (SD: 4.35) and 74% (SD: 4), with an F1 score of 0.71 (SD: 0.04). This study demonstrates that an image classification algorithm can identify SGS on endoscopic images. Work is needed to improve diagnostic accuracy for eventual deployment of the algorithm into clinical care.

Innovative Approaches to Clinical Diagnosis: Transfer Learning in Facial Image Classification for Celiac Disease Identification

Background: Celiac disease arises from gluten consumption and shares symptoms with other conditions, leading to delayed diagnoses. Untreated celiac disease heightens the risk of autoimmune disorders, neurological issues, and certain cancers like lymphoma while also impacting skin health due to intestinal disruptions. This study uses facial photos to distinguish individuals with celiac disease from those without. Surprisingly, there is a lack of research involving transfer learning for this purpose despite its benefits such as faster training, enhanced performance, and reduced overfitting. While numerous studies exist on endoscopic intestinal photo classification and a few have explored the link between facial morphology measurements and celiac disease, none have concentrated on diagnosing celiac disease through facial photo classification. Methods: This study sought to apply transfer learning techniques with VGG16 to address a gap in research by identifying distinct facial features that differentiate patients with celiac disease from healthy individuals. A dataset containing a total of 200 facial images of adult individuals with and without celiac condition was utilized. Half of the dataset had a ratio of 70% females to 30% males with celiac condition, and the rest had a ratio of 60% females to 40% males without celiac condition. Among those with celiac condition, 28 were newly diagnosed and 72 had been previously diagnosed, with 25 not adhering to a gluten-free diet and 47 partially adhering to such a diet. Results: Utilizing transfer learning, the model achieved a 73% accuracy in classifying the facial images of the patients during testing, with corresponding precision, recall, and F1 score values of 0.54, 0.56, and 0.52, respectively. The training process involved 50,178 parameters, showcasing the model’s efficacy in diagnostic image analysis. Conclusions: The model correctly classified approximately three-quarters of the test images. While this is a reasonable level of accuracy, it also suggests that there is room for improvement as the dataset contains images that are inherently difficult to classify even for humans. Increasing the proportion of newly diagnosed patients in the dataset and expanding the dataset size could notably improve the model’s efficacy. Despite being the first study in this field, further refinement holds promise for the development of a diagnostic tool for celiac disease using transfer learning in medical image analysis, addressing the lack of prior studies in this area.

Lychee cultivar fine-grained image classification method based on improved ResNet-34 residual network

Lychee, a key economic crop in southern China, has numerous similar-looking varieties. Classifying these can aid farmers in understanding each variety's growth and market demand, enhancing agricultural efficiency. However, existing classification techniques are subjective, complex, and costly. This paper proposes a lychee classification method using an improved ResNet-34 residual network for six common varieties. We enhance the CBAM attention mechanism by replacing the large receptive field in the SAM module with a smaller one. Attention mechanisms are added at key network stages, focusing on crucial image information. Transfer learning is employed to apply ImageNet-trained model weights to this task. Test set evaluations demonstrate that our improved ResNet-34 network surpasses the original, achieving a recognition accuracy of 95.8442%, a 5.58 percentage point improvement.

G-SAM: GMM-based segment anything model for medical image classification and segmentation

G-SAM: GMM-based segment anything model for medical image classification and segmentation

Multi-Label Generalized Zero Shot Chest Xray Classification By Combining Image-Text Information With Feature Disentanglement.

In fully supervised learning-based medical image classification, the robustness of a trained model is influenced by its exposure to the range of candidate disease classes. Generalized Zero Shot Learning (GZSL) aims to correctly predict seen and novel unseen classes. Current GZSL approaches have focused mostly on the single-label case. However, it is common for chest X-rays to be labelled with multiple disease classes. We propose a novel multi-modal multi-label GZSL approach that leverages feature disentanglement andmulti-modal information to synthesize features of unseen classes. Disease labels are processed through a pre-trained BioBert model to obtain text embeddings that are used to create a dictionary encoding similarity among different labels. We then use disentangled features and graph aggregation to learn a second dictionary of inter-label similarities. A subsequent clustering step helps to identify representative vectors for each class. The multi-modal multi-label dictionaries and the class representative vectors are used to guide the feature synthesis step, which is the most important component of our pipeline, for generating realistic multi-label disease samples of seen and unseen classes. Our method is benchmarked against multiple competing methods and we outperform all of them based on experiments conducted on the publicly available NIH and CheXpert chest X-ray datasets.

Pyramid Channel-based Feature Attention Network with Ensemble Learning based UAV Image Classification on IoT Assisted Remote Sensing Environment

Pyramid Channel-based Feature Attention Network with Ensemble Learning based UAV Image Classification on IoT Assisted Remote Sensing Environment

An improved efficientnet B7 underwater marine organism image classification model based on the spatial group enhancement attention mechanisms

In this paper, we adopt the Efficientnet B7 model, which is an excellent performer in deep learning algorithms, and improve it by combining with the Spatial Group Enhancement attention mechanism to provide an innovative method for underwater biological image classification. After a reasonable division of the dataset, we introduced the improved Efficientnet B7 model for training. By observing the change of the loss curve on the training set, it can be seen that the loss value of the model gradually decreases from 0.6 to 0.05 and tends to be stable, which indicates that the classification prediction of the model is gradually close to the real result, and it can classify the underwater marine organisms images effectively. The accuracy on the training set gradually increases from the initial 80.12% to 98.31%, and the recall also grows from 75.82% to 98.93%, showing that the model predicts well. The performance on the test set shows an accuracy of 84.86%, a recall of 82.40%, and an F1 value of 80.2%, indicating that the model has good generalisation ability. This means that our proposed improved methods and ideas have achieved significant results in the task of underwater biological image classification, providing a useful reference for research in related fields. By comparing the experimental results, it can be seen that the optimisation of the Efficientnet B7 model by introducing the Spatial Group Enhancement attention mechanism achieves better performance in the underwater marine organisms image classification task, which lays the foundation for the future application of deep learning in underwater environments. This study is of positive significance for the promotion of underwater biology research, marine protection and other fields, and provides new ideas and methods for carrying out more in-depth related research.

An efficient image classification and segmentation method for crime investigation applications

AbstractThe field of forensic science is experiencing significant growth, largely driven by the increasing integration of holographic and immersive technologies, along with their associated head-mounted displays. These immersive systems have become increasingly vital in resolving critical crimes as they facilitate communication, interaction, and collaboration. Given the sensitive nature of their work, crime investigators require substantial technical support. There is a pressing need for accurate documentation and archiving of crime scenes, which can be addressed by leveraging 3D scanned scenes to accurately represent evidence and expected scenarios. This study aims to develop an enhanced AR. system that can be deployed on hologram facilities such as the Microsoft HoloLens. The proposed system encompasses two main approaches, namely image classification and image segmentation. Image classification utilizes various deep learning models, including lightweight convolutional neural networks (CNNs) and convolutional Long-Short Term Memory (ConvLSTM). Additionally, the image segmentation approach is based on the fuzzy active contour model (FACM). The effectiveness of the proposed system was evaluated for both classification and segmentation tasks, utilizing metrics such as accuracy, sensitivity, precision, and F1 score. The simulation results indicate that the proposed system achieved a 99% accuracy rate in classification and segmentation tasks, positioning it as an effective solution for detecting bloodstain patterns in AR applications.

MonuNet: a high performance deep learning network for Kolkata heritage image classification

Kolkata, renowned as the City of Joy, boasts a rich tapestry of cultural heritage spanning centuries. Despite the significance of its architectural marvels, accessing comprehensive visual documentation of Kolkata's heritage sites remains a challenge. In online searches, limited imagery often fails to provide a detailed understanding of these historical landmarks. To address this gap, this paper introduces MonuNet, a high-performance deep-learning network specifically designed for the classification of heritage images from Kolkata. The development of MonuNet addresses the critical need for efficient and accurate identification of Kolkata's architectural marvels, which are significant tangible cultural heritages. The dataset used to train MonuNet is organized by heritage sites, each category within the dataset represents distinct sites. It includes images from 13 prominent heritage sites in Kolkata. For each of these sites, there are 50 images, making it a structured collection where each category (heritage site) is equally represented. The proposed network utilizes a unique architecture incorporating a Dense channel attention module and a Parallel-spatial channel attention module to capture intricate architectural details and spatial relationships within the images. Experimental evaluations demonstrate the superior performance of MonuNet in classifying Kolkata heritage images with an accuracy of 89%, Precision of 87.77%, and Recall of 86.61%. The successful deployment of MonuNet holds significant implications for cultural preservation, tourism enhancement, and urban planning in Kolkata, aligning with the United Nations Sustainable Development Goals (SDGs) for sustainable city development. By providing a robust tool for the automatic identification and classification of heritage images, MonuNet promises to enrich online repositories with detailed visual documentation, thereby enhancing accessibility to Kolkata's cultural heritage for researchers, tourists, and urban planners alike.Graphical

Weather forecast image classification based on KNN, CNN, and VGG19

Image classification is an important technology in the field of computer vision, with the main objective of categorizing input images into different classes. It is used in many areas, such as weather forecasting. The significance of weather forecast image classification spans several areas, including enhancing weather forecast accuracy, aiding agriculture, optimizing the energy sector, ensuring transportation safety, and informing urban planning and construction. In this study, the author investigates the precision and efficiency of three machine learning algorithmsConvolutional Neural Network (CNN), K-Nearest Neighbor (KNN), and Visual Geometry Group 19 (VGG19)in classifying weather forecast images. The research meticulously elucidates the methodologies underlying each algorithm, outlining their distinct architectures, training processes, and feature extraction mechanisms. The research highlights that the self-built CNN model excels in accuracy and efficiency, while VGG19 achieves higher accuracy (93%) with longer training time. In contrast, the KNN model shows shorter training time (32.50 seconds) with slightly lower accuracy (80%).

Image classification and reconstruction from low-density EEG

Recent advances in visual decoding have enabled the classification and reconstruction of perceived images from the brain. However, previous approaches have predominantly relied on stationary, costly equipment like fMRI or high-density EEG, limiting the real-world availability and applicability of such projects. Additionally, several EEG-based paradigms have utilized artifactual, rather than stimulus-related information yielding flawed classification and reconstruction results. Our goal was to reduce the cost of the decoding paradigm, while increasing its flexibility. Therefore, we investigated whether the classification of an image category and the reconstruction of the image itself is possible from the visually evoked brain activity measured by a portable, 8-channel EEG. To compensate for the low electrode count and to avoid flawed predictions, we designed a theory-guided EEG setup and created a new experiment to obtain a dataset from 9 subjects. We compared five contemporary classification models with our setup reaching an average accuracy of 34.4% for 20 image classes on hold-out test recordings. For the reconstruction, the top-performing model was used as an EEG-encoder which was combined with a pretrained latent diffusion model via double-conditioning. After fine-tuning, we reconstructed images from the test set with a 1000 trial 50-class top-1 accuracy of 35.3%. While not reaching the same performance as MRI-based paradigms on unseen stimuli, our approach greatly improved the affordability and mobility of the visual decoding technology.

Empowering Diabetic Eye Disease Detection: Leveraging Differential Evolution for Optimized Convolution Neural Networks

Diabetic eye detection has become a major concern across the globe, which could be effectively addressed by automated detection using a deep convolutional neural network (DCNN). CNN models have better detection and classification accuracy than other state-of-theart models. In this paper, a differential evolution (DE)-optimized CNN has been proposed for the single-step classification of diabetic retinopathy (DR) and glaucoma images. DE has been used to find out the optimized values of four hyper-parameters of CNN, i.e., the number of filters in the first layer, the filter size, the number. of convolution layers, and the number of strides. Simulation has been done using three publicly available datasets, and the accuracy obtained is 87.8%, 92.3%, and 88.7%, respectively, which outperforms other models. No other state-of-the-art model has used DE for hyper-parameter tuning in CNN models. Also, no other additional segmentation approach or handcrafted features have been used. The model has been kept simple to reduce computational costs.

A brain tumor diagnosis approach based on deep separable convolutional networks and attention mechanisms

Brain tumors rank among the most lethal types of tumors. Magnetic Resonance Imaging (MRI) technology can clearly display the position, size, and borders of the tumors. Hence, MRI is frequently used in clinical diagnostics to detect brain tumors. Deep learning and related methods have been widely used in computer vision research recently for diagnosis and classification of MRI images of brain tumors. One trend is to achieve better performance by increasing model complexity. However, at the same time, the trainable parameters of the model increases accordingly. Too many parameters will lead to more difficult model training and optimization, and are prone to overfitting. To address this problem, this study constructs a model that incorporates a depthwise separable convolution technique and an attention mechanism to balance model performance and complexity. The model achieves 97.41% accuracy in the brain tumor classification task, which exceeds the 96.72% accuracy of the pre-trained model MobileNetV2, and shows good image classification ability. Future work could test the model's classification results on noisy images and investigate how to optimize the model's generalization ability.

Perbandingan Dataset Labelled Faces in the Wild (LFW) dan faces94 Menggunakan Algoritma Convolutional Neural Networks (CNN) untuk Pengenalan Wajah

This research compares the performance of two popular datasets, Labelled Faces in the Wild (LFW) and faces94, in the task of face recognition using Convolutional Neural Networks (CNN) algorithms. The LFW dataset is known for its high variation in pose, lighting, and expression, while faces94 is more structured with more uniform lighting and pose conditions. CNNs were chosen for their ability to extract important features from face images for classification. In this study, a CNN model was trained on both datasets and its performance was evaluated using accuracy, precision, and recall metrics. The experimental results showed that the model trained on the faces94 dataset achieved higher accuracy compared to the model trained on the LFW dataset. However, the model on the LFW dataset demonstrated better resilience to variations in lighting and pose conditions. These findings indicate that while a more structured dataset like faces94 can produce a model with high accuracy under testing conditions similar to the training data, a dataset with greater variation like LFW is more suitable for real-world applications involving diverse conditions. This study provides important insights into the selection of datasets for developing robust and accurate face recognition systems.

HLFSRNN-MIL: A Hybrid Multi-Instance Learning Model for 3D CT Image Classification

At present, many diseases are diagnosed by computer tomography (CT) image technology, which affects the health of the lives of millions of people. In the process of disease confrontation, it is very important for patients to detect diseases in the early stage by deep learning of 3D CT images. The paper offers a hybrid multi-instance learning model (HLFSRNN-MIL), which hybridizes high-low frequency feature fusion (HLFFF) with sequential recurrent neural network (SRNN) for CT image classification tasks. Firstly, the hybrid model uses Resnet-50 as the deep feature. The main feature of the HLFSRNN-MIL lies in its ability to make full use of the advantages of the HLFFF and SRNN methods to make up for their own weakness; i.e., the HLFFF can extract more targeted feature information to avoid the problem of excessive gradient fluctuation during training, and the SRNN is used to process the time-related sequences before classification. The experimental study of the HLFSRNN-MIL model is on two public CT datasets, namely, the Cancer Imaging Archive (TCIA) dataset on lung cancer and the China Consortium of Chest CT Image Investigation (CC-CCII) dataset on pneumonia. The experimental results show that the model exhibits better performance and accuracy. On the TCIA dataset, HLFSRNN-MIL with Residual Network (ResNet) as the feature extractor achieves an accuracy (ACC) of 0.992 and an area under curve (AUC) of 0.997. On the CC-CCII dataset, HLFSRNN-MIL achieves an ACC of 0.994 and an AUC of 0.997. Finally, compared with the existing methods, HLFSRNN-MIL has obvious advantages in all aspects. These experimental results demonstrate that HLFSRNN-MIL can effectively solve the disease problem in the field of 3D CT images.

Conversion Factor Estimation of Stacked Eucalypt Timber Using Supervised Image Classification with Artificial Neural Networks

Stacked timber is quantified in-store units and then adjusted with a conversion factor for volume estimation in cubic meters, which is important for the wood trade in South America. However, measuring large quantities accurately can be challenging. Digital image processing and artificial intelligence advancements offer promising solutions, making research in this area increasingly attractive. This study aims to estimate conversion factors of stacked Eucalyptus grandis timber using supervised image classification with Artificial Neuronal Network (ANN). Measured data and photographs from an experiment involving thirty stacks of timber were used to achieve this. The conversion factor was determined using photographic methods that involved the applications of equidistant points and ANN and subsequently validated with values observed through the manual method. The ANN method produced more accurate conversion factor estimates than the equidistant points method. Approximately 97% of the ANN estimates were within the ±1% error class, even when using low-resolution digital photographs.

Wavelet Transform, Reconstructed Phase Space, and Deep Learning Neural Networks for EEG-Based Schizophrenia Detection.

This study proposes an innovative expert system that uses exclusively EEG signals to diagnose schizophrenia in its early stages. For diagnosing psychiatric/neurological disorders, electroencephalogram (EEG) testing is considered a financially viable, safe, and reliable alternative. Using the reconstructed phase space (RPS) and the continuous wavelet transform, the researchers maximized the differences between the EEG nonstationary signals of normal and schizophrenia individuals, which cannot be observed in the time, frequency, or time-frequency domains. This reveals significant information, highlighting more distinguishable features. Then, a deep learning network was trained to enhance the accuracy of the resulting image classification. The algorithm's efficacy was confirmed through three distinct methods: employing 70% of the dataset for training, 15% for validation, and the remaining 15% for testing. This was followed by a 5-fold cross-validation technique and a leave-one-out classification approach. Each method was iterated 100 times to ascertain the algorithm's robustness. The performance metrics derived from these tests - accuracy, precision, sensitivity, F1 score, Matthews correlation coefficient, and Kappa - indicated remarkable outcomes. The algorithm demonstrated steady performance across all evaluation strategies, underscoring its relevance and reliability. The outcomes validate the system's accuracy, precision, sensitivity, and robustness by showcasing its capability to autonomously differentiate individuals diagnosed with schizophrenia from those in a state of normal health.