Lightweight Convolutional Neural Network Research Articles

Comparative Analysis of CNN Algorithms for Mushroom Classification with Proposed Lightweight CNN Model

The classification of mushroom species presents significant ecologic and health-related challenges; advancement in classification techniques is required to gain reliable identifications. This study aims to explain a methodology that was devised and evaluated in the development of a novel, lightweight Convolutional Neural Network (CNN) designed specifically for the task of mushroom classification. The paper provides a custom CNN model that is computationally cost-effective and capable of high-precision classification, fit for real-time usage. Hence, the proposed model was evaluated on this dataset of curated mushroom images with traditional classifiers and state-of-the-art CNN architectures, such as EfficientNet-B7, ResNet50, InceptionV3, and MobileNetV2. The custom model is depth-wise separations engineered in such a way that while they reduce the computational load, they don't compromise the effectiveness of the model. The custom model achieved a test score of 0.68, which is moderate compared to more established models such as EfficientNet-B7 or ResNet50. This approach helps the model function effectively even on platforms having low computational resources. A comprehensive evaluation reveals that a custom CNN has reasonable accuracy in the identification of different mushroom species vis-à-vis existing models, but also significantly lightens the classification process.

Fault detection and diagnosis of grid-connected photovoltaic systems using energy valley optimizer based lightweight CNN and wavelet transform

Early fault detection and diagnosis of grid-connected photovoltaic systems (GCPS) is imperative to improve their performance and reliability. Low-cost edge devices have emerged as innovative solutions for real-time monitoring, reducing latency, and improving response times. In this work, a lightweight Convolutional Neural Network (CNN) is designed and fine-tuned using Energy Valley Optimizer (EVO) for fault diagnosis. The CNN input consists of two-dimensional scalograms generated using Continuous Wavelet Transform (CWT). The proposed diagnosis technique demonstrated superior performance compared to benchmark architectures, namely MobileNet, NASNetMobile, and InceptionV3, achieving higher test accuracies and lower losses on binary and multi-fault classification tasks on balanced, unbalanced, and noisy datasets. Further, a quantitative comparison is conducted with similar recent studies. The obtained results indicate good performance and high reliability of the proposed fault diagnosis method.

Intelligent Fault Diagnosis Method for Rotating Machinery Based on Recurrence Binary Plot and DSD-CNN.

To tackle the issue of the traditional intelligent diagnostic algorithm's insufficient utilization of correlation characteristics within the time series of fault signals and to meet the challenges of accuracy and computational complexity in rotating machinery fault diagnosis, a novel approach based on a recurrence binary plot (RBP) and a lightweight, deep, separable, dilated convolutional neural network (DSD-CNN) is proposed. Firstly, a recursive encoding method is used to convert the fault vibration signals of rotating machinery into two-dimensional texture images, extracting feature information from the internal structure of the fault signals as the input for the model. Subsequently, leveraging the excellent feature extraction capabilities of a lightweight convolutional neural network embedded with attention modules, the fault diagnosis of rotating machinery is carried out. The experimental results using different datasets demonstrate that the proposed model achieves excellent diagnostic accuracy and computational efficiency. Additionally, compared with other representative fault diagnosis methods, this model shows better anti-noise performance under different noise test data, and it provides a reliable and efficient reference solution for rotating machinery fault-classification tasks.

DiRecNetV2: A Transformer-Enhanced Network for Aerial Disaster Recognition

The integration of Unmanned Aerial Vehicles (UAVs) with artificial intelligence (AI) models for aerial imagery processing in disaster assessment, necessitates models that demonstrate exceptional accuracy, computational efficiency, and real-time processing capabilities. Traditionally Convolutional Neural Networks (CNNs), demonstrate efficiency in local feature extraction but are limited by their potential for global context interpretation. On the other hand, Vision Transformers (ViTs) show promise for improved global context interpretation through the use of attention mechanisms, although they still remain underinvestigated in UAV-based disaster response applications. Bridging this research gap, we introduce DiRecNetV2, an improved hybrid model that utilizes convolutional and transformer layers. It merges the inductive biases of CNNs for robust feature extraction with the global context understanding of Transformers, maintaining a low computational load ideal for UAV applications. Additionally, we introduce a new, compact multi-label dataset of disasters, to set an initial benchmark for future research, exploring how models trained on single-label data perform in a multi-label test set. The study assesses lightweight CNNs and ViTs on the AIDERSv2 dataset, based on the frames per second (FPS) for efficiency and the weighted F1 scores for classification performance. DiRecNetV2 not only achieves a weighted F1 score of 0.964 on a single-label test set but also demonstrates adaptability, with a score of 0.614 on a complex multi-label test set, while functioning at 176.13 FPS on the Nvidia Orin Jetson device.

ALKU-Net: Adaptive Large Kernel Attention Convolution Network for Lung Nodule Segmentation

The accurate segmentation of lung nodules in computed tomography (CT) images is crucial for the early screening and diagnosis of lung cancer. However, the heterogeneity of lung nodules and their similarity to other lung tissue features make this task more challenging. By using large receptive fields from large convolutional kernels, convolutional neural networks (CNNs) can achieve higher segmentation accuracies with fewer parameters. However, due to the fixed size of the convolutional kernel, CNNs still struggle to extract multi-scale features for lung nodules of varying sizes. In this study, we propose a novel network to improve the segmentation accuracy of lung nodules. The network integrates adaptive large kernel attention (ALK) blocks, employing multiple convolutional layers with variously sized convolutional kernels and expansion rates to extract multi-scale features. A dynamic selection mechanism is also introduced to aggregate the multi-scale features obtained from variously sized convolutional kernels based on selection weights. Based on this, we propose a lightweight convolutional neural network with large convolutional kernels, called ALKU-Net, which integrates the ALKA module in a hierarchical encoder and adopts a U-shaped decoder to form a novel architecture. ALKU-Net efficiently utilizes the multi-scale large receptive field and enhances the model perception capability through spatial attention and channel attention. Extensive experiments demonstrate that our method outperforms other state-of-the-art models on the public dataset LUNA-16, exhibiting considerable accuracy in the lung nodule segmentation task.

Fire-Net: Rapid Recognition of Forest Fires in UAV Remote Sensing Imagery Using Embedded Devices

Forest fires pose a catastrophic threat to Earth’s ecology as well as threaten human beings. Timely and accurate monitoring of forest fires can significantly reduce potential casualties and property damage. Thus, to address the aforementioned problems, this paper proposed an unmanned aerial vehicle (UAV) based on a lightweight forest fire recognition model, Fire-Net, which has a multi-stage structure and incorporates cross-channel attention following the fifth stage. This is to enable the model’s ability to perceive features at various scales, particularly small-scale fire sources in wild forest scenes. Through training and testing on a real-world dataset, various lightweight convolutional neural networks were evaluated on embedded devices. The experimental outcomes indicate that Fire-Net attained an accuracy of 98.18%, a precision of 99.14%, and a recall of 98.01%, surpassing the current leading methods. Furthermore, the model showcases an average inference time of 10 milliseconds per image and operates at 86 frames per second (FPS) on embedded devices.

MobileAmcT: A Lightweight Mobile Automatic Modulation Classification Transformer in Drone Communication Systems

With the rapid advancement of wireless communication technology, automatic modulation classification (AMC) plays a crucial role in drone communication systems, ensuring reliable and efficient communication in various non-cooperative environments. Deep learning technology has demonstrated significant advantages in the field of AMC, effectively and accurately extracting and classifying modulation signal features. However, existing deep learning models often have high computational costs, making them difficult to deploy on resource-constrained drone communication devices. To address this issue, this study proposes a lightweight Mobile Automatic Modulation Classification Transformer (MobileAmcT). This model combines the advantages of lightweight convolutional neural networks and efficient Transformer modules, incorporating the Token and Channel Conv (TCC) module and the EfficientShuffleFormer module to enhance the accuracy and efficiency of the automatic modulation classification task. The TCC module, based on the MetaFormer architecture, integrates lightweight convolution and channel attention mechanisms, significantly improving local feature extraction efficiency. Additionally, the proposed EfficientShuffleFormer innovatively improves the traditional Transformer architecture by adopting Efficient Additive Attention and a novel ShuffleConvMLP feedforward network, effectively enhancing the global feature representation and fusion capabilities of the model. Experimental results on the RadioML2016.10a dataset show that compared to MobileNet-V2 (CNN-based) and MobileViT-XS (ViT-based), MobileAmcT reduces the parameter count by 74% and 65%, respectively, and improves classification accuracy by 1.7% and 1.09% under different SNR conditions, achieving an accuracy of 62.93%. This indicates that MobileAmcT can maintain high classification accuracy while significantly reducing the parameter count and computational complexity, clearly outperforming existing state-of-the-art AMC methods and other lightweight deep learning models.

A Lightweight Convolutional Spiking Neural Network for Fires Detection Based on Acoustics

A Lightweight Convolutional Spiking Neural Network for Fires Detection Based on Acoustics

Fast and Accurate Recognition of Perovskite Fluorescent Anti-counterfeiting Labels Based on Lightweight Convolutional Neural Networks.

Anti-counterfeiting technology has always been a key issue in the field of information security. Physical Unclonable Function (PUF) labels, which are random patterns produced by a stochastic process, emerge as an effective anti-counterfeiting strategy due to the inherent randomness of their physical patterns. In this study, we developed a high-throughput droplet array generation technique based on surface tension confinement to prepare perovskite crystal films with controllable shapes and sizes. We utilized the random distribution of perovskite nanocrystal particles to construct the PUF textures of the labels. Compared to other anti-counterfeiting labels, our labels not only possess fluorescent properties but also feature microscale dimensions (less than 5.3 × 10-2mm2), low cost (less than 3 × 10-4 USD), and high encoding capacity (1.7 × 101956), providing support for multilevel anti-counterfeiting protection. Additionally, we introduce an innovative PUF recognition method based on a Partial Convolutional Network (PaCoNet), effectively addressing the limitations of previous methods, in terms of recognition accuracy and speed. Experimental validation on a data set of perovskite nanocrystal films with up to 60 different macroscopic shapes and unique microscopic textures demonstrates that our method achieves a recognition accuracy of up to 99.65% and significantly reduces the recognition time per image to just 0.177 s, highlighting the potential application of these labels in the field of anti-counterfeiting.

ADVANCING COLORECTAL POLYP DETECTION: AN AUTOMATED SEGMENTATION APPROACH WITH COLRECTSEG-UNET

Purpose: This study aimed to achieve two primary goals. First, we sought to develop a lightweight convolutional neural network (CNN) model, COLRECTSEG-UNet, for the purpose of automated polyp segmentation and localization. Second, we evaluated the generalizability of the proposed model by testing it on a proprietary colonoscopy image dataset (own dataset) in addition to a publicly available benchmark (CVC-ColonDB and Kvasir dataset). Methods: The COLRECTSEG-UNet architecture was employed to perform polyp segmentation. Subsequently, the model was trained and validated using an 80:20 data split from the CVC-ColonDB dataset. The efficacy of these data split was confirmed through [Formula: see text]-fold cross-validation. To elucidate the significance of each layer within the COLRECTSEG-UNet design, an ablation study was conducted. The performance of the model was assessed using various metrics on the CVC-ClinicDB, own dataset and Kvasir dataset during the testing phase. These metrics were then compared to those achieved by current state-of-the-art models and findings reported in recent literature. Results: When evaluated on the CVC-ClinicDB dataset, the COLRECTSEG-UNet model achieved outstanding accuracy of 0.9591, intersection over union (IoU) of 0.9299 and F1-Score of 0.9530. Similarly, impressive results were obtained on the own dataset, with accuracy, IoU and F1-Score values of 0.955, 0.9346 and 0.9539, respectively. Additionally, Kvasir dataset attained the accuracy, IoU and F1-Score of 0.9542, 0.9291 and 0.9565, respectively. These results demonstrate that the proposed COLRECTSEG-UNet outperforms the existing benchmark models and surpasses the performance reported in current literature. Conclusion: The implementation of COLRECTSEG-UNet as a lightweight model paves the way for its integration as a backend component within medical imaging system software. This has the potential to significantly aid gastroenterologists in clinical decision-making during interventions.

ICS-ResNet: A Lightweight Network for Maize Leaf Disease Classification

The accurate identification of corn leaf diseases is crucial for preventing disease spread and improving corn yield. Plant leaf images are often affected by factors such as complex backgrounds, climate, light, and sample data imbalance. To address these issues, we propose a lightweight convolutional neural network, ICS-ResNet, based on ResNet50. This network incorporates improved spatial and channel attention modules as well as a deep separable residual structure to enhance recognition accuracy. (1) The residual connections in the ResNet network prevent gradient loss during deep network training. (2) The improved channel attention (ICA) and spatial attention (ISA) modules fully utilize semantic information from different feature layers to accurately localize key features of the network. (3) To reduce the number of parameters and lower computational costs, we replace traditional convolutional computation with a depth-separable residual structure. (4) We also employ cosine annealing to dynamically adjust the learning rate, enhancing the network’s training stability, improving model convergence, and preventing local optima. Experiments on the corn dataset in Plant Village compare the proposed ICS-ResNet with eight popular networks: CSPNet, InceptionNet_v3, EfficientNet, ShuffleNet, MobileNet, ResNet50, ResNet101 and ResNet152. The results show that the ICS-ResNet achieves an accuracy of 98.87%, which is 5.03%, 3.18%, 1.13%, 1.81%, 1.13%, 0.68%, 0.44% and 0.60% higher than the other networks, respectively. Furthermore, the number of parameters and computations are reduced by 69.21% and 54.88%, respectively, compared to the original ResNet50 network, significantly improving the efficiency of corn leaf disease classification. The study provides strong technical support for sustainable agriculture and the promotion of agricultural science and technology innovation.

An efficient image classification and segmentation method for crime investigation applications

AbstractThe field of forensic science is experiencing significant growth, largely driven by the increasing integration of holographic and immersive technologies, along with their associated head-mounted displays. These immersive systems have become increasingly vital in resolving critical crimes as they facilitate communication, interaction, and collaboration. Given the sensitive nature of their work, crime investigators require substantial technical support. There is a pressing need for accurate documentation and archiving of crime scenes, which can be addressed by leveraging 3D scanned scenes to accurately represent evidence and expected scenarios. This study aims to develop an enhanced AR. system that can be deployed on hologram facilities such as the Microsoft HoloLens. The proposed system encompasses two main approaches, namely image classification and image segmentation. Image classification utilizes various deep learning models, including lightweight convolutional neural networks (CNNs) and convolutional Long-Short Term Memory (ConvLSTM). Additionally, the image segmentation approach is based on the fuzzy active contour model (FACM). The effectiveness of the proposed system was evaluated for both classification and segmentation tasks, utilizing metrics such as accuracy, sensitivity, precision, and F1 score. The simulation results indicate that the proposed system achieved a 99% accuracy rate in classification and segmentation tasks, positioning it as an effective solution for detecting bloodstain patterns in AR applications.

Solid Waste Detection Using Enhanced YOLOv8 Lightweight Convolutional Neural Networks

Solid Waste Detection Using Enhanced YOLOv8 Lightweight Convolutional Neural Networks

Enhancing agriculture through real-time grape leaf disease classification via an edge device with a lightweight CNN architecture and Grad-CAM

Crop diseases can significantly affect various aspects of crop cultivation, including crop yield, quality, production costs, and crop loss. The utilization of modern technologies such as image analysis via machine learning techniques enables early and precise detection of crop diseases, hence empowering farmers to effectively manage and avoid the occurrence of crop diseases. The proposed methodology involves the use of modified MobileNetV3Large model deployed on edge device for real-time monitoring of grape leaf disease while reducing computational memory demands and ensuring satisfactory classification performance. To enhance applicability of MobileNetV3Large, custom layers consisting of two dense layers were added, each followed by a dropout layer, helped mitigate overfitting and ensured that the model remains efficient. Comparisons among other models showed that the proposed model outperformed those with an average train and test accuracy of 99.66% and 99.42%, with a precision, recall, and F1 score of approximately 99.42%. The model was deployed on an edge device (Nvidia Jetson Nano) using a custom developed GUI app and predicted from both saved and real-time data with high confidence values. Grad-CAM visualization was used to identify and represent image areas that affect the convolutional neural network (CNN) classification decision-making process with high accuracy. This research contributes to the development of plant disease classification technologies for edge devices, which have the potential to enhance the ability of autonomous farming for farmers, agronomists, and researchers to monitor and mitigate plant diseases efficiently and effectively, with a positive impact on global food security.

Efficient and lightweight convolutional neural network architecture search methods for object classification

Determining the architecture of deep learning models is a complex task. Several automated search techniques have been proposed, but these methods typically require high-performance graphics processing units (GPUs), manual parameter adjustments, and specific training approaches. This study introduces an efficient, lightweight convolutional neural network architecture search approach tailored for object classification. It features an optimized search space design and a novel controller design.This study introduces a refined search space design incorporating optimizations in both spatial and operational aspects. The focus is on the synergistic integration of convolutional units, dimension reduction units, and the stacking of Convolutional Neural Network (CNN) architectures. To enhance the search space, ShuffleNet modules are integrated, reducing the number of parameters and training time. Additionally, BlurPool is implemented in the dimension reduction unit operation to achieve translational invariance, alleviate the gradient vanishing problem, and optimize unit compositions. Moreover, an innovative controller model, Stage LSTM, is proposed based on Long Short-Term Memory (LSTM) to generate lightweight architectural sequences. In conclusion, the refined search space design and the Stage LSTM controller model are synergistically combined to establish an efficient and lightweight architecture search technique termed Stage and Lightweight Network Architecture Search (SLNAS).The experimental results highlight the superior performance of the optimized search space design, primarily when implemented with the Stage LSTM controller model. This approach shows significantly improved accuracy and stability compared to random, traditional LSTM, and Genetic Algorithm (GA) controller models, with statistically significant differences. Notably, the Stage LSTM controller excels in accuracy while producing models with fewer parameters within the expanded architecture search space.The study adopts the Stage LSTM controller model due to its ability to approximate optimal sequence structures, particularly when combined with the optimized search space design, referred to as SLNAS. SLNAS's performance is evaluated through experiments and comparisons with other Neural Architecture Search (NAS) and object classification methods from different researchers. These experiments consider model parameters, hardware resources, model stability, and multiple datasets. The results show that SLNAS achieves a low error rate of 2.86 % on the CIFAR-10 dataset after just 0.2 days of architecture search, matching the performance of manually designed models but using only 2 % of the parameters. SLNAS consistently demonstrates robust performance across various image classification domains, with an approximate parameter count 700,000.To summarize, SLNAS emerges as a highly effective automated network architecture search method tailored for image classification. It streamlines the model design process, making it accessible to researchers without specialized knowledge in deep learning. Optimizing this method unlocks the full potential of deep learning across diverse research areas. Interested parties can publicly access the source code and pre-trained models through the following link: https://github.com/huanyu-chen/LNASG-and-SLNAS-model.

MobileDenseNeXt: Investigations on biomedical image classification

Background and objectiveWe are living in the information era. Therefore, intelligence-based researchers are hot-topic such as artificial intelligence. In the artificial intelligence research area, machine learning and deep learning models have frequently used to create intelligence assistants and deep learning is the shining star of the AI. Specifically, in the computer vision, numerous deep learning models have been proposed, leading to a competition between transformers and convolutional neural networks (CNNs). Since the introduction of Vision Transformers (ViT), many transformer models have been advocated for computer vision, often overshadowing CNNs. Therefore, it is crucial to propose CNNs to showcase their prowess in image classification. This research introduces a lightweight CNN named MobileDenseNeXt. Materials and methodsThe proposed MobileDenseNeXt comprises four main blocks: (i) input, (ii) main, (iii) average pooling-based downsampling, and (iv) output. This research also incorporates convolution-based residual blocks and uses a depth concatenation layer to increase the number of filters. For downsampling, an average pooling operation has been employed, similar to the original DenseNet. Furthermore, the swish activation function is utilized in the presented CNN. MobileDenseNeXt has approximately 1.4 million learnable parameters, categorizing it as a lightweight CNN model. Additionally, a deep feature engineering approach has been developed using MobileDenseNeXt, incorporating two feature extractors with global average pooling and dropout layers, along with 10 feature selectors, to demonstrate the transfer learning capabilities of MobileDenseNeXt. ResultsThe recommended models achieved over 95% test classification accuracy on the used three datasets, unequivocally demonstrating the high image classification proficiency of the proposed MobileDenseNeXt. Moreover, to show general classification ability of the proposed model, MobileDenseNeXt was trained on the CIFAR10 dataset and reached 98.62% accuracy. ConclusionsThis research not only highlights the efficiency and effectiveness of MobileDenseNeXt in biomedical image classification but also highlights the competitive potential of this model for computer vision.

A Method to Extract Task-Related EEG Feature Based on Lightweight Convolutional Neural Network.

Unlocking task-related EEG spectra is crucial for neuroscience. Traditional convolutional neural networks (CNNs) effectively extract these features but face limitations like overfitting due to small datasets. To address this issue, we propose a lightweight CNN and assess its interpretability through the fully connected layer (FCL). Initially tested with two tasks (Task 1: open vs closed eyes, Task 2: interictal vs ictal stage), the CNN demonstrated enhanced spectral features in the alpha band for Task 1 and the theta band for Task 2, aligning with established neurophysiological characteristics. Subsequent experiments on two brain-computer interface tasks revealed a correlation between delta activity (around 1.55 Hz) and hand movement, with consistent results across pericentral electroencephalogram (EEG) channels. Compared to recent research, our method stands out by delivering task-related spectral features through FCL, resulting in significantly fewer trainable parameters while maintaining comparable interpretability. This indicates its potential suitability for a wider array of EEG decoding scenarios.

Res-MGCA-SE: a lightweight convolutional neural network based on vision transformer for medical image classification

Res-MGCA-SE: a lightweight convolutional neural network based on vision transformer for medical image classification

LMBiS-Net: A lightweight bidirectional skip connection based multipath CNN for retinal blood vessel segmentation

Blinding eye diseases are often related to changes in retinal structure, which can be detected by analysing retinal blood vessels in fundus images. However, existing techniques struggle to accurately segment these delicate vessels. Although deep learning has shown promise in medical image segmentation, its reliance on specific operations can limit its ability to capture crucial details such as the edges of the vessel. This paper introduces LMBiS-Net, a lightweight convolutional neural network designed for the segmentation of retinal vessels. LMBiS-Net achieves exceptional performance with a remarkably low number of learnable parameters (only 0.172 million). The network used multipath feature extraction blocks and incorporates bidirectional skip connections for the information flow between the encoder and decoder. In addition, we have optimised the efficiency of the model by carefully selecting the number of filters to avoid filter overlap. This optimisation significantly reduces training time and improves computational efficiency. To assess LMBiS-Net’s robustness and ability to generalise to unseen data, we conducted comprehensive evaluations on four publicly available datasets: DRIVE, STARE, CHASE_DB1, and HRF The proposed LMBiS-Net achieves significant performance metrics in various datasets. It obtains sensitivity values of 83.60%, 84.37%, 86.05%, and 83.48%, specificity values of 98.83%, 98.77%, 98.96%, and 98.77%, accuracy (acc) scores of 97.08%, 97.69%, 97.75%, and 96.90%, and AUC values of 98.80%, 98.82%, 98.71%, and 88.77% on the DRIVE, STARE, CHEASE_DB, and HRF datasets, respectively. In addition, it records F1 scores of 83.43%, 84.44%, 83.54%, and 78.73% on the same datasets. Our evaluations demonstrate that LMBiS-Net achieves high segmentation accuracy (acc) while exhibiting both robustness and generalisability across various retinal image datasets. This combination of qualities makes LMBiS-Net a promising tool for various clinical applications.

Robust Forest Fire Detection using Deep Convolutional Neural Networks

Forest fires pose significant threats to ecosystems, wildlife, and human lives, necessitating proactive measures for early detection and rapid response. This paper presents FireGuard, an efficient model for forest fire detection using deep convolutional neural networks (CNNs). Leveraging the power of deep learning and image processing techniques, FireGuard analyzes aerial imagery and satellite data to detect signs of smoke and fire outbreaks in forested areas. The model utilizes a lightweight CNN architecture optimized for real-time performance and resource-constrained environments, making it suitable for deployment on unmanned aerial vehicles (UAVs), surveillance cameras, and satellite platforms. Experimental results demonstrate the effectiveness of FireGuard in accurately identifying forest fires with high precision and recall, outperforming traditional methods and existing deep learning models. By providing early warnings of potential fire incidents, FireGuard enables timely intervention by fire fighting agencies, thereby mitigating the impact of forest fires and preserving natural habitats.