Convolutional Neural Network Architecture Research Articles

Investigation of the performances of Support Vector Machine, Random Forest, and 3D-2D Convolutional Neural Network for Hyperspectral Image Classification

Classification of the hyperspectral images (HSIs) is one of the most challenging tasks hyperspectral remote sensing. Various Machine Learning classification algorithms have been implemented to HSI classification. In recent years, several Convolutional Neural Network (CNN) architectures were developed for HSI classification. The aim of this study is to test the performance of CNN, and well-known Support Vector Machine and Random Forest algorithms using the HyRANK Loukia, Houston 2013, and Salinas Scene datasets. The findings indicate that the Modified HybridSN CNN outperformed other algorithms across all datasets, as demonstrated by various performance evaluation metrics.

Automated gall bladder cancer detection using artificial gorilla troops optimizer with transfer learning on ultrasound images

The gallbladder (GB) is a small pouch and a deep tissue placed under the liver. GB Cancer (GBC) is a deadly illness that is complex to discover in an initial phase. Initial diagnosis can significantly enhance the existence rate. Non-ionizing energy, low cost, and convenience make the US a general non-invasive analytical modality for patients with GB diseases. Automatic recognition of GBC from US imagery is a significant issue that has gained much attention from researchers. Recently, machine learning (ML) techniques dependent on convolutional neural network (CNN) architectures have prepared transformational growth in radiology and medical analysis for illnesses like lung, pancreatic, breast, and melanoma. Deep learning (DL) is a region of artificial intelligence (AI), a functional medical tomography model that can help in the initial analysis of GBC. This manuscript presents an Automated Gall Bladder Cancer Detection using an Artificial Gorilla Troops Optimizer with Transfer Learning (GBCD-AGTOTL) technique on Ultrasound Images. The GBCD-AGTOTL technique examines the US images for the presence of gall bladder cancer using the DL model. In the initial stage, the GBCD-AGTOTL technique preprocesses the US images using a median filtering (MF) approach. The GBCD-AGTOTL technique applies the Inception module for feature extraction, which learns the complex and intrinsic patterns in the pre-processed image. Besides, the AGTO algorithm-based hyperparameter tuning procedure takes place, which optimally picks the hyperparameter values of the Inception technique. Lastly, the bidirectional gated recurrent unit (BiGRU) model helps classify gall bladder cancer. A series of simulation analyses were performed to ensure the performance of the GBCD-AGTOTL technique on the GBC dataset. The experimental outcomes inferred the enhanced abilities of the GBCD-AGTOTL in detecting gall bladder cancer.

Assessment of Dataset Scalability for Classification of Black Sigatoka in Banana Crops Using UAV-Based Multispectral Images and Deep Learning Techniques

This paper presents an evaluation of different convolutional neural network (CNN) architectures using false-colour images obtained by multispectral sensors on drones for the detection of Black Sigatoka in banana crops. The objective is to use drones to improve the accuracy and efficiency of Black Sigatoka detection to reduce its impact on banana production and improve the sustainable management of banana crops, one of the most produced, traded, and important fruits for food security consumed worldwide. This study aims to improve the precision and accuracy in analysing the images and detecting the presence of the disease using deep learning algorithms. Moreover, we are using drones, multispectral images, and different CNNs, supported by transfer learning, to enhance and scale up the current approach using RGB images obtained by conventional cameras and even smartphone cameras, available in open datasets. The innovation of this study, compared to existing technologies for disease detection in crops, lies in the advantages offered by using drones for image acquisition of crops, in this case, constructing and testing our own datasets, which allows us to save time and resources in the identification of crop diseases in a highly scalable manner. The CNNs used are a type of artificial neural network widely utilised for machine training; they contain several specialised layers interconnected with each other in which the initial layers can detect lines and curves, and gradually become specialised until reaching deeper layers that recognise complex shapes. We use multispectral sensors to create false-colour images around the red colour spectra to distinguish infected leaves. Relevant results of this study include the construction of a dataset with 505 original drone images. By subdividing and converting them into false-colour images using the UAV’s multispectral sensors, we obtained 2706 objects of diseased leaves, 3102 objects of healthy leaves, and an additional 1192 objects of non-leaves to train classification algorithms. Additionally, 3640 labels of Black Sigatoka were generated by phytopathology experts, ideal for training algorithms to detect this disease in banana crops. In classification, we achieved a performance of 86.5% using false-colour images with red, red edge, and near-infrared composition through MobileNetV2 for three classes (healthy leaves, diseased leaves, and non-leaf extras). We obtained better results in identifying Black Sigatoka disease in banana crops using the classification approach with MobileNetV2 as well as our own datasets.

Automated Deep Learning-Based Finger Joint Segmentation in 3-D Ultrasound Images With Limited Dataset.

Ultrasound imaging has shown promise in assessing synovium inflammation associated early stages of rheumatoid arthritis (RA). The precise identification of the synovium and the quantification of inflammation-specific imaging biomarkers is a crucial aspect of accurately quantifying and grading RA. In this study, a deep learning-based approach is presented that automates the segmentation of the synovium in ultrasound images of finger joints affected by RA. Two convolutional neural network architectures for image segmentation were trained and validated in a limited number of 2-D images, extracted from N = 18 3-D ultrasound volumes acquired from N = 9 RA patients, with sparse ground truth annotations of the synovium. Various augmentation strategies were employed to enhance the diversity and size of the training dataset. The utilization of geometric and noise augmentation transforms resulted in the highest dice score (0.768 0.040, N = 6), as determined via six-fold cross-validation. In addition, the segmentation model is used to generate dense 3-D segmentation maps in the ultrasound volumes, based on the available sparse annotations. The developed technique shows promise in facilitating more efficient and standardized workflow for RA screening using ultrasound imaging.

A Convolutional Neural Network Approach for Precision Fish Disease Detection

Background: Detecting and classifying fish diseases is crucial for maintaining the health and sustainability of aquaculture systems. This study employs deep learning techniques, particularly Convolutional Neural Networks (CNNs), to automate the detection of various fish diseases using image data. Methods: The study utilizes a carefully curated dataset sourced from the Kaggle database, comprising images representing seven distinct types of fish diseases, along with images of healthy fish. Data preprocessing techniques, including resizing, rescaling, denoising, sharpening, and smoothing, are applied to enhance image quality and facilitate accurate disease detection. Data augmentation is employed to increase the model's ability to generalize to unseen data. The CNN architecture is designed with cascading convolutional layers, ReLU activation functions, and pooling operations to extract high-level features associated with fish infections. The model architecture, implemented using the Keras Sequential API, includes convolutional layers, max pooling layers, and densely connected layers for classification. Results: Experimental results demonstrated promising performance across various disease categories, with high accuracy and balanced precision and recall values for most classes. The study also discussed the impact of climate change on fish disease incidence and underscores the importance of effective monitoring and management practices facilitated by technological innovations such as Big Data, IoT, sensors, and robotics in ensuring sustainable fisheries management.

Detecting Alzheimer’s disease and brain tumors using machine learning and convolutional neural networks (CNNs)

This white paper presents a systematic study and proposes a novel solution for detecting Alzheimer's disease and brain tumors using machine learning (ML) and Convolutional Neural Networks (CNNs). Given the increasing prevalence of these neurological disorders and the critical need for early and accurate diagnosis, the proposed approach leverages advanced CNN architectures with multi-modal data fusion to enhance diagnostic precision. The study systematically reviews recent literature and integrates state-of-the-art techniques to propose a comprehensive framework that can be implemented in clinical settings. Keywords: Elaborated Proposed Solution, Detecting Alzheimer's Disease and Brain Tumors Using Machine Learning and Convolutional Neural Networks (CNNs)

Cognitive State Classification Using Convolutional Neural Networks on Gamma-Band EEG Signals

This study introduces a novel methodology for classifying cognitive states using convolutional neural networks (CNNs) on electroencephalography (EEG) data of 41 students, aimed at streamlining the traditionally labor-intensive analysis procedures utilized in EEGLAB. Concentrating on the 30–40 Hz frequency range within the gamma band, we developed a CNN model to analyze EEG signals recorded from the inferior parietal lobule during various cognitive tasks. The model demonstrated substantial efficacy, achieving an accuracy of 91.42%, precision of 71.41%, and recall of 72.51%, effectively distinguishing between high and low gamma activity states. This performance surpasses traditional machine learning methods for EEG analysis, such as support vector machines and random forests, which typically achieve accuracies between 70–85% for similar tasks. Our approach offers significant time savings over manual EEGLAB methods. The integration of event-related spectral perturbation (ERSP) analysis with a novel CNN architecture enables capture of both fine-grained and broad spectral EEG features, advancing the field of computational neuroscience. This research has implications for brain-computer interfaces, clinical diagnostics, and cognitive monitoring, offering a more efficient and accurate alternative to current EEG analysis methods.

Integrating neural networks with advanced optimization techniques for accurate kidney disease diagnosis

Kidney diseases pose a significant global health challenge, requiring precise diagnostic tools to improve patient outcomes. This study addresses this need by investigating three main categories of renal diseases: kidney stones, cysts, and tumors. Utilizing a comprehensive dataset of 12,446 CT whole abdomen and urogram images, this study developed an advanced AI-driven diagnostic system specifically tailored for kidney disease classification. The innovative approach of this study combines the strengths of traditional convolutional neural network architecture (AlexNet) with modern advancements in ConvNeXt architectures. By integrating AlexNet’s robust feature extraction capabilities with ConvNeXt’s advanced attention mechanisms, the paper achieved an exceptional classification accuracy of 99.85%. A key advancement in this study’s methodology lies in the strategic amalgamation of features from both networks. This paper concatenated hierarchical spatial information and incorporated self-attention mechanisms to enhance classification performance. Furthermore, the study introduced a custom optimization technique inspired by the Adam optimizer, which dynamically adjusts the step size based on gradient norms. This tailored optimizer facilitated faster convergence and more effective weight updates, imporving model performance. The model of this study demonstrated outstanding performance across various metrics, with an average precision of 99.89%, recall of 99.95%, and specificity of 99.83%. These results highlight the efficacy of the hybrid architecture and optimization strategy in accurately diagnosing kidney diseases. Additionally, the methodology of this paper emphasizes interpretability and explainability, which are crucial for the clinical deployment of deep learning models.

Automated Mango Classification Using Convolutional Neural Networks (CNN)

This paper presents a system developed for the automated classification of different mango varieties using Convolutional Neural Networks (CNNs). The model was trained on an image dataset containing labeled mango varieties, which was augmented to enhance robustness. The CNN architecture comprises convolutional layers, pooling layers, and fully connected layers, optimized using TensorFlow. The system achieved satisfactory accuracy on both training and validation datasets. Evaluation was conducted using confusion matrices and training curves. The proposed system can classify mango images in real- time, providing predictions with confidence scores. The results demonstrate the potential of deep learning in automating fruit classification tasks, offering significant benefits for agricultural and retail sectors by improving efficiency and accuracy.

Identifying Mergers in the Legacy Surveys with Few-shot Learning

Galaxy mergers exert a pivotal influence on the evolutionary trajectory of galaxies and the expansive development of cosmic structures. The primary challenge encountered in machine learning–based identification of merging galaxies arises from the scarcity of meticulously labeled data sets specifically dedicated to merging galaxies. In this paper, we propose a novel framework utilizing few-shot learning techniques to identify galaxy mergers in the Legacy Surveys. Few-shot learning enables effective classification of merging galaxies even when confronted with limited labeled training samples. We employ a deep convolutional neural network architecture trained on data sets sampled from Galaxy Zoo Decals to learn essential features and generalize to new instances. Our experimental results demonstrate the efficacy of our approach, achieving high accuracy and precision in identifying galaxy mergers with few labeled training samples. Furthermore, we investigate the impact of various factors, such as the number of training samples and network architectures, on the performance of the few-shot learning model. The proposed methodology offers a promising avenue for automating the identification of galaxy mergers in large-scale surveys, facilitating the comprehensive study of galaxy evolution and structure formation. In pursuit of identifying galaxy mergers, our methodology is applied to analyze the Data Release 9 of the Dark Energy Spectroscopic Instrument Legacy Imaging Surveys. As a result, we have unveiled an extensive catalog encompassing 648,183 galaxy merger candidates. We publicly release the catalog alongside this paper.

Tuning parameters of deep neural network training algorithms pays off: a computational study

AbstractThe paper aims to investigate the impact of the optimization algorithms on the training of deep neural networks with an eye to the interaction between the optimizer and the generalization performance. In particular, we aim to analyze the behavior of state-of-the-art optimization algorithms in relationship to their hyperparameters setting to detect robustness with respect to the choice of a certain starting point in ending on different local solutions. We conduct extensive computational experiments using nine open-source optimization algorithms to train deep Convolutional Neural Network architectures on an image multi-class classification task. Precisely, we consider several architectures by changing the number of layers and neurons per layer, to evaluate the impact of different width and depth structures on the computational optimization performance. We show that the optimizers often return different local solutions and highlight the strong correlation between the quality of the solution found and the generalization capability of the trained network. We also discuss the role of hyperparameters tuning and show how a tuned hyperparameters setting can be re-used for the same task on different problems achieving better efficiency and generalization performance than a default setting.

Baby Cry Sound Detection: A Comparison of Mel Spectrogram Image on Convolutional Neural Network Models

Baby cries contain patterns that indicate their needs, such as pain, hunger, discomfort, colic, or fatigue. This study explores the use of Convolutional Neural Network (CNN) architectures for classifying baby cries using Mel Spectrogram images. The primary objective of this research is to compare the effectiveness of various CNN architectures such as VGG-16, VGG-19, LeNet-5, AlexNet, ResNet-50, and ResNet-152 in detecting baby needs based on their cries. The datasets used include the Donate-a-Cry Corpus and Dunstan Baby Language. The results show that AlexNet achieved the best performance with an accuracy of 84.78% on the Donate-a-Cry Corpus dataset and 72.73% on the Dunstan Baby Language dataset. Other models like ResNet-50 and LeNet-5 also demonstrated good performance although their computational efficiency varied, while VGG-16 and VGG-19 exhibited lower performance. This research provides significant contributions to the understanding and application of CNN models for baby cry classification. Practical implications include the development of baby cry detection applications that can assist parents and healthcare provide.

HeritageScript: A cutting-edge approach to historical manuscript script classification with CNN and vision transformer architectures

Determining the script of historical manuscripts is pivotal for understanding historical narratives, providing historians with vital insights into the past. In this study, our focus lies in developing an automated system for effectively identifying the script of historical documents using a deep learning approach. Leveraging the ClAMM dataset as the foundation for our system, we initiate the system with dataset preprocessing, employing two fundamental techniques: denoising through non-local means denoising and binarization using Canny-edge detection. These techniques prepare the document for keypoint detection facilitated by the Harris-corner detector, a feature-detection method. Subsequently, we cluster these keypoints utilizing the k-means algorithm and extract patches based on the identified features. The final step involves training these patches on deep learning models, with a comparative analysis between two architectures: Convolutional Neural Networks (CNN) and Vision Transformers (ViT). Given the absence of prior studies investigating the performance of vision transformers on historical manuscripts, our research fills this gap. The system undergoes a series of experiments to fine-tune its parameters for optimal performance. Our conclusive results demonstrate an average accuracy of 89.2 and 91.99% respectively of the CNN and ViT based proposed framework, surpassing the state of the art in historical script classification so far, and affirming the effectiveness of our automated script identification system.

Identifying the degree of cornstarch adulteration in turmeric powder using optimized convolutional neural network

Adulteration in different spices is an emerging challenge in human civilization. It is commonly detected using different analytical and instrumental techniques. Despite good accuracy and precision many of such techniques are limited by their high processing time, skilled manpower requirement, expensive machinery and portability factor. Computer vision methodology driven by powerful convolutional neural network (CNN) architectures can be a possible way to address those limitations. This paper presents a CNN driven computer vision model which can detect cornstarch adulteration in turmeric powder along with the degree of adulteration. The model has been optimized using binary genetic algorithm (BGA) for improved performance and consistency. The experimentations presented in this paper were conducted with an in-house database prepared for 4 levels of adulteration and found to provide about 98% overall accuracy. The less expensive and faster detection capability of the model along with its mobility makes this proposal a promising addition to the existing spice adulteration screening methods.

Lung Cancer Detection Using Convolutional Neural Networks

Lung cancer is among the most prevalent and deadly cancers worldwide. Accurate diagnosis and early detection are critical for improving lung cancer patient outcomes and survival rates. Thanks to developments in medical imaging technology, computer-aided diagnosis (CAD) systems have shown a great deal of promise in helping radiologists identify and diagnose lung cancer from medical images. Here, we present the use of convolutional neural networks (CNNs) to create an early detection system (CAD) for lung cancer. The suggested approach uses lung computed tomography (CT) scans as input and use a CNN architecture to extract high-level features from the pictures. We use transfer learning to enhance a CNN model trained on a large dataset of CT images. The CNN model has been taught to determine if a specific CT image contains lung cancer or not. We evaluate the performance of the proposed CAD system on a dataset of CT scans of the lungs from different institutions. The trial's results show that our CNN-based CAD system can reliably and precisely identify lung cancer from CT scans. We also show the comparative performance of our proposed system against the state-of-the-art machine learning methods for lung cancer prediction. In conclusion, the suggested CNN-based deep learning-based CAD system has produced encouraging results for lung cancer detection from CT scans. The approach might help radiologists identify and classify lung cancer early on, leading to better patient outcomes and survival rates. The viability and usefulness of the suggested approach in clinical practice require more study

Lightweight deep learning model for underwater waste segmentation based on sonar images

In recent years, the rapid accumulation of marine waste not only endangers the ecological environment but also causes seawater pollution. Traditional manual salvage methods often have low efficiency and pose safety risks to human operators, making automatic underwater waste recycling a mainstream approach. In this paper, we propose a lightweight multi-scale cross-level network for underwater waste segmentation based on sonar images that provides pixel-level location information and waste categories for autonomous underwater robots. In particular, we introduce hybrid perception and multi-scale attention modules to capture multi-scale contextual features and enhance high-level critical information, respectively. At the same time, we use sampling attention modules and cross-level interaction modules to achieve feature down-sampling and fuse detailed features and semantic features, respectively. Relevant experimental results indicate that our method outperforms other semantic segmentation models and achieves 74.66 % mIoU with only 0.68 M parameters. In particular, compared with the representative PIDNet Small model based on the convolutional neural network architecture, our method can improve the mIoU metric by 1.15 percentage points and can reduce model parameters by approximately 91 %. Compared with the representative SeaFormer T model based on the transformer architecture, our approach can improve the mIoU metric by 2.07 percentage points and can reduce model parameters by approximately 59 %. Our approach maintains a satisfactory balance between model parameters and segmentation performance. Our solution provides new insights into intelligent underwater waste recycling, which helps in promoting sustainable marine development.

A Performance Evaluation of Convolutional Neural Network Architectures for Pterygium Detection in Anterior Segment Eye Images.

In this article, various convolutional neural network (CNN) architectures for the detection of pterygium in the anterior segment of the eye are explored and compared. Five CNN architectures (ResNet101, ResNext101, Se-ResNext50, ResNext50, and MobileNet V2) are evaluated with the objective of identifying one that surpasses the precision and diagnostic efficacy of the current existing solutions. The results show that the Se-ResNext50 architecture offers the best overall performance in terms of precision, recall, and accuracy, with values of 93%, 92%, and 92%, respectively, for these metrics. These results demonstrate its potential to enhance diagnostic tools in ophthalmology.

Automatic segmentation of echocardiographic images using a shifted windows vision transformer architecture

Echocardiography is one the most commonly used imaging modalities for the diagnosis of congenital heart disease. Echocardiographic image analysis is crucial to obtaining accurate cardiac anatomy information. Semantic segmentation models can be used to precisely delimit the borders of the left ventricle, and allow an accurate and automatic identification of the region of interest, which can be extremely useful for cardiologists. In the field of computer vision, convolutional neural network (CNN) architectures remain dominant. Existing CNN approaches have proved highly efficient for the segmentation of various medical images over the past decade. However, these solutions usually struggle to capture long-range dependencies, especially when it comes to images with objects of different scales and complex structures. In this study, we present an efficient method for semantic segmentation of echocardiographic images that overcomes these challenges by leveraging the self-attention mechanism of the Transformer architecture. The proposed solution extracts long-range dependencies and efficiently processes objects at different scales, improving performance in a variety of tasks. We introduce Shifted Windows Transformer models (Swin Transformers), which encode both the content of anatomical structures and the relationship between them. Our solution combines the Swin Transformer and U-Net architectures, producing a U-shaped variant. The validation of the proposed method is performed with the EchoNet-Dynamic dataset used to train our model. The results show an accuracy of 0.97, a Dice coefficient of 0.87, and an Intersection over union (IoU) of 0.78. Swin Transformer models are promising for semantically segmenting echocardiographic images and may help assist cardiologists in automatically analyzing and measuring complex echocardiographic images.

Versatile Video Coding-Post Processing Feature Fusion: A Post-Processing Convolutional Neural Network with Progressive Feature Fusion for Efficient Video Enhancement

Advanced video codecs such as High Efficiency Video Coding/H.265 (HEVC) and Versatile Video Coding/H.266 (VVC) are vital for streaming high-quality online video content, as they compress and transmit data efficiently. However, these codecs can occasionally degrade video quality by adding undesirable artifacts such as blockiness, blurriness, and ringing, which can detract from the viewer’s experience. To ensure a seamless and engaging video experience, it is essential to remove these artifacts, which improves viewer comfort and engagement. In this paper, we propose a deep feature fusion based convolutional neural network (CNN) architecture (VVC-PPFF) for post-processing approach to further enhance the performance of VVC. The proposed network, VVC-PPFF, harnesses the power of CNNs to enhance decoded frames, significantly improving the coding efficiency of the state-of-the-art VVC video coding standard. By combining deep features from early and later convolution layers, the network learns to extract both low-level and high-level features, resulting in more generalized outputs that adapt to different quantization parameter (QP) values. The proposed VVC-PPFF network achieves outstanding performance, with Bjøntegaard Delta Rate (BD-Rate) improvements of 5.81% and 6.98% for luma components in random access (RA) and low-delay (LD) configurations, respectively, while also boosting peak signal-to-noise ratio (PSNR).

A study on improving drug–drug interactions prediction using convolutional neural networks

Appropriate studies on drug–drug interactions (DDIs) can evade possible adverse side effects due to the ingestion of multiple drugs. This paper proposes a novel framework called Similarity Network Fusion and Hybrid Convolutional Neural Network (SNF–HCNN) to predict the DDIs better. The proposed framework leverages data from DrugBank, PubChem, and SIDER. Seven critical drug features are extracted: Target, Transporter, Enzymes, Chemical substructure, Carrier, Offside, and Side effects. The Jaccard Similarity measure evaluates the similarity of drug features to construct a comprehensive similarity matrix that effectively captures potential drug relationships and patterns. The similarity selection process identifies the most relevant features, reduces redundancy, and enhances identifying potential drug interactions. Integrating Similarity Network Fusion (SNF) with the selected similarity matrix ensures a comprehensive representation of drug features and leads to superior accuracy compared to conventional methods. Our experimental results demonstrate the effectiveness of the proposed hybrid convolutional neural network (HCNN) architectures, such as CNN+LR (CNN+Logistic Regression), CNN+RF (CNN+Random Forest), and CNN+SVM (CNN+Support Vector Machine), showing impressive accuracies of 95.19%, 94.45%, and 93.65%, respectively. Moreover, CNN+LR outperforms other approaches regarding precision, sensitivity, F1-score, and AUC score, which implicate better outcomes for ensuring medication safety aspects in clinical settings in the future.