Convolutional Network Research Articles

Secure Face Recognition Using Fully Homomorphic Encryption and Convolutional Neural Networks

Secure Face Recognition Using Fully Homomorphic Encryption and Convolutional Neural Networks

Integrating Deep Learning with Generative Design and Topology Optimization for Efficient Additive Manufacturing

Abstract. Additive manufacturing (AM) through generative design and topology optimisation creates complex, lightweight structures with exceptional material efficiency and structural integrity. When coupled with deep learning functionality, generative design and topology optimisation can explore broader design spaces and optimise more efficiently, creating novel AM structures that utilise material more efficiently and have better strength and performance than their counterparts created through conventional AM methods. The study tackles how deep learning models such as convolutional neural networks (CNNs) can be integrated into generative design and topology optimisation and how these integration help optimise material usage, production time and performance. Case studies from the aerospace, automotive, and healthcare industries exemplify how these synergies resulted in more resilient, cost-effective designs that would not have been possible through conventional AM approaches. The study focuses on material usage efficiency, reduction in production time and performance improvement to showcase how deep learning integrations enhance the process from design conceptualisation, through iterations, to final production.

The Role of Artificial Intelligence in Revolutionizing Mental Health Services: A Data-Driven Approach

The potential of artificial intelligence (AI) to transform mental health care through individualized treatment approaches is significant. This research investigates the application of AI and extensive healthcare datasets to improve the precision of mental health diagnoses and treatments. The study employs various machine learning techniques, such as Random Forest, CatBoost, K-Nearest Neighbors, XGBoost, Convolutional Neural Networks, and Long Short-Term Memory networks, to analyze diverse data sources including electronic health records, neuroimaging, genetic information, and demographic data. Following thorough data preprocessing, model training, and evaluation using metrics like accuracy, precision, recall, F1 score, and Cohen's Kappa, the Random Forest algorithm emerges as the top performer with 98.7% accuracy. The research highlights the importance of addressing ethical considerations, such as protecting patient privacy, ensuring data security, and mitigating algorithmic bias when implementing AI in mental health services. The findings indicate that AI-based approaches can markedly improve diagnostic accuracy, provide tailored treatment suggestions, and facilitate early relapse detection, thus promoting proactive mental health management. Key Words: Artificial Intelligence, Mental Health, Data- Driven approach, Personalized Treatment, Machine Learning, Natural Language Processing.

A Comprehensive Review of Mobile Robot Navigation Using Deep Reinforcement Learning Algorithms in Crowded Environments

Navigation is a crucial challenge for mobile robots. Currently, deep reinforcement learning has attracted considerable attention and has witnessed substantial development owing to its robust performance and learning capabilities in real-world scenarios. Scientists leverage the advantages of deep neural networks, such as long short-term memory, recurrent neural networks, and convolutional neural networks, to integrate them into mobile robot navigation based on deep reinforcement learning. This integration aims to enhance the robot's motion control performance in both static and dynamic environments. This paper illustrates a comprehensive survey of deep reinforcement learning methods applied to mobile robot navigation systems in crowded environments, exploring various navigation frameworks based on deep reinforcement learning and their benefits over traditional simultaneous localization and mapping-based frameworks. Subsequently, we comprehensively compare and analyze the relationships and differences among three types of navigation: autonomous-based navigation, navigation based on simultaneous localization and mapping, and planning-based navigation. Moreover, the crowded environment includes static, dynamic, and a combination of obstacles in different typical application scenarios. Finally, we offer insights into the evolution of navigation based on deep reinforcement learning, addressing the problems and providing potential solutions associated with this emerging field.

Research on target detection and recognition system of autonomous driving based on deep learning

Abstract. Autonomous driving technology relies heavily on advanced target detection and recognition systems to ensure safety and efficiency. This essay explores how deep learning has revolutionized these systems in four key areas: lane detection, detection of obscured vehicle parts, blind spot detection, and multi-target detection. Traditional methods often struggle under challenging conditions, but deep learning approaches, including Convolutional Neural Networks (CNNs) and Fully Convolutional Networks (FCNs), offer superior performance by analyzing complex features from raw data. Techniques like the Detection of Incomplete Vehicles using Deep Learning and Image Inpainting (DIDA) enhance safety by reconstructing obscured vehicle parts. In blind spot detection, models such as Sep-Res-SE blocks provide an effective, cost-efficient alternative to radar systems. The Adaptive Perceive SSD (AP-SSD) framework improves multi-target detection accuracy and real-time tracking by incorporating advanced feature extraction and temporal analysis. The essay concludes with future research directions aimed at refining real-time capabilities, expanding datasets, and exploring collaborative learning to further enhance autonomous driving technology.

DEST: Difference enhanced-Swin Transformer for remote sensing change detection

ABSTRACT Remote sensing (RS) change detection (CD) has recently achieved remarkable success thanks to convolutional neural networks (CNNs). However, due to the limited receptive fields of CNN models, existing methods are prone to generating pseudo detections or missed detections. In this letter, we propose a difference enhanced-Swin Transformer network (DEST) for accurate and robust change detection in RS images. First, we design a difference enhancement module (DEM) in the feature extraction stage to boost the feature learning of differences for dual-temporal images at each level. Second, to enlarge the receptive fields of networks and capture more changed details, we apply a Swin Transformer module to the difference features to model the global contextual information. Third, to avoid the semantic loss and simultaneously solve the problem of uneven contributions of features at different levels, we design a feature weight fusion module (FWFM) to effectively aggregate multi-level feature difference maps. Extensive experimental results on two publicly available benchmarks demonstrate that the proposed method is superior to some state-of-the-art change detection models.

Design of automatic sorting system based on capsule neural network

Abstract. This paper proposes a vegetable disease classification system based on Capsule Neural Network (CapsNet), which uses the visual recognition mechanism of deep learning algorithms to improve the efficiency and accuracy of agricultural disease recognition. The CapsNet algorithm outperforms traditional Convolutional Neural Network (CNN) in few-shot learning and generalization due to its unique capsule structure and dynamic routing mechanism. Experimental results show that the proposed system performs well in the accuracy, robustness, and model interpretation of image recognition, and can accurately identify diseases even in the case of poor image quality or noise and occlusion. In addition, the embedded system of this experiment includes an image acquisition module, an algorithm core module, and a logic control module, which realizes the automation of the whole process from image acquisition to recognition result display. This study also discusses the scalability and adaptability of the system, as well as the future application prospects in agricultural intelligence and automation. It is expected that CapsNet will play a more critical role in artificial intelligence, especially in agrarian automation and smart agriculture.

Research on image recognition and processing application technology of unmanned vehicle based on deep learning

Abstract. Image recognition technology is critically important in various fields, including the rapidly advancing sector of autonomous vehicles. As one of the core components enabling driverless cars to perceive their environment and make informed decisions, image recognition has seen significant advancements due to deep learning. This paper focuses on the application of deep learning in image recognition for self-driving cars and explores its implications for the future of autonomous driving technology. To begin with, this paper examines the empirical evaluation of deep learning models in highway driving scenarios. By employing Convolutional Neural Networks (CNN), these models achieve high detection rates and superior accuracy in recognizing vehicles and lanes. The robustness of these models is tested under varying weather conditions and times, demonstrating their effectiveness compared to classical computer vision techniques. Next, the paper discusses radar-camera fusion technology, highlighting different fusion strategies such as data-level, feature-level, object-level, and hybrid-level. The findings suggest that while feature-level fusion excels in detecting small objects in complex scenes, hybrid-level fusion is optimal for diverse driving situations. This section provides valuable insights into the integration of multimodal data for improved object recognition and semantic segmentation. After discussing fusion technologies, the paper finally reviews the security challenges posed by adversarial attacks on deep learning-based unmanned systems.

Comprehensive Analysis of the Impact of Learning Rate and Dropout Rate on the Performance of Convolutional Neural Networks on the CIFAR-10 Dataset

Abstract. This study investigates the impact of two crucial hyperparameters, learning rate and dropout rate, on the performance of Convolutional Neural Networks (CNNs) on the CIFAR-10 dataset. Learning rate controls how quickly a model adapts to new data, while dropout rate helps prevent overfitting by randomly omitting neurons during training. These parameters are critical because they directly influence model convergence speed, accuracy, and generalization ability. By experimenting with various combinations of learning rates (0.01, 0.001, 0.0001) and dropout rates (0.3, 0.5, 0.7), we analyze the model's performance in terms of accuracy and overfitting. Our results suggest that a learning rate of 0.001 combined with a dropout rate of 0.5 yields the best balance between learning efficiency and generalization. This study offers important insights for optimizing hyperparameters in CNN training.

Remote sensing image scene recognition using MobileNet

Abstract. Remote sensing image scene recognition plays a pivotal role in various applications, including environmental monitoring, disaster response, urban planning, precision agriculture, and aids in resource management and policy formulation. However, utilizing established convolutional neural networks(CNNs) models like AlexNet and VGG9 for this task can be computationally intensive and time-consuming due to their extensive parameter requirements. This dissertation introduces a MobileNet-based CNN optimized for remote sensing image scene recognition. This lightweight model significantly reduces computational load and model size without compromising accuracy, thereby enhancing efficiency. Empirical results on the NWPU45 dataset demonstrate MobileNet's superiority, achieving an accuracy of 91.16%, a Kappa coefficient of 90.96%, and an F1 score of 91.16% on the test set. Moreover, MobileNet's compact architecture, with merely 3.2531 million parameters and 587.9342 million FLOPs, underscores its efficiency and makes it a promising candidate for practical deployment in remote sensing applications. The findings suggest that MobileNet not only addresses the challenge of computational intensity but also opens new avenues for advancing scene recognition technology in the field of remote sensing.

CNN-Based Distracted Driver Recognition: Enhancing Accuracy Through Optimized Training Techniques

Abstract. Distracted driving is a significant contributor to vehicle accidents worldwide, underscoring the need for an effective recognition model that can identify risky driver behaviors in real-time and provide timely alerts. This study proposes a Convolutional Neural Network (CNN)-based model designed to accurately detect distracted drivers. To optimize the model's performance, this paper implemented several strategic enhancements. During the preprocessing phase, 90% of the dataset was allocated for training, ensuring a comprehensive learning process, while the remaining 10% was used for validation to assess the model's accuracy. The Adam optimizer was chosen for its ability to dynamically adjust the learning rate, facilitating faster convergence to an optimal solution. Additionally, the Cross-Entropy loss function was employed to amplify errors during training, driving the model to correct inaccuracies more effectively. The model was trained over 25 epochs, resulting in an accuracy rate of nearly 80%. This level of performance demonstrates the models viability for real-world applications, where it can play a critical role in reducing accidents caused by distracted driving. Future research may focus on further refining the model by exploring advanced loss functions, optimizers, and CNN architectures, as well as incorporating more sophisticated data preprocessing techniques.

Classification of hand movements from EEG using a FusionNet based LSTM network.


Accurate classification of electroencephalogram (EEG) signals is crucial for advancing brain-computer interface (BCI) technology. However, current methods face significant challenges in classifying hand movement EEG signals, including effective spatial feature extraction, capturing temporal dependencies, and representing underlying signal dynamics.
Approach.
This paper introduces a novel multi-model fusion approach, FusionNet-LSTM, designed to address these issues. Specifically, it integrates Convolutional Neural Networks (CNN) for spatial feature extraction, Gated Recurrent Units (GRU) and Long Short-Term Memory (LSTM) networks for capturing temporal dependencies, and Autoregressive (AR) models for representing signal dynamics.
Main results.
Compared to single models and state-of-the-art methods, this fusion approach demonstrates substantial improvements in classification accuracy. Experimental results show that the proposed model achieves an accuracy of 87.1% in cross-subject data classification and 99.1% in within-subject data classification. Additionally, Gradient Boosting Trees were employed to evaluate the significance of various EEG features to the model.
Significance.
This study highlights the advantages of integrating multiple models and introduces a superior classification model, which is pivotal for the advancement of BCI systems.

Performance of vibration and current signals in the fault diagnosis of induction motors using deep learning and machine learning techniques

Induction motors (IMs) play a pivotal role in various industrial applications, powering critical systems such as pumps, compressors, fans, blowers, and refrigeration and air conditioning systems. Monitoring the health of these IMs is essential for ensuring reliable operation. Numerous sensors, including vibration, current, temperature, acoustic, and power sensors, can be employed for their health monitoring. This article conducts a comprehensive comparative analysis of two widely used sensors—vibration and current, for classifying different health states of IMs, such as a healthy condition, bearing fault, and misalignment. The study employed deep learning techniques, specifically 1D and 2D convolutional neural networks, trained on raw data. Additionally, machine learning techniques, including random forest and XGBoost, were utilized and trained on features derived from preprocessed signals using fast Fourier transform and discrete wavelet decomposition. Comparative results indicated that vibration signals achieved remarkably high accuracy, nearly 100%, in detecting the investigated mechanical faults, while current signals, after signal processing and manual feature extraction, achieved an accuracy of 87.41%. These results demonstrate that, though current sensors are a viable alternative to vibration sensors, their performance can be affected by the type and degree of the considered faults. This study also highlights the attributes of vibration and current signals in the health monitoring of rotating machinery such as IMs.

MRF-PINN: a multi-receptive-field convolutional physics-informed neural network for solving partial differential equations

MRF-PINN: a multi-receptive-field convolutional physics-informed neural network for solving partial differential equations

Hand Gesture Enabled Operation for Computer Using Deep Learning

This project aims to develop a system that detects hand gestures and prints corresponding instructions for computer operators. The system utilizes Deep learning algorithms CNN and mediapipe to recognize hand gestures, and then prints instructions for the operator to perform specific computer operations.Operations like Notepad Open,Shutdown,Volume Up,Volume Down etc.The system will consist of a webcam, a Deep learning model, and a printer. The webcam will capture images of hand gestures, which will be processed using the Deep learning model to identify the specific gesture. The system will then print the corresponding instruction on the printer. The system will be designed to be user-friendly and adaptable to different environments and hardware configurations.The system aims to improve efficiency, reduce errors, and enhance accessibility for computer operators. The proposed system consists of a hand gesture detection module, instruction printing module, and computer operation module. The system is trained using a dataset of hand gestures and corresponding computer operations. Experimental results show that the system achieves high accuracy in gesture recognition and instruction printing. The system has potential applications in various fields, including gaming, education, and healthcare. Key Words: Hand gesture detection, Deep learning, instruction printing, computer operation, accessibility, Mediapipe, CNN.

Polarimetric image denoising via non-local based cube matching convolutional neural network

Due to rapid advances in deep learning, many polarimetric image denoising networks have been developed and achieved promising results. However, these methods are based on general network architectures that do not fully exploit problem-specific knowledge, leading to over-smoothing results and poor generalization. Inspired by the non-local, which is an effective prior for image restoration, we propose a cube matching convolutional neural network to incorporate non-local operations into denoising models for polarimetric images. Specifically, the cube matching technique allows the denoising network to simultaneously exploit the non-local correlation and polarization relationship between the corresponding voxels of similar cubes. Rather than applying self-similarity directly in an isolated manner, the proposed cube matching module can be flexibly integrated into existing deep networks by combining with 3D convolution, achieving an effect equivalent to non-local means. This design enhances the generalization ability against various types and levels of noise. Experimental results show that using cube matching operations significantly improves denoising performance.

Employing Xception convolutional neural network through high-precision MRI analysis for brain tumor diagnosis

The classification of brain tumors from medical imaging is pivotal for accurate medical diagnosis but remains challenging due to the intricate morphologies of tumors and the precision required. Existing methodologies, including manual MRI evaluations and computer-assisted systems, primarily utilize conventional machine learning and pre-trained deep learning models. These systems often suffer from overfitting due to modest medical imaging datasets and exhibit limited generalizability on unseen data, alongside substantial computational demands that hinder real-time application. To enhance diagnostic accuracy and reliability, this research introduces an advanced model utilizing the Xception architecture, enriched with additional batch normalization and dropout layers to mitigate overfitting. This model is further refined by leveraging large-scale data through transfer learning and employing a customized dense layer setup tailored to effectively distinguish between meningioma, glioma, and pituitary tumor categories. This hybrid method not only capitalizes on the strengths of pre-trained network features but also adapts specific training to a targeted dataset, thereby improving the generalization capacity of the model across different imaging conditions. Demonstrating an important improvement in diagnostic performance, the proposed model achieves a classification accuracy of 98.039% on the test dataset, with precision and recall rates above 96% for all categories. These results underscore the possibility of the model as a reliable diagnostic tool in clinical settings, significantly surpassing existing diagnostic protocols for brain tumors.

An Adaptive Method for Predicting Bearing Remaining Useful Life Across Various Degradation Stages

Abstract Bearing degradation is a multi-stage, multi-trend and highly complex process, significant information discrepancies and extreme imbalances exist in degradation data across different stages. These complexities hinder the accuracy of predictive model in predicting the remaining useful life throughout all stages of the bearing's degradation. In this paper, a novel prediction model based on Adaptive Convolutional Neural Network (ACNN)-Multiple Kernel Convolutional Long Short-Term Memory (MKConvLSTM) is proposed, which utilizes adaptive feature extraction and multi-scale dynamic selection to solve the problem of multi-stage, multi trend and highly complex information in bearing degradation. First, the ACNN is used to perform convolutional feature extraction and adaptive mapping on input samples, effectively distinguishing the degradation stages Then, the MKConvLSTM generates features at different time scales and dynamically selects these features to capture temporal information during the degradation process, enriching the model's capability to represent complex information and improving its predictive performance. To validate the effectiveness of the proposed model, experiments were conducted on the PHM2012 datasets and XJTU datasets. The MAE and RMSE of ACNN-MKConvLSTM reaches 0.078 and 0.099 on the first dataset, 0.086 and 0.107 on the second dataset, respectively. approximately 23% and 17% improvement Compared to the baseline model, respectively. Experimental results demonstrate that the model exhibits high accuracy and robustness in bearing remaining useful life prediction, effectively addressing the impact of feature variations across different degradation stages on prediction performance.

Optimized convolutional neural network using grasshopper optimization technique for enhanced heart disease prediction

Optimized convolutional neural network using grasshopper optimization technique for enhanced heart disease prediction

Novel Approach in Vegetation Detection Using Multi-Scale Convolutional Neural Network

Vegetation segmentation plays a crucial role in accurately monitoring and analyzing vegetation cover, growth patterns, and changes over time, which in turn contributes to environmental studies, land management, and assessing the impact of climate change. This study explores the potential of a multi-scale convolutional neural network (MSCNN) design for object classification, specifically focusing on vegetation detection. The MSCNN is designed to integrate multi-scale feature extraction and attention mechanisms, enabling the model to capture both fine and coarse vegetation patterns effectively. Moreover, the MSCNN architecture integrates multiple convolutional layers with varying kernel sizes (3 × 3, 5 × 5, and 7 × 7), enabling the model to extract features at different scales, which is vital for identifying diverse vegetation patterns across various landscapes. Vegetation detection is demonstrated using three diverse datasets: the CamVid dataset, the FloodNet dataset, and the multispectral RIT-18 dataset. These datasets present a range of challenges, including variations in illumination, the presence of shadows, occlusion, scale differences, and cluttered backgrounds, which are common in real-world scenarios. The MSCNN architecture allows for the integration of information from multiple scales, facilitating the detection of diverse vegetation types under varying conditions. The performance of the proposed MSCNN method is rigorously evaluated and compared against state-of-the-art techniques in the field. Comprehensive experiments showcase the effectiveness of the approach, highlighting its robustness in accurately segmenting and classifying vegetation even in complex environments. The results indicate that the MSCNN design significantly outperforms traditional methods, achieving a remarkable global accuracy and boundary F1 score (BF score) of up to 98%. This superior performance underscores the MSCNN’s capability to enhance vegetation detection in imagery, making it a promising tool for applications in environmental monitoring and land use management.