Deep Convolutional Network Research Articles

Safeguarding User-Centric Privacy in Smart Homes

Internet of Things (IoT) devices have been increasingly deployed in smart homes to automatically monitor and control their environments. Unfortunately, extensive recent research has shown that on-path external adversaries can infer and further fingerprint people’s sensitive private information by analyzing IoT network traffic traces. In addition, most recent approaches that aim to defend against these malicious IoT traffic analytics cannot adequately protect user privacy with reasonable traffic overhead. In particular, these approaches often did not consider practical traffic reshaping limitations, user daily routine permitting, and user privacy protection preference in their design. To address these issues, we design a new low-cost, open source user-centric defense system—PrivacyGuard—that enables people to regain the privacy leakage control of their IoT devices while still permitting sophisticated IoT data analytics that is necessary for smart home automation. In essence, our approach employs intelligent deep convolutional generative adversarial network assisted IoT device traffic signature learning, long short-term memory based artificial traffic signature injection, and partial traffic reshaping to obfuscate private information that can be observed in IoT device traffic traces. We evaluate PrivacyGuard using IoT network traffic traces of 31 IoT devices from five smart homes and buildings. We find that PrivacyGuard can effectively prevent a wide range of state-of-the-art adversarial machine learning and deep learning based user in-home activity inference and fingerprinting attacks and help users achieve the balance between their IoT data utility and privacy preserving.

The deep convolution network in immersive design of digital media art in smart city.

The goal of the paper is to examine how convolutional neural network (CNN) is used in the immersive world of digital media art. In order to do this, this paper first explains digital media art in the context of smart cities and the use of immersive scenarios. Next, a brief analysis of the Unet network model and deep aggregation structure is provided. Then, a projector, camera, and computer-based immersive projector-camera display system is constructed. Based on the mathematical reflection model of the system, this paper discusses the method of using CNN to solve the photometric compensation of the projection picture. Meanwhile, a Projection Compensation Network (PCN) is designed, and a multi-scale perceptual loss is added to this compensation network, and the content information of the compensated image is improved by calculating the loss of feature maps of different scales. The final network is named Perceptual Loss-Projection Compensation Network (PL-PCN). Experiments are used to confirm the PL-PCN model's efficacy. The outcomes demonstrate that the SSIM and PSNR of the projected picture compensated by PL-PCN are boosted by 35.8% and 31.6%, respectively. While the RMSE is reduced by 40.9%, demonstrating an improvement in the compensated image's quality. Additionally, utilizing a CNN makes it possible to do cross-reflection compensation. Additionally, compared to the network without deep polymerization, the PL-PCN with deep polymerization structure boosts the projected image's SSIM and PSNR by 6% and 7.57%, respectively, and lowers the RMSE by 13.3% This demonstrates that the addition of deep polymerization structure can have a stronger compensatory effect. This paper can offer a theoretical framework for improving the immersive scene quality of digital media art.

A Study of Radar Anti-Jamming Based on Deep Convolutional Mix Separation Network

A Study of Radar Anti-Jamming Based on Deep Convolutional Mix Separation Network

Image-based deep learning in diagnosing mycoplasma pneumonia on pediatric chest X-rays.

Correctly diagnosing and accurately distinguishing mycoplasma pneumonia in children has consistently posed a challenge in clinical practice, as it can directly impact the prognosis of affected children. To address this issue, we analyzed chest X-rays (CXR) using various deep learning models to diagnose pediatric mycoplasma pneumonia. We collected 578 cases of children with mycoplasma infection and 191 cases of children with virus infection, with available CXR sets. Three deep convolutional neural networks (ResNet50, DenseNet121, and EfficientNetv2-S) were used to distinguish mycoplasma pneumonia from viral pneumonia based on CXR. Accuracy, area under the curve (AUC), sensitivity, and specificity were used to evaluate the performance of the model. Visualization was also achieved through the use of Class Activation Mapping (CAM), providing more transparent and interpretable classification results. Of the three models evaluated, ResNet50 outperformed the others. Pretrained with the ZhangLabData dataset, the ResNet50 model achieved 80.00% accuracy in the validation set. The model also showed robustness in two test sets, with accuracy of 82.65 and 83.27%, and AUC values of 0.822 and 0.758. In the test results using ImageNet pre-training weights, the accuracy of the ResNet50 model in the validation set was 80.00%; the accuracy in the two test sets was 81.63 and 62.91%; and the corresponding AUC values were 0.851 and 0.776. The sensitivity values were 0.884 and 0.595, and the specificity values were 0.655 and 0.814. This study demonstrates that deep convolutional networks utilizing transfer learning are effective in detecting mycoplasma pneumonia based on chest X-rays (CXR). This suggests that, in the near future, such computer-aided detection approaches can be employed for the early screening of pneumonia pathogens. This has significant clinical implications for the rapid diagnosis and appropriate medical intervention of pneumonia, potentially enhancing the prognosis for affected children.

A study of machine learning applications in healthcare

Abstract. Machine learning, a sub-field of artificial intelligence, has numerous algorithms with applications in image recognition and classification, natural language processing, data prediction, medical diagnosis, and more, achieving significant results. Nowadays, the application of many algorithms of machine learning in the medical field has become a research hotspot and attracted wide attention from society, which plays a key role in disease screening, disease prediction, and assisted diagnosis of diseases. In this paper, we have developed a new approach to the medical field that can be applied in the healthcare industry by using technologies such as k-nearest neighbor (KNN), recurrent neural network (RNN), plain Bayesian (NB), decision tree (DTT), random forest (RF), deep convolutional adversarial network (DCAN), generative adversarial network (GAN), deep convolutional generative adversarial network (DCGAN),deep convolutional neural network (CNN), and support vector machine (SVM). By referring to the existing related literature and application practice results, this paper provides a systematic introduction to the application and research of machine learning in the medical field. This paper also analyses and describes the challenges and difficulties in the implementation of machine learning in the medical field.

Reconstruction of Fine-Spatial-Resolution FY-3D-Based Vegetation Indices to Achieve Farmland-Scale Winter Wheat Yield Estimation via Fusion with Sentinel-2 Data

The spatial resolution (250–1000 m) of the FY-3D MERSI is too coarse for agricultural monitoring at the farmland scale (20–30 m). To achieve the winter wheat yield (WWY) at the farmland scale, based on FY-3D, a method framework is developed in this work. The enhanced deep convolutional spatiotemporal fusion network (EDCSTFN) was used to perform a spatiotemporal fusion on the 10 day interval FY-3D and Sentinel-2 vegetation indices (VIs), which were compared with the enhanced spatial and temporal adaptive reflectance fusion model (ESTARFM). In addition, a BP neural network was built to calculate the farmland-scale WWY based on the fused VIs, and the Aqua MODIS gross primary productivity product was used as ancillary data for WWY estimation. The results reveal that both the EDCSTFN and ESTARFM achieve satisfactory precision in the fusion of the Sentinel-2 and FY-3D VIs; however, when the period of spatiotemporal data fusion is relatively long, the EDCSTFN can achieve greater precision than ESTARFM. Finally, the WWY estimation results based on the fused VIs show remarkable correlations with the WWY data at the county scale and provide abundant spatial distribution details about the WWY, displaying great potential for accurate farmland-scale WWY estimations based on reconstructed fine-spatial-temporal-resolution FY-3D data.

Reliable Augmentation and Precise Identification of EPG Waveforms Based on Multi-Criteria DCGAN

The electrical penetration graph (EPG) technique is of great significance in elucidating the mechanisms of virus transmission by piercing-sucking insects and crop resistance to these insects. The traditional method of manually processing EPG signals encounters the drawbacks of inefficiency and subjectivity. This study investigated the data augmentation and automatic identification of various EPG signals, including A, B, C, PD, E1, E2, and G, which correspond to distinct behaviors exhibited by the Asian citrus psyllid. Specifically, a data augmentation method based on an improved deep convolutional generative adversarial network (DCGAN) was proposed to address the challenge of insufficient E1 waveforms. A multi-criteria evaluation framework was constructed, leveraging maximum mean discrepancy (MMD) to evaluate the similarity between the generated and real data, and singular value decomposition (SVD) was incorporated to optimize the training iterations of DCGAN and ensure data diversity. Four models, convolutional neural network (CNN), K-nearest neighbors (KNN), decision tree (DT), and support vector machine (SVM), were established based on DCGAN to classify the EPG waveforms. The results showed that the parameter-optimized DCGAN strategy significantly improved the model accuracies by 5.8%, 6.9%, 7.1%, and 7.9% for DT, SVM, KNN, and CNN, respectively. Notably, DCGAN-CNN effectively addressed the skewed distribution of EPG waveforms, achieving an optimal classification accuracy of 94.13%. The multi-criteria optimized DCGAN-CNN model proposed in this study enables reliable augmentation and precise automatic identification of EPG waveforms, holding significant practical implications for understanding psyllid behavior and controlling citrus huanglongbing.

An Adaptive Framework for Traffic Congestion Prediction using Deep Learning

Aim and background: Congestion on China's roads has worsened in recent years due to the country's rapid economic development, rising urban population, rising private car ownership, inequitable traffic flow distribution, and growing local congestion. As cities expand, traffic congestion has become an unavoidable nuisance that endangers the safety and progress of its residents. Improving the utilization rate of municipal transportation facilities and relieving traffic congestion depend on a thorough and accurate identification of the current state of road traffic and necessitate anticipating road congestion in the city. Methodology: In this research, we suggest using a deep spatial and temporal graph convolutional network (DSGCN) to forecast the current state of traffic congestion. To begin, we grid out the transportation system to create individual regions for analysis. In this work, we abstract the grid region centers as nodes, and we use an adjacency matrix to signify the dynamic correlations between the nodes. Results and Discussion: The spatial correlation between regions is then captured utilizing a Graph Convolutional-Neural-Network (GCNN), while the temporal correlation is captured using a two-layer long and short-term feature model (DSTM). Conclusion: Finally, testing on real PeMS datasets shows that the DSGCN has superior performance than other baseline models and provides more accurate traffic congestion prediction.

An Efficient DDoS Attack Detection and Prevention Model using fusion Heuristic Enhancement of Deep Learning Approach in FANET Sector

Problem OverviewA Flying Ad-hoc Network (FANET) is a decentralized communication network formed by Unmanned Aerial Vehicles (UAVs). However, it faces significant security challenges due to its decentralized nature and mobility. One of the most critical threats is the Distributed Denial-of-Service (DDoS) attack, which aims to overcome the network by flooding it with malicious actions, disrupting communication, and causing system failures. The primary challenge lies in detecting and mitigating such attacks in real-time, given the dynamic and complex nature of FANETs, where the rapid movement of UAVs complicates monitoring and defending mechanisms. MethodologyA novel detection and prevention model has been proposed to address the issue of DDoS attacks utilizing a hybrid heuristic-based machine learning approach tailored for FANET environments. The model begins by collecting necessary information using benchmark datasets to train and enhance the detection performance. The collected data is used for detecting the DDoS attack using Hybrid Deep Learning (HDL). The HDL model developed by combining Deep Temporal Convolutional Networks (DTCN) and Long Short-Term Memory (LSTM) networks, offers a powerful solution. DTCNs excel at detecting short-term, rapidly changing patterns in network traffic, which is essential for recognizing the instant effects of topology changes in FANETs. At the same time, LSTMs are designed to handle long-term dependencies and can used to the evolving patterns of UAV movement and traffic behavior over time. Here, the hyper-parameters are optimized by proposing the Hybrid of Water Strider and Cuckoo Search (HWSCS). Water Strider optimization (WSA) and Cuckoo Search Optimizer (CSO) are combined in the HWSCS algorithm. This algorithm is a versatile and powerful tool for optimizing multifaceted systems across different fields. Its combination of local and global search abilities allows it to find optimal solutions in complicated environments, making it invaluable for tasks ranging from machine learning to network security and beyond. In network security, HWSCS is effective in optimizing the parameters of intrusion detection systems, particularly in detecting complex cyber threats like DDoS attacks, ensuring more accuracy while reducing false positives. After detecting the DDoS attack, it is prevented from communication by establishing the routing process. This routing process involves rerouting the network traffic away from the affected areas and towards secure servers, effectively isolating the attack and minimizing its impact on the network. Additionally, it allows for greater flexibility and adaptability in responding to evolving threats in realtime. Here, the attack mitigation is accomplished by finding the Optimal Link State Routing (OLSR), estimated by the hybrid HWSCS algorithm. This algorithm determines the most efficient path for redirecting traffic away from the targeted servers, preventing overload, and maintaining network stability. The integration of HWSCS with OLSR not only improves network security but also proves the importance of innovative solutions in protecting malicious activities. Lastly, the model's performance is validated and measured with different metrics. ResultsThe proposed model demonstrated superior performance compared to traditional models. It achieved a recall of 93.87, significantly higher than other approaches like 89.22 for MobileNet, 89.40 for DTCN, 88.44 for LSTM, and 88.35 for DTCN-LSTM. This improved detection accuracy, combined with the effective routing mechanism, ensures better prevention and mitigation of DDoS attacks in FANETs. The results confirm the model's ability to not only detect attacks but also minimize network disruption, providing a robust solution for maintaining secure and stable communication in FANET environments.

SkipNode: On Alleviating Performance Degradation for Deep Graph Convolutional Networks

SkipNode: On Alleviating Performance Degradation for Deep Graph Convolutional Networks

LW-DCGAN: a lightweight deep convolutional generative adversarial network for enhancing occluded face recognition

LW-DCGAN: a lightweight deep convolutional generative adversarial network for enhancing occluded face recognition

HRTBDA: a network for post-disaster building damage assessment based on remote sensing images

ABSTRACT Efficient building damage assessment after disasters is vital for emergency response and loss evaluation, but the task is complicated by diverse building structures and complex environments. Traditional methods using Convolutional Neural Networks (CNNs) struggle to capture global contextual features, limiting damage categorization accuracy. To address this, we introduce the High-Resolution Transformer Architecture for Building Damage Assessment (HRTBDA), which enhances multi-scale feature extraction. A Cross-Attention-Based Spatial Fusion (CSF) module is proposed to utilize the attention mechanism, improving the model’s ability to identify detailed associations in damaged buildings. Additionally, we propose a deep convolution network matching optimization strategy that integrates a multilayer perceptron and expands the receptive field, enhancing global feature perception. HRTBDA’s performance was evaluated on two public datasets and compared with five recent frameworks. The model achieved an F1-score of 86.0% in building localization and 78.4% in damage assessment, with a 4.8% improvement in detecting minor damages. These results demonstrate HRTBDA’s potential for improving building damage assessment and highlight its significant advancements over existing methods.

Improving losses & accuracy through design of deep convolutional generative adversarial network (DCGAN) for plant disease detection tasks

Improving losses & accuracy through design of deep convolutional generative adversarial network (DCGAN) for plant disease detection tasks

Improving Recognition of Road Users via Doppler Radar Data and Deep Learning Convolutional Networks

This research presents findings from laboratory experiments on a novel method for identifying and differentiating objects using radar signatures and a specialized convolutional neural network architecture. Previously introduced by the authors, this method has been validated through real-world measurements in an urban environment with a 24 GHz frequency-modulated continuous-wave radar. This study describes how radar signatures, generated in the MATLAB (R2023b) environment from I and Q signals captured by the uRAD USB v1.2 radar, were processed. A database of radar signatures for pedestrians, cyclists, and vehicles was created, and a tailored convolutional neural network was trained. The developed solution achieves an accuracy of over 95% in distinguishing between various objects. The simulation results and successful tests support the application of this system across various sectors. The key innovations include distinguishing multiple objects from a single radar signature, a custom architecture for the convolutional neural network, and an application that processes radar data to produce near-real-time recognition results.

Physics-informed deep convolutional network for combined sea ice concentration and velocity prediction

Accurate prediction of short-term fluctuations in Arctic sea ice is important for safe use of Arctic shipping routes. While deep-learning models can improve the accuracy of sea-ice predictions, the accuracy and predictability of short-term sea-ice conditions are limited in most purely data-driven deep-learning models that consider a single aspect of sea ice, without considering the physical variation law between several sea ice factors. We propose dual-task prediction models for sea ice concentration (SIC) and sea ice velocity (SIV), and incorporate a loss function that simultaneously addresses dynamic constraints of SIC and SIV into each model, based on dynamics terms in the sea ice control equation. Comparative experiments are performed to determine which model structure best performs at predicting SIC and SIV. We report a dual-task branching structure to be more suitable for predicting SIC and SIV, and a post-decoder branch network structure to best predict SIC and SIV. Adding a sea ice dynamics equation to the loss function improves the model fit with dynamics law, improving the predictability and prediction accuracy of SIC and SIV.

An efficient attention-based hybridized deep learning network with deep RBM features for customer behavior prediction in digital marketing

PurposeAn efficient customer behavior prediction model is designed using deep learning techniques. The necessary data used for the implementation are taken from standard datasets and presented to perform subsequent tasks. Here, deep restricted Boltzmann machines (RBM) features are retrieved from the input images. Further, the extracted deep RBM features are presented to the customer behavior prediction phase. Here, the attention-based hybrid deep learning (A-HDL) technique is designed based on the incorporation of a dilated deep temporal convolutional network (dilated-DTCN) and a weighted recurrent neural network (weighted RNN). Moreover, the weights in RNN are tuned using a modernized random parameter-based cheetah optimizer (MRPCO). Further, various experiments were performed on the implemented framework, and it secured an enhanced customer behavior prediction rate than the conventional models.Design/methodology/approachA novel hybrid deep network-based customer behavior prediction model was developed to predict the behavior of the customer so the companies yield more income by advertising their products based on the predicted results.FindingsWhen considering the first dataset, the designed customer behavior prediction mechanism produced 94% accuracy, which is higher than the conventional techniques such as long short-term memory (LSTM), DTCN, RNN and A-HDL with 88%, 87%, 89% and 93%.Originality/valueThe precision and the accuracy of the developed MRPCO-A-HDL-based customer behavior prediction model progressed than the conventional techniques and algorithms.

Design and Research on Identification of Typical Tea Plant Diseases Using Small Sample Learning

Tea plants are susceptible to diseases during their growth. These diseases seriously affect the yield and quality of tea. The effective prevention and control of diseases requires accurate identification of diseases. With the development of artificial intelligence and computer vision, automatic recognition of plant diseases using image features has become feasible. As the support vector machine (SVM) is suitable for high dimension, high noise, and small sample learning, this paper uses the support vector machine learning method to realize the segmentation of disease spots of diseased tea plants. An improved Conditional Deep Convolutional Generation Adversarial Network with Gradient Penalty (C-DCGAN-GP) was used to expand the segmentation of tea plant spots. Finally, the Visual Geometry Group 16 (VGG16) deep learning classification network was trained by the expanded tea lesion images to realize tea disease recognition.

A comprehensive investigation on the performance of reconstruction of noncircular fiber-representative volume elements in unidirectional composites using diffusion generative models

This study employs diffusion generative models to reconstruct random representative volume elements (RVEs) of unidirectional composites with noncircular fibers. Microscope images of these composites were prepared and trained with denoising diffusion probabilistic model (DDPM), denoising diffusion implicit model (DDIM), progressive distillation diffusion model (PDDM), and deep convolutional generative adversarial network (DCGAN). Hyperparameter tuning was performed for both DDPM and PDDM, and the generated RVE images were evaluated using the two-point correlation function (TPCF), Fréchet Inception Distance (FID), and computational cost. Furthermore, finite element (FE) models were generated using these images, and FE simulations were conducted considering interfacial debonding behavior. The resulting stress and strain curves from these simulations were compared. The results show that DDPM demonstrated the best performance in final image quality, while PDDM maintained stable performance from the early stages of training. Additionally, both models exhibited excellent agreement with the original images, indicating high quality, diversity, and resemblance.

A deep learning‐based channel estimation and joint adaptive hybrid beamforming approach for mm‐wave massive MIMO with group‐of‐subarrays

SummaryMillimeter‐wave massive multiple‐input‐multiple‐output (MIMO) is a wireless communication that enables communication at extremely high data rates. It is widely used to expand communication bandwidth to improve spectral and energy efficiency. The mm‐wave system is usually based on the radio frequency (RF) chain. Beamforming is used to minimize the interface signal and maximize each user's received signal power. The hybrid beamforming method uses channel estimation and beam generation techniques that improve overall performance and save energy. There are various limitations and disadvantages arising from different techniques of the MIMO system. Hence, the proposed model is introduced to enhance the performance and maximize the spectral and energy efficiency. Initially, the optimal RF chain selection and channel optimization are done by the differential evolution firefly‐assisted optimized channel compression‐reconstruction (DEF_OCCR) network. In this research, the RF chain selection process is done using hybrid differential evolution firefly optimization. A robust autoencoder‐driven deep learning model is proposed for channel estimation after RF chain selection. Finally, the deep learning convolutional joint adaptive hybrid beamforming network (DConvHB) is used for beamforming to maximize spectral efficiency. The overall performance of this work is analyzed using several existing models to describe its superiority. The average system throughput is 12.85 bits, and the spectral efficiency of the proposed model is 5 bits for 10 dB and 32.18 bits for 13 dB. The proposed energy efficiency model is 1.73 bits and 4.96 bits for 10 dB.

An improved deep convolutional generative adversarial network for quantification of catechins in fermented black tea

The rapid and non-destructive quantification of catechins in fermented black tea is crucial for evaluating the quality of black tea. The combination of hyperspectral imaging and chemometrics has been applied for quantitative detection, but its performance is usually constrained by the limited dataset size. Targeted at the challenge of insufficient samples in regression analysis of catechins, this study proposes an improved deep convolutional generative adversarial network with labeling module, named as DCGAN-L for hyperspectral data augmentation. The DCGAN-L consists of the spectral and label generating modules. First the synthetic spectra were generated, and an indicator was proposed to evaluate their quality. Then, the corresponding label values were generated, including epicatechin gallate (ECG), epicatechin (EGC), catechin (C), and total catechin (CC). For label generating, the Euclidean distances between the synthetic spectrum and all true spectra were measured, followed by allocating weights for calculating the label values based on these distances. Subsequently, the training dataset was augmented with the generated synthetic data. The effect of data augmentation was finally evaluated based on two regression models of random forest (RF) and broad learning system (BLS) for the quantification of catechins. Compared with the results before data augmentation, the average R2 of RF and BLS models increased by 0.044 and 0.164, respectively. The proposed DCGAN-L model allows for the rapid, non-destructive quantification of catechins in black tea in the case of limited sample size.