Deep Network Model Research Articles

Research on deep unfolding network reconstruction method based on scalable sampling of transient signals.

In order to solve the problems of long reconstruction time and low reconstruction accuracy of compressed sensing reconstruction algorithm in the measurement of transient signals, a deep unfolding network reconstruction method based on scalable sampling is proposed to achieve fast and high-quality reconstruction of transient signal under low number of measurements. Firstly, the measurement process of compressed sensing is embedded into the neural network to realize automatic design and optimization of the observation matrix, which can reduce the number of measurements. Secondly, scalable sampling is introduced into the measurement process of compressed sensing, which can realize the training of data with different sampling ratios in the same model. Finally, a deep unfolding network model is designed to reconstruct the transient signal, which not only realizes the interpretability of the reconstructed network, but also achieves fast and high-quality reconstruction of the transient signal under the low number of measurements. Experimental results show that compared with the traditional compressed sensing reconstruction algorithms, the proposed method can obtain high-quality reconstruction accuracy with lower measurement times, and the reconstruction time is greatly reduced. The algorithm in this paper also obtains good reconstruction results under different sampling ratios, which shows that the method in this paper has good adaptability and effectiveness.

Blockchain-Based Intelligent Inventory Management for Hospital Supply Chain (HSC) with Deep Learning Techniques

A medication shortage may have far-reaching consequences, making it an important inventory management concern for healthcare organizations. Intelligent demand forecasting is essential to make cold chain businesses more competitive and save transportation and storage costs. Hence, this paper proposes a blockchain-based intelligent inventory management model (BC-IIMM) with deep learning techniques for hospitals to prevent running out of supplies, run their systems sustainably, and optimize their profits in the hospital supply chain (HSC).Preventing the contamination of pharmaceuticals requires a pharmaceutical cold chain monitoring system that uses IoT devices, blockchain, and cloud computing to track items across their entire supply chain reliably. One other perk is that both doctors and patients may benefit from drug recommendations made by a deep belief network (DBN) model. Further, to construct deep learning (DL), the proposed cold chain monitoring system produces large-scale, high-quality data. Holding cold chain items would become less expensive and cold chain inventory management decisions would be easier with it.Next, they provide a numerical result proving the suggested method works better than the baselines regarding refilling cost and shortage rate.

An efficient deep reinforcement learning based task scheduler in cloud-fog environment

Efficient task scheduling in cloud and fog computing environments remains a significant challenge due to the diverse nature and critical processing requirements of tasks originating from heterogeneous devices. Traditional scheduling methods often struggle with high latency and inadequate processing times, especially in applications demanding strict computational efficiency. To address these challenges, this paper proposes an advanced fog-cloud integration approach utilizing a deep reinforcement learning-based task scheduler, DRLMOTS (Deep Reinforcement Learning based Multi Objective Task Scheduler in Cloud Fog Environment). This novel scheduler intelligently evaluates task characteristics, such as length and processing capacity, to dynamically allocate computation to either fog nodes or cloud resources. The methodology leverages a Deep Q-Learning Network model and includes extensive simulations using both randomized workloads and real-world Google Jobs Workloads. Comparative analysis demonstrates that DRLMOTS significantly outperforms existing baseline algorithms such as CNN, LSTM, and GGCN, achieving a substantial reduction in makespan by up to 26.80%, 18.84, and 13.83% and decreasing energy consumption by up to 39.60%, 30.29%, and 27.11%. Additionally, the proposed scheduler enhances fault tolerance, showcasing improvements of up to 221.89%, 17.05%, and 11.05% over conventional methods. These results validate the efficiency and robustness of DRLMOTS in optimizing task scheduling in fog-cloud environments.

An optimization driven deep belief network model for crop yield prediction in IoT based smart agriculture

An optimization driven deep belief network model for crop yield prediction in IoT based smart agriculture

Fluorescence spectroscopy combined with multilayer perceptron deep learning to identify the authenticity of monofloral honey—Rape honey

Honey authenticity is critical to honey quality. The development of a quick, easy, and non-destructive technique for determining the authenticity of honey encourages an improvement in honey quality. Here, the authenticity of monofloral honey—rape honey was determined using fluorescence spectroscopy combined with multilayer perceptron (MLP) deep learning, without the need for any prior feature extraction or pre-processing. A total of 91 raw fluorescence intensity data of the real and adulterated honey samples at a fixed excitation wavelength of 280 nm were first matrixed, and all data were then categorized into a training set, a validation set, and a test set with numbers of 64, 16, and 11, respectively. The connection with dropout was selected to build and link the MLP internal network. The activation function, learning rate, optimizer, and number of epochs were among the hyperparameters of the MLP neural network that were tuned. A good MLP deep learning network model for determining the authenticity of monofloral honey, rape honey, was developed after constant validation and debugging. According to the accuracy curve of the MLP model, the accuracy of the training set increased with the number of epochs and eventually converged to 100 %, while the accuracy of the validation set could be well stabilized at about 100 % after 5000 epochs. Finally, the accuracy of the MLP model on the test set was close to 100 %. According to our findings, the MLP neural network and fluorescence intensity have great potential applications in identifying the authenticity of honey.

User emotion recognition and indoor space interaction design: a CNN model optimized by multimodal weighted networks

In interior interaction design, achieving intelligent user-interior interaction is contingent upon understanding the user’s emotional responses. Precise identification of the user’s visual emotions holds paramount importance. Current visual emotion recognition methods rely solely on singular features, predominantly facial expressions, resulting in inadequate coverage of visual characteristics and low recognition rates. This study introduces a deep learning-based multimodal weighting network model to address this challenge. The model initiates with a convolutional attention module, employing a self-attention mechanism within a convolutional neural network (CNN). As a result, the multimodal weighting network model is integrated to optimize weights during training. Finally, a weight network classifier is derived from these optimized weights to facilitate visual emotion recognition. Experimental outcomes reveal a 77.057% correctness rate and a 74.75% accuracy rate in visual emotion recognition. Comparative analysis against existing models demonstrates the superiority of the multimodal weight network model, showcasing its potential to enhance human-centric and intelligent indoor interaction design.

Ancient Yi Script Handwriting Sample Repository

The ancient Yi script has been used for over 8000 years, which can be ranked with Oracle,Sumerian,Egyptian,Mayan and Harappan,and is one of the six ancient scripts in the world. In this article, we collected 2922 handwritten single word samples of commonly used ancient Yi characters. Each character was written by 310 people respectively, with a total of 427,939 valid characters. We completed continuous handwritten text sampling, written by 250 people, with 5 texts per person, covering topics such as Yi astronomy, geography, rituals, and agriculture. In the process of data collection, we proposed an automatic sampling method for ancient Yi script, and completed the automatic cutting and labeling of handwritten samples. Furthermore, we tested the recognition performance of the sorted data set under different deep learning network models. The results show that ancient Yi script has diverse shape structures and rich writing styles, which can be used as a benchmark data set in related fields such as handwritten text recognition and handwritten text generation.

Modeling the occupancy rate and nights spent at tourism accommodations of Spain using autoregressive deep learning networks

Purpose The purpose of this paper is to autoregressively model the net occupancy rate of beds and bedrooms in hotels and similar accommodations and the nights spent at these accommodations of Spain for the period of 1990–2023 using monthly data. Design/methodology/approach The monthly occupancy rate of hotels and the total number of hotel nights data of Spain for the 1990M01–2023M09 range is considered. An autoregressive deep learning network is developed for the modeling of both metrics. Moreover, the results of the proposed autoregressive deep learning method are compared to those of a classical artificial neural network. Findings The actual occupancy rate, total night data and the deep learning model results are compared showing the accuracy of the developed model. Moreover, the R2, mean absolute error, root mean square error and mean absolute percentage error of the models are calculated further demonstrating the high performance of the developed model. The R2 values higher than 0.9 are achieved for both occupancy rate and total number of hotel nights data. Practical implications The modeling results given in this paper demonstrate that the previous values of the net occupancy rate and the total number of nights can be used as inputs of a deep learning network model by which accurate forecasts can be made for the future values of the occupancy rate and the total number of hotel nights. This modeling approach possesses importance from the practical viewpoint considering that the accurate planning and forecast of the net occupancy rate and the total number of nights affect the tourism income. Originality/value This study differs from existing literature by attempting to model the occupancy rate and the total number of hotel nights data autoregressively using deep learning networks.

Modeling takeover time for non-driving related tasks using hybrid deep neural networks in conditionally automated vehicles

To enhance the safety of the transition from autonomous to manual driving control, one of the key factors is quantifying the safe takeover transition, namely the takeover time. Previous studies have focused on factors influencing takeover time and predicting takeover time using traditional methods, but there is a lack of research utilizing deep learning networks and driver physiological factors for takeover time prediction. Toward this end, we propose a hybrid deep learning network model dedicated to predicting drivers’ takeover time with a dataset obtained from a bench experiment involving 46 drivers. Firstly, to address the potential information loss commonly associated with traditional manual feature extraction techniques, a convolutional neural network (CNN) is developed to automatically extract physiological spatial representations from drivers. Additionally, a double-layer bidirectional long short-term memory network (DBiLSTM) is incorporated to model the physiological time representation dimension, enabling a more refined representation of physiological signals. Then, to tackle the complexities introduced by individual driver variations, a self-attention mechanism is enabling the model to automatically prioritize critical features, thereby enhancing the accuracy and reliability of its predictions. The results demonstrate that the proposed approach surpasses traditional machine learning network models in predictive accuracy for takeover time prediction, thereby exhibiting novelty in the field of vehicle takeover control research. This provides a more reliable technical foundation for anticipating the durations of vehicle takeovers.

Feasibility Analysis for Predicting Indian Ocean Bigeye Tuna (Thunnus obesus) Fishing Grounds Based on Temporal Characteristics of FY-3 Microwave Radiation Imager Data

Efficient and accurate fishery forecasting is of great significance in ensuring the efficiency of fishery operations. This paper proposes a fishery forecasting method using a brightness temperature (TB) time series spatial feature extraction and fusion model. Using Indian Ocean bigeye tuna fishery data from 2009 to 2021 as a reference, this paper discusses the feasibility of fishery forecasting using FY-3 Microwave Radiation Imager (MWRI) Level 1 TB data. For this paper, we designed a deep learning network model for radiometer TB time series feature extraction (TimeTB-FishNet) based on the Convolutional Neural Network (CNN), Gated Recurrent Unit (GRU), and Attention mechanism. After expanding the dimensions of TB features, the model uses them together with spatiotemporal feature factors (year, month, longitude, and latitude) as features. By adding the GRU and Attention to the CNN, the CNN-GRU-Attention model architecture is established and can extract deep time series spatial features from the data to achieve the best results. In the model validation experiments, the TimeTB-FishNet model performed optimally, with a coefficient of determination (R2) of 0.6643. In the generalization experiments, the R2 also reached 0.6261, with a root mean square error (RMSE) of 46.6031 kg/1000 hook. When the sea surface height (SSH) was introduced, the R2 further reached 0.6463, with a lower RMSE of 45.1318 kg/1000 hook. The experimental results show that the proposed method and model are feasible and effective. The proposed model can directly use enhanced radiometer TB data without relying on lagging ocean environmental product data, performing deep temporal and spatial feature extraction for fishery forecasting. This method can provide a reference for the fishing of bigeye tuna in the Indian Ocean.

A modified A* algorithm combining remote sensing technique to collect representative samples from unmanned surface vehicles.

Ensuring representativeness of collected samples is the most critical requirement of water sampling. Unmanned surface vehicles (USVs) have been widely adopted in water sampling, but current USV sampling path planning tend to overemphasize path optimization, neglecting the representative samples collection. This study proposed a modified A* algorithm that combined remote sensing technique while considering both path length and the representativeness of collected samples. Water quality parameters were initially retrieved using satellite remote sensing imagery and a deep belief network model, with the parameter value incorporated as coefficient Q in the heuristic function of A* algorithm. The adjustment coefficient k was then introduced into the coefficient Q to optimize the trade-off between sampling representativeness and path length. To evaluate the effectiveness of this algorithm, Chlorophyll-a concentration (Chl-a) was employed as the test parameter, with Chaohu Lake as the study area. Results showed that the algorithm was effective in collecting more representative samples in real-world conditions. As the coefficient k increased, the representativeness of collected samples enhanced, indicated by the Chl-a closely approximating the overall mean Chl-a and exhibiting a gradient distribution. This enhancement was also associated with increased path length. This study is significant in USV water sampling and water environment protection.

Classification of Faults in Power System Transmission Lines Using Deep Learning Methods with Real, Synthetic, and Public Datasets

Every part of society relies on energy systems due to the growing population and the constant demand for energy. Because of the high energy demands of transportation, industry, and daily life, energy systems are crucial to every part of society. Electrical transmission lines are a crucial component of the electrical power system. Therefore, in order to determine the power system’s protection plan and increase its reliability, it is critical to foresee and classify fault types. With this motivation, the main goal of this paper is to design a deep network model to classify faults in transmission lines based on real, generated, and publicly available datasets. A deep learning architecture that was based on a one-dimensional convolutional neural network (CNN) was utilized in this study. Accuracy, specificity, recall, precision, F1 score, ROC curves, and AUC were employed as performance criteria for the suggested model. Not only synthetic but also real data were used in this study. It has been seen that the created model can be used successfully for both real data and synthetic data. In order to measure the robustness of the network, it was tested with three different datasets consisting of real, generated, and publicly available datasets. In the paper, 1D CNN, one of the machine learning methods, was used on three different power systems, and it was observed that the machine learning method was successful in all three power systems.

A deep belief network model for predicting the material removal rate in the polishing process

A deep belief network model for predicting the material removal rate in the polishing process

Differential diagnosis of congenital ventricular septal defect and atrial septal defect in children using deep learning–based analysis of chest radiographs

BackgroundChildren with atrial septal defect (ASD) and ventricular septal defect (VSD) are frequently examined for respiratory symptoms, even when the underlying disease is not found. Chest radiographs often serve as the primary imaging modality. It is crucial to differentiate between ASD and VSD due to their distinct treatment.PurposeTo assess whether deep learning analysis of chest radiographs can more effectively differentiate between ASD and VSD in children.MethodsIn this retrospective study, chest radiographs and corresponding radiology reports from 1,194 patients were analyzed. The cases were categorized into a training set and a validation set, comprising 480 cases of ASD and 480 cases of VSD, and a test set with 115 cases of ASD and 119 cases of VSD. Four deep learning network models—ResNet-CBAM, InceptionV3, EfficientNet, and ViT—were developed for training, and a fivefold cross-validation method was employed to optimize the models. Receiver operating characteristic (ROC) curve analyses were conducted to assess the performance of each model. The most effective algorithm was compared with the interpretations provided by two radiologists on 234 images from the test group.ResultsThe average accuracy, sensitivity, and specificity of the four deep learning models in the differential diagnosis of VSD and ASD were higher than 70%. The AUC values of ResNet-CBAM, IncepetionV3, EfficientNet, and ViT were 0.87, 0.91, 0.90, and 0.66, respectively. Statistical analysis showed that the differential diagnosis efficiency of InceptionV3 was the highest, reaching 87% classification accuracy. The accuracy of InceptionV3 in the differential diagnosis of VSD and ASD was higher than that of the radiologists.ConclusionsDeep learning methods such as IncepetionV3 based on chest radiographs in the study showed good performance for differential diagnosis of congenital VSD and ASD, which may be able to assist radiologists in diagnosis, education, and training, and reduce missed diagnosis and misdiagnosis.

Multi-Source Data Fusion for Vehicle Maintenance Project Prediction

Ensuring road safety is heavily reliant on the effective maintenance of vehicles. Accurate predictions of maintenance requirements can substantially reduce ownership costs for vehicle owners. Consequently, this field has attracted increasing attention from researchers in recent years. However, existing studies primarily focus on predicting a limited number of maintenance needs, predominantly based solely on vehicle mileage and driving time. This approach often falls short, as it does not comprehensively monitor the overall health condition of vehicles, thus posing potential safety risks. To address this issue, we propose a deep fusion network model that utilizes multi-source data, including vehicle maintenance record data and vehicle base information data, to provide comprehensive predictions for vehicle maintenance projects. To capture the relationships among various maintenance projects, we create a correlation representation using the maintenance project co-occurrence matrix. Furthermore, building on the correlation representation, we propose a deep fusion network that employs the attention mechanism to efficiently merge vehicle mileage and vehicle base information. Experiments conducted on real data demonstrate the superior performance of our proposed model relative to competitive baseline models in predicting vehicle maintenance projects.

A self-iterative learning with dual attention mechanism fusion method for pumpkin seed quality equipment

To perform fast and accurate classification of pumpkin seeds, three batches of pumpkin seed images were taken. A self-iterative learning large kernel attention-Squeeze and Excitation-Residual Network34 (LKA-SE-ResNet34) model was proposed by adding dual attention mechanism fusion of large kernal attention (LKA) mechanism and Squeeze and Excitation (SE) attention mechanism to each residual module of ResNet34 for recognizing pumpkin seeds. ResNet34 network model was chosen as the basic framework by comparing GoogleNet, AlexNet, EfficientNet, MobileNet, DenseNet, ResNet34 and Residual Network50 (ResNet50) deep learning network models. The comparation result showed that the top two models with the highest accuracy (Acc) are ResNet50 network model and ResNet34 network model among the compared models. The experimental results showed that the self-iterative learning LKA-SE-ResNet34 model outperformed the above-mentioned other network models in pumpkin seed recognition with an accuracy of 91.8%. To further validate the effectiveness of the proposed model for small sample size of data, two-sided images and deformed images of pumpkin seeds were collected and used, and the experimental results still proved that the proposed model had good generalization ability and accuracy, with the accuracies of 93.63% and 94.15% for two sides of pumpkin seeds as well as an accuracy of 99.03% for deformed pumpkin seeds. A set of seed sorting machine and an application (APP) for non-destructive testing of seeds were initially developed.

Improving Non-Line-of-Sight Identification in Cellular Positioning Systems Using a Deep Autoencoding and Generative Adversarial Network Model

Positioning service is a critical technology that bridges the physical world with digital information, significantly enhancing efficiency and convenience in life and work. The evolution of 5G technology has proven that positioning services are integral components of current and future cellular networks. However, positioning accuracy is hindered by non-line-of-sight (NLoS) propagation, which severely affects the measurements of angles and delays. In this study, we introduced a deep autoencoding channel transform-generative adversarial network model that utilizes line-of-sight (LoS) samples as a singular category training set to fully extract the latent features of LoS, ultimately employing a discriminator as an NLoS identifier. We validated the proposed model in 5G indoor and indoor factory (dense clutter, low base station) scenarios by assessing its generalization capability across different scenarios. The results indicate that, compared to the state-of-the-art method, the proposed model markedly diminished the utilization of device resources and achieved a 2.15% higher area under the curve while reducing computing time by 12.6%. This approach holds promise for deployment in future positioning terminals to achieve superior localization precision, catering to commercial and industrial Internet of Things applications.

Blockchain-assisted improved interval type-2 fuzzy deep learning-based attack detection on internet of things driven consumer electronics

The Internet of Things (IoTs) revolutionizes the consumer electronics landscape by presenting a degree of personalization and interactivity that was previously unimaginable. Interconnected devices are now familiar with user characteristics, giving custom skills that improve the user's satisfaction. Still, IoT remains to transform the consumer electronics field; security in IoT becomes critical, and it is utilized by cyber attackers to pose risks to public safety, compromise data privacy, gain unauthorized access, and even disrupt operations. Robust security measures are crucial for maintaining trust in the proliferation and adoption of interconnected technologies, mitigating those risks, protecting sensitive data, and certifying the integrity of the IoT ecosystem. An intrusion detection system (IDS) is paramount in IoT security, as it dynamically monitors device behaviours and network traffic to detect and mitigate any possible cyber threats. Using machine learning (ML) methods and anomaly detection algorithms, IDS can rapidly identify abnormal activities, unauthorized access, or malicious behaviours within the IoT ecosystem, thus preserving the integrity of interconnected devices and networks, safeguarding sensitive data, and protecting against cyber-attacks. This work presents an Improved Crayfish Optimization Algorithm with Interval Type-2 Fuzzy Deep Learning (ICOA-IT2FDL) technique for Intrusion Detection on IoT infrastructure. The main intention of the ICOA-IT2FDL technique is to utilize a hyperparameter-tuned improved deep learning (DL) method for intrusion detection, thereby improving safety in the IoT infrastructure. BC technology can be used to accomplish security among consumer electronics. The ICOA-IT2FDL technique employs a linear scaling normalization (LSN) approach for data normalization. In addition, features are selected using an improved crayfish optimization algorithm (ICOA). This is followed by the ICOA-IT2FDL technique, which applies the interval type-2 fuzzy deep belief network (IT2-FDBN) model to identify intrusions. Finally, the bald eagle search (BES) model strategy improves the intrusion recognition rate. A series of investigations is accomplished to ensure the enhanced accomplishment of the ICOA-IT2FDL model. The experimentation results specified that the ICOA-IT2FDL model shows better recognition results compared to recent models.

Extraction of agricultural plastic greenhouses based on a U-Net Convolutional Neural Network Coupled with edge expansion and loss function improvement

ABSTRACT Agricultural plastic greenhouses (APGs) are crucial for sustainable agricultural planting, and accurate spatial distribution information acquisition is crucial. Deep learning network models can extract target features from remote sensing images more effectively than traditional interpretation methods, which face challenges like high workloads and poor repeatability. In this study, we aim to enhance the inventorying of Agricultural Plastic Greenhouses (APGs) by improving the extraction accuracy of their locations and numbers through remote sensing techniques. Utilizing GF-7 satellite imagery, we propose an enhanced U-Net convolutional neural network (CNN) model that incorporates edge information expansion and a joint loss function to optimize performance. The primary objective is to provide a rapid and accurate method for mapping APGs, which is crucial for effective agricultural management and environmental monitoring. The U-Net network’s accuracy was enhanced by 1.1% after expanding 3 × 3sample edge information, and further by 1.9% by combining edge extension and loss function constraints. Our results demonstrate that the modified U-Net model significantly improves extraction accuracy compared to traditional methods, thereby facilitating better inventory management and planning for agricultural cash crops. This advancement not only supports farmers in optimizing resources but also contributes to sustainable agricultural practices by enabling precise monitoring of APG distribution. Implication Statement Compared to traditional interpretation methods, which suffer problems such as heavy workloads, small adaptation ranges and poor repeatability, deep learning network models can better extract target features from remote sensing images. In this study, we used GF-7 image data to improve the traditional U-Net convolutional neural network (CNN) model. The Canny operator and Gaussian kernel (GK) function were used for sample edge expansion, and the binary cross-entropy and GK functions were used to jointly constrain the loss. Finally, APGs were accurately extracted and compared to those obtained with the original model. The results indicated that the APG extraction accuracy of the U-Net network was improved through the expansion of sample edge information and adoption of joint loss function constraints.

Improving the UNet with channel attention mechanism for Taihu Lake water body recognition

Abstract Accurate recognition of surface water bodies is important for disaster management and resource planning. To explore a higher-precision water body recognition method, propose an improved channel attention mechanism UNet (ECA-UNet) water body recognition model based on Sentinel-2A remote sensing images. Utilizing ECA-UNet, UNet, PSPnet, and DeeplabV3, as well as the traditional normalized water body index (NDWI), recognize the water body in the Taihu Lake area. Through comparative analysis, the following main conclusions are drawn: (1) The recognition accuracy of the deep learning network model is better than the traditional NDWI method, among which the ECA-UNet network model has the highest accuracy of 98.67%, and the lowest recognition accuracy of NDWI is 89.06%. (2) The ECA-UNet network model can effectively extract water body recognition targets, has a better recognition effect on local features of water bodies, and can improve the water body extraction effect. The above results show that the improved channel attention mechanism ECA-UNet has the highest accuracy in water body recognition in Taihu Lake, which provides a reference for subsequent research and applications in this field.