Dynamic Convolutional Neural Network Research Articles

Automatic 3-dimensional quantification of orthodontically induced root resorption in cone-beam computed tomography images based on deep learning

Orthodontically induced root resorption (OIRR) is a common and undesirable consequence of orthodontic treatment. Traditionally, studies employ manual methods to conduct 3-dimensional quantitative analysis of OIRR via cone-beam computed tomography (CBCT), which is often subjective and time-consuming. With advancements in computer technology, deep learning-based approaches have gained traction in medical image processing. This study presents a deep learning-based model for the fully automatic extraction of root volume information and the localization of root resorption from CBCT images. In this cross-sectional, retrospective study, 4534 teeth from 105 patients were used to train and validate an automatic model for OIRR quantification. The protocol encompassed several steps: preprocessing of CBCT images involving automatic tooth segmentation and conversion into point clouds, followed by segmentation of tooth crowns and roots via the Dynamic Graph Convolutional Neural Network. The root volume was subsequently calculated, and OIRR localization was performed. The intraclass correlation coefficient was employed to validate the consistency between the automatic model and manual measurements. The proposed method strongly correlated with manual measurements in terms of root volume and OIRR severity assessment. The intraclass correlation coefficient values for average volume measurements at each tooth position exceeded 0.95 (P<0.001), with the accuracy of different OIRR severity classifications surpassing 0.8. The proposed methodology provides automatic and reliable tools for OIRR assessment, offering potential improvements in orthodontic treatment planning and monitoring.

Rolling bearing fault diagnosis method based on MSDCNN in strong noise environment

Aiming at the problems of poor noise resistance, high computational complexity and insufficient generalization performance of traditional bearing fault diagnosis methods based on deep learning, a rolling bearing fault diagnosis method based on multi-scale dynamic convolutional neural network (MSDCNN) is proposed. Firstly, the one-dimensional vibration signal of the rolling bearing is converted to the frequency domain by Fourier transform, and the features are further extracted by wide convolution kernel. Secondly, a multi-scale dynamic convolution structure is proposed, and the feature information extracted by convolution kernels of different sizes is given different weights by using an improved channel attention mechanism. Then, a self-calibrating spatial attention mechanism (SCSAM) is designed, and the extracted feature information is input into the spatial attention mechanism to capture the importance of different regions. Finally, the features are further extracted by small convolution kernels, and the fault category is classified by using Softmax classifier. The fault diagnosis performance of the proposed model is verified by three different data sets. The experimental results show that compared with other intelligent models, the proposed model has higher classification accuracy, better generalization ability and stronger robustness under strong noise background.

Analysis of the Influence of Rock Mechanics Variables on the Stability of Tunnel Surrounding Rock Based on Engineering Mathematics Applications

Tunnels are essential infrastructure elements, and it is critical to maintain their stability for both operation and safety. Using engineering techniques, this study examines the correlation between rock mass motorized characteristics and tunnel surrounding rock stability. This study utilizes the multi-sensor monitoring data of the surrounding rock mechanical characteristics and tunnel support structure collected during tunnel boring machine construction as its research object. The integrated cuckoo search optimized Upgraded dynamic convolutional neural network (ICSO-UDCNN) has been utilized for predicting the tunnel parameters. In general, the surrounding rock’s hardness correlates with its level, which in turn determines how quickly tunnels are being excavated. There is a stronger correlation of 98\% between the field penetration index (FPI) variables of the rock’s characteristic slope along the conditions surrounding the tunnel. The most significant factor influencing its deformation is the surrounding rock’s mechanical characteristics. For engineers and other decision-makers engaged in tunnel design, building, and maintenance, the study’s findings add a greater understanding of the variables affecting tunnel stability. This research provides an establishment for enhancing security protocols, lowering hazards related to tunneling operation, and optimizing tunnel engineering techniques by quantitatively evaluating the influence of rock mass mechanical factors on solidity.

A novel approach for APT attack detection based on an advanced computing

To enhance the effectiveness of the Advanced Persistent Threat (APT) detection process, this research proposes a new approach to build and analyze the behavior profiles of APT attacks in network traffic. To achieve this goal, this study carries out two main objectives, including (i) building the behavior profile of APT IP in network traffic using a new intelligent computation method; (ii) analyzing and evaluating the behavior profile of APT IP based on a deep graph network. Specifically, to build the behavior profile of APT IP, this article describes using a combination of two different data mining methods: Bidirectional Long Short-Term Memory (Bi) and Attention (A). Based on the obtained behavior profile, the Dynamic Graph Convolutional Neural Network (DGCNN) is proposed to extract the characteristics of APT IP and classify them. With the flexible combination of different components in the model, the important information and behavior of APT attacks are demonstrated, not only enhancing the accuracy of detecting attack campaigns but also reducing false predictions. The experimental results in the paper show that the method proposed in this study has brought better results than other approaches on all measurements. In particular, the accuracy of APT attack prediction results (Precision) reached from 84 to 91%, higher than other studies of over 7%. These experimental results have proven that the proposed BiADG model for detecting APT attacks in this study is proper and reasonable. In addition, those experimental results have not only proven the effectiveness and superiority of the proposed method in detecting APT attacks but have also opened up a new approach for other cyber-attack detections such as distributed denial of service, botnets, malware, phishing, etc.

A Robot Ground Medium Classification Algorithm Based on Feature Fusion and Adaptive Spatio-Temporal Cascade Networks

With technological advancements and scientific progress, mobile robots have found widespread applications across various fields. To enable robots to perform tasks safely and effectively in diverse and unknown environments, this paper proposes a ground medium classification algorithm for robots based on feature fusion and an adaptive spatio-temporal cascade network. Specifically, the original directional features in the dataset are first transformed into quaternion form. Then, spatio-temporal forward and reverse neighbors are identified using KD trees, and their connection strengths are evaluated via a kernel density estimation algorithm to determine the final set of neighbors. Subsequently, based on the connection strengths determined in the previous step, we perform noise reduction on the features using discrete wavelet transform. The noise-reduced features are then weighted and fused to generate a new feature representation.After feature fusion, the Adaptive Dynamic Convolutional Neural Network (ADC) proposed in this paper is cascaded with the Long Short-Term Memory (LSTM) network to further extract hybrid spatio-temporal feature information from the dataset, culminating in the final terrain classification. Experiments on the terrain type classification dataset demonstrate that our method achieves an average accuracy of 97.46% and an AUC of 99.80%, significantly outperforming other commonly used algorithms in the field. Furthermore, the effectiveness of each module in the proposed method is further demonstrated through ablation experiments.

Structural damage detection and localization via an unsupervised anomaly detection method

This study introduces an unsupervised machine learning framework for damage detection and localization in Structural Health Monitoring (SHM), leveraging dynamic graph convolutional neural networks and Transformer networks. This approach is specifically tailored to overcome the challenge of limited labeled data in SHM, enabling precise analysis and feature synthesis from sensor-derived time series data for accurate damage identification. Incorporating a novel ‘localization score’ enhances the framework’s precision in pinpointing structural damages by integrating data-driven insights with a physics-informed understanding of structural dynamics. Extensive validations on diverse structures, including a benchmark steel structure and a real-world cable-stayed bridge, underscore the framework’s effectiveness in anomaly detection and damage localization, showcasing its potential to safeguard critical infrastructure through advanced data-effective machine learning techniques.

DGCPPISP: a PPI site prediction model based on dynamic graph convolutional network and two-stage transfer learning

BackgroundProteins play a pivotal role in the diverse array of biological processes, making the precise prediction of protein–protein interaction (PPI) sites critical to numerous disciplines including biology, medicine and pharmacy. While deep learning methods have progressively been implemented for the prediction of PPI sites within proteins, the task of enhancing their predictive performance remains an arduous challenge.ResultsIn this paper, we propose a novel PPI site prediction model (DGCPPISP) based on a dynamic graph convolutional neural network and a two-stage transfer learning strategy. Initially, we implement the transfer learning from dual perspectives, namely feature input and model training that serve to supply efficacious prior knowledge for our model. Subsequently, we construct a network designed for the second stage of training, which is built on the foundation of dynamic graph convolution.ConclusionsTo evaluate its effectiveness, the performance of the DGCPPISP model is scrutinized using two benchmark datasets. The ensuing results demonstrate that DGCPPISP outshines competing methods in terms of performance. Specifically, DGCPPISP surpasses the second-best method, EGRET, by margins of 5.9%, 10.1%, and 13.3% for F1-measure, AUPRC, and MCC metrics respectively on Dset_186_72_PDB164. Similarly, on Dset_331, it eclipses the performance of the runner-up method, HN-PPISP, by 14.5%, 19.8%, and 29.9% respectively.

A Rotating Machinery Fault Diagnosis Method Based on Dynamic Graph Convolution Network and Hard Threshold Denoising.

With the development of precision sensing instruments and data storage devices, the fusion of multi-sensor data in gearbox fault diagnosis has attracted much attention. However, existing methods have difficulty in capturing the local temporal dependencies of multi-sensor monitoring information, and the inescapable noise severely decreases the accuracy of multi-sensor information fusion diagnosis. To address these issues, this paper proposes a fault diagnosis method based on dynamic graph convolutional neural networks and hard threshold denoising. Firstly, considering that the relationships between monitoring data from different sensors change over time, a dynamic graph structure is adopted to model the temporal dependencies of multi-sensor data, and, further, a graph convolutional neural network is constructed to achieve the interaction and feature extraction of temporal information from multi-sensor data. Secondly, to avoid the influence of noise in practical engineering, a hard threshold denoising strategy is designed, and a learnable hard threshold denoising layer is embedded into the graph neural network. Experimental fault datasets from two typical gearbox fault test benches under environmental noise are used to verify the effectiveness of the proposed method in gearbox fault diagnosis. The experimental results show that the proposed DDGCN method achieves an average diagnostic accuracy of up to 99.7% under different levels of environmental noise, demonstrating good noise resistance.

MP-DGCNN for the semantic segmentation of Chinese ancient building point clouds

Point cloud semantic segmentation is a key step in the scan-to-HBIM process. In order to reduce the information in the process of DGCNN, this paper proposes a Mix Pooling Dynamic Graph Convolutional Neural Network (MP-DGCNN) for the segmentation of ancient architecture point clouds. The proposed MP-DGCNN differs from DGCNN mainly in two aspects: (1) to more comprehensively characterize the local topological structure of points, the edge features are redefined, and distance and neighboring points are added to the original edge features; (2) based on a Multilayer Perceptron (MLP), an internal feature adjustment mechanism is established, and a learnable mix pooling operator is designed by fusing adaptive pooling, max pooling, average pooling, and aggregation pooling, to learn local graph features from the point cloud topology. To verify the proposed algorithm, experiments are conducted on the Qutan Temple point cloud dataset, and the results show that compared with PointNet, PointNet++, DGCNN, GACNet and LDGCNN, the MP-DGCNN segmentation network achieves the highest OA, mIOU and mAcc, reaching 90.19%,65.34% and 79.41%, respectively.

Real-World Spatial Synchronization of Event-CMOS Cameras through Deep Learning: A Novel CNN-DGCNN Approach.

This paper presents a new deep-learning architecture designed to enhance the spatial synchronization between CMOS and event cameras by harnessing their complementary characteristics. While CMOS cameras produce high-quality imagery, they struggle in rapidly changing environments-a limitation that event cameras overcome due to their superior temporal resolution and motion clarity. However, effective integration of these two technologies relies on achieving precise spatial alignment, a challenge unaddressed by current algorithms. Our architecture leverages a dynamic graph convolutional neural network (DGCNN) to process event data directly, improving synchronization accuracy. We found that synchronization precision strongly correlates with the spatial concentration and density of events, with denser distributions yielding better alignment results. Our empirical results demonstrate that areas with denser event clusters enhance calibration accuracy, with calibration errors increasing in more uniformly distributed event scenarios. This research pioneers scene-based synchronization between CMOS and event cameras, paving the way for advancements in mixed-modality visual systems. The implications are significant for applications requiring detailed visual and temporal information, setting new directions for the future of visual perception technologies.

Two-layer dynamic graph convolutional recurrent neural network for traffic flow prediction

Two-layer dynamic graph convolutional recurrent neural network for traffic flow prediction

A lightweight dynamic dual-damped wavelet-based convolutional neural network for interpretable bearing fault diagnosis

Wavelet-based convolutional neural networks (CNNS) have attracted widespread attention because they can improve the interpretability of intelligent fault diagnosis methods. However, the fault feature representation capability of typical wavelet-based convolution kernel frameworks must be strengthened to improve the diagnostic accuracy of complex faults. In the meantime, the large number of network parameters leads to high computational costs. To address these issues, a lightweight wavelet-based dynamic CNN, which comprises a dual-damping wavelet-based dynamic CNN (DWDC) block and a discrete wavelet transformation (DWT) enhancement (DWTE) block, is put forward. In the DWDC block, a wavelet convolution layer is initially designed, where a dual-damping wavelet is used as the kernel function to improve the match of the convolution kernel with fault impulses. Subsequently, a dynamic convolution layer with multiple parallel small-size convolutional kernels is designed to screen the fault features instead of a multilayer network structure, thereby greatly reducing the number of network parameters. Finally, the DWTE block is constructed by combining the DWT and residual dense block, and it can mine more fault information from the previously extracted features. The experiments on the variable speed bearing dataset, locomotive bearing dataset with constant speed and the Case Western Reserve University dataset prove that the proposed approach outperforms five classical CNN models and six advanced wavelet-based CNN models. In addition, it can effectively solve the issue of data imbalance because of its powerful feature extraction capability.

A novel lightweight dynamic focusing convolutional neural network LAND-FCNN for EEG emotion recognition

The inefficiency of model inference and the limited sample data are significant issues in electroencephalogram (EEG) emotion recognition models based on neural networks. Therefore, we propose a novel lightweight adaptive dynamic focusing convolutional neural network (LAND-FCNN). We use Partial Convolution (PConv) and Batch interactive attention in constructing the Backbone network. PConv reduces the computational cost by selectively extracting features from a subset of input channels, utilizing feature graph redundancy. Batch interactive attention establishes connections between various types of samples to address sample scarcity without relying on data augmentation. Then Backbone serves as the encoder for the Glance and Focus Dynamic Inference Networks (GFnet). The patch proposal network in GFnet adaptively captures task-relevant areas of each sample, allowing encoders to process only those areas. This increases inference speed and ensures reliable results with minimal computational effort. Extensive validation of diverse datasets with varying distributions confirms the efficacy and precision of LAND-FCNN.

Real-time Classification of Brain States in Functional MRI Using Dynamic Connectivity Patterns and Machine Learning

Understanding real-time brain states facilitates deeper insights into cognitive processes, emotional responses, and neurological phenomena. It provides researchers with a dynamic view of brain function, aiding in the development of novel therapies, advancing neuroscience, and fostering innovations in brain-computer interfaces and artificial intelligence. The research aims to achieve real-time classification of brain states using dynamic connectivity patterns and Convolutional Neural Network (CNN) algorithms. It focuses on how demographic variables, such as brain volume and medication usage, influence classification accuracy. The study employs Python programming with FSL and Nilearn for preprocessing tasks like motion correction and dynamic connectivity pattern extraction. Feature selection and data partitioning are managed using Scikit-learn, ensuring standardized feature values and handling missing data. The CNN architecture is customized to handle spatial and temporal features in functional MRI (fMRI) data, with convolutional layers extracting spatial features representing local connectivity patterns. Dynamic connectivity matrices visualization aids in understanding brain network reconfigurations over time. This approach offers real-time insights into cognitive processes and neurological disorders, guiding personalized interventions for brain health. In result, connectivity matrices and 3D brain network visualizations are pivotal for unraveling brain state dynamics. Connectivity matrices unveil intricate interactions among brain regions across resting, task execution, and stress response states, offering quantitative insights into functional connectivity patterns. Meanwhile, 3D visualizations provide spatial representations, showcasing complex interplays and architectural changes across states.

Real-time Classification of Brain States in Functional MRI Using Dynamic Connectivity Patterns and Machine Learning

Understanding real-time brain states facilitates deeper insights into cognitive processes, emotional responses, and neurological phenomena. It provides researchers with a dynamic view of brain function, aiding in the development of novel therapies, advancing neuroscience, and fostering innovations in brain-computer interfaces and artificial intelligence. The research aims to achieve real-time classification of brain states using dynamic connectivity patterns and Convolutional Neural Network (CNN) algorithms. It focuses on how demographic variables, such as brain volume and medication usage, influence classification accuracy. The study employs Python programming with FSL and Nilearn for preprocessing tasks like motion correction and dynamic connectivity pattern extraction. Feature selection and data partitioning are managed using Scikit-learn, ensuring standardized feature values and handling missing data. The CNN architecture is customized to handle spatial and temporal features in functional MRI (fMRI) data, with convolutional layers extracting spatial features representing local connectivity patterns. Dynamic connectivity matrices visualization aids in understanding brain network reconfigurations over time. This approach offers real-time insights into cognitive processes and neurological disorders, guiding personalized interventions for brain health. In result, connectivity matrices and 3D brain network visualizations are pivotal for unraveling brain state dynamics. Connectivity matrices unveil intricate interactions among brain regions across resting, task execution, and stress response states, offering quantitative insights into functional connectivity patterns. Meanwhile, 3D visualizations provide spatial representations, showcasing complex interplays and architectural changes across states.

A Novel Money Laundering Prediction Model Based on a Dynamic Graph Convolutional Neural Network and Long Short-Term Memory

Money laundering is an illicit activity that seeks to conceal the nature and origins of criminal proceeds, posing a substantial threat to the national economy, the political order, and social stability. To scientifically and reasonably predict money laundering risks, this paper focuses on the “layering” stage of the money laundering process in the field of supervised learning for money laundering fraud prediction. A money laundering and fraud prediction model based on deep learning, referred to as MDGC-LSTM, is proposed. The model combines the use of a dynamic graph convolutional network (MDGC) and a long short-term memory (LSTM) network to efficiently identify illegal money laundering activities within financial transactions. MDGC-LSTM constructs dynamic graph snapshots with symmetrical spatiotemporal structures based on transaction information, representing transaction nodes and currency flows as graph nodes and edges, respectively, and effectively captures the relationships between temporal and spatial structures, thus achieving the dynamic prediction of fraudulent transactions. The experimental results demonstrate that compared with traditional algorithms and other deep learning models, MDGC-LSTM achieves significant advantages in comprehensive spatiotemporal feature modeling. Specifically, based on the Elliptic dataset, MDGC-LSTM improves the Macro-F1 score by 0.25 compared to that of the anti-money laundering fraud prediction model currently considered optimal.

SANe: Space adaptation network for temporal knowledge graph completion

Temporal Knowledge Graphs (TKGs) model time-dependent facts as relations between entities at specific timestamps, making them well-suited for real-world scenarios. However, TKGs are susceptible to incompleteness, necessitating Temporal Knowledge Graph Completion (TKGC) to predict missing facts. Prior methods often struggle to effectively handle two critical properties of TKGs, time-variability and time-stability, simultaneously, which hinders their performance. In this paper, we propose Space Adaptation Network (SANe), a novel approach for TKGC. SANe adapts facts at different timestamps to distinct latent spaces, effectively addressing time-variability. Our model introduces Parameter Generation Network to produce separate neural networks for each snapshot, which are then encoded into different latent spaces. A dynamic convolutional neural network processes entities and relations, utilizing different learned parameters generated by parameter generation network with respect to timestamps. By handling different temporal snapshots separately, TKGC is transformed into static KGC, enabling the modeling of time-variability. Dynamic convolutional neural network efficiently learns collective knowledge over large periods and supplements more specific knowledge gradually in smaller periods, facilitating time-stability. To strike a balance between learning time-variability and time-stability, we introduce a time-aware parameter generator to produce parameters hierarchically based on year, month, and day timestamps. Long-term knowledge is effectively shared across adjacent snapshots within the same year or month, while short-term knowledge within a day is preserved in specific parameters. However, in unbalanced TKGs, where many facts occur in small intervals, the large number of parameters generated by time-aware parameter generator may remain underutilized. To address this, we propose Adaptive Parameter Generation with a partition tree, ensuring parameter load balancing while maintaining time-stability. We conduct extensive experiments on five benchmark datasets, demonstrating the superiority of SANe over existing methods for TKGC, achieving state-of-the-art performance. Our contributions include pioneering TKGC from the perspective of space adaptation, achieving a balance between time-variability and time-stability through latent space overlap constraints, and substantiating the effectiveness of our model through comprehensive experiments on rich temporal datasets.

Earthquake monitoring using deep learning with a case study of the Kahramanmaras Turkey earthquake aftershock sequence

Abstract. Seismic phase picking and magnitude estimation are fundamental aspects of earthquake monitoring and seismic event analysis. Accurate phase picking allows for precise characterization of seismic wave arrivals, contributing to a better understanding of earthquake events. Likewise, accurate magnitude estimation provides crucial information about an earthquake's size and potential impact. Together, these components enhance our ability to monitor seismic activity effectively. In this study, we explore the application of deep-learning techniques for earthquake detection and magnitude estimation using continuous seismic recordings. Our approach introduces DynaPicker, which leverages dynamic convolutional neural networks to detect seismic body-wave phases in continuous seismic data. We demonstrate the effectiveness of DynaPicker using various open-source seismic datasets, including both window-format and continuous recordings. We evaluate its performance in seismic phase identification and arrival-time picking, as well as its robustness in classifying seismic phases using low-magnitude seismic data in the presence of noise. Furthermore, we integrate the phase arrival-time information into a previously published deep-learning model for magnitude estimation. We apply this workflow to continuous recordings of aftershock sequences following the Turkey earthquake. The results of this case study showcase the reliability of our approach in earthquake detection, phase picking, and magnitude estimation, contributing valuable insights to seismic event analysis.

A new paradigm in electron microscopy: Automated microstructure analysis utilizing a dynamic segmentation convolutional neutral network

Over the past half century, the transmission electron microscope enabled insight into the fundamental arrangements and structures of materials. State-of-the-art electron microscopes can acquire large image datasets across multiple imaging modalities. However, the manual annotation process for feature or defect quantification may not be feasible with the modern microscope. Convolutional neural networks emerged to characterize individual microstructural features from an image in a cost-effective, consistent manner. However, many of these neural network approaches rely on thousands to hundreds of thousands of manual annotations of each feature type across hundreds of images to train the network for adequate performance. This work focused on the development and application of a pixel-wise defect detection machine-learning dynamic segmentation convolutional neural network with associated automated acquisition and postprocessing to identify microstructural features rapidly and quantitatively from a small initial dataset incorporating multiple imaging modes. The approach was demonstrated for characterization of superalloy 718 from both single image acquisition on multiple detectors to in-situ evolution captured with a single detector on a standard desktop computer to demonstrate the low barrier to entry required for widespread adoption. Pixel-by-pixel class identification was excellent with strong identification of chemically distinct phases, structurally distinct phases, and defect structures, thus demonstrating the new paradigm of machine learning-assisted characterization.

A workload identification method of industrial robot combining dynamic model and convolutional neural network

The motion joint system of industrial robot has obvious nonlinear characteristics, high dimensional running data and limited number of experimental samples. If mature neural network algorithm is used for identifying the workload of robots, it is easy to have over-learning problems, which seriously restricts the generalization ability of load identification method. In this paper, a load identification method combining the dynamic model of industrial robots with the neural network data model is proposed. A UR5 robot is used for carrying out multiple dynamic load testings to verify the effectiveness of the proposed identification method. Firstly, the workload identification by CNN algorithm is given, and the influence of parameters of prediction model and different neutral network are analyzed. Then the classical dynamic model of industrial robots with multi-degrees of freedom is established. The identified workload by dynamic model is also analyzed. At last, the deterministic information such as velocity and displacement is extracted from the calculation results of the dynamic model as the initial anchoring value. Then convolutional neural network is applied for compensating the residual highly nonlinear information. An improved mixing combination method is also proposed. This method can effectively deal with the interaction of different types of information in the data, and preliminarily cooperate the dynamic model and convolutional neural network. This provides a basic framework and method for solving the problem of parameter identification in multi-degree-of-freedom systems with small samples.