Graphical Features Research Articles

Spatial-temporal graph feature learning driven by time–frequency similarity assessment for robust fault diagnosis of rotating machinery

Noises widely exist in the actual working environment of rotating machinery, which makes it difficult to extract high-quality fault features. Recently, the superiority of graph neural network (GNN) in the aspect of fault feature representation has been confirmed. By converting one-dimensional signals into graph structural data, hidden structural information inside the signals can be revealed. In this study, a novel graph-level fault diagnosis method based on spatial–temporal graph feature learning is developed. It mainly contains the following steps: First, Short-Time Fourier Transform (STFT) is used to construct time–frequency energy heatmaps, which can reflect the distribution of frequencies over time windows and the temporal variation characteristics. Second, a time–frequency similarity assessment method based on dynamic frequency warping is presented. On this basis, a time–frequency similarity graph (TFSG) is constructed to describe the frequency relationship over different time windows, which can bring extra structural information for the domain of time–frequency to support the subsequent classification task. Then, with the input of TFSG, a graph-level fault diagnosis model based on an improved GraphSAGE network (IGN) is developed. Finally, the fault labels for all TFSGs are recognized with a SoftMax classifier. Two experimental cases based on axial flow pumps and a public gearbox dataset verified the effectiveness of the proposed fault diagnosis method.

Pelatihan Canva untuk Siswa SMP sebagai Media Pembuatan Materi Presentasi

This training aims to improve Mardhiyah Middle School students' skills in using Canva as a tool to create interesting and informative presentation material. Canva was chosen because of its easy-to-use interface and various graphic design features that can be accessed online. The Service Team carries out training methods including an introduction to basic Canva features, such as using templates, manipulating text, setting layouts, and integrating graphic elements. In addition, this training will focus on developing students' creativity in designing presentations that are aesthetic and easy to understand, taking into account the principles of effective design. The training material also covers color management strategies, information hierarchy, and techniques for arranging content that suits the target audience. It is hoped that after attending this training, students will be more confident in creating quality presentations, using modern technology to express their ideas and information in a visual and professional way. It is hoped that this can also prepare them to face the demands of competence in the current digital era.

Towards multimodal graph neural networks for surgical instrument anticipation

PurposeDecision support systems and context-aware assistance in the operating room have emerged as the key clinical applications supporting surgeons in their daily work and are generally based on single modalities. The model- and knowledge-based integration of multimodal data as a basis for decision support systems that can dynamically adapt to the surgical workflow has not yet been established. Therefore, we propose a knowledge-enhanced method for fusing multimodal data for anticipation tasks.MethodsWe developed a holistic, multimodal graph-based approach combining imaging and non-imaging information in a knowledge graph representing the intraoperative scene of a surgery. Node and edge features of the knowledge graph are extracted from suitable data sources in the operating room using machine learning. A spatiotemporal graph neural network architecture subsequently allows for interpretation of relational and temporal patterns within the knowledge graph. We apply our approach to the downstream task of instrument anticipation while presenting a suitable modeling and evaluation strategy for this task.ResultsOur approach achieves an F1 score of 66.86% in terms of instrument anticipation, allowing for a seamless surgical workflow and adding a valuable impact for surgical decision support systems. A resting recall of 63.33% indicates the non-prematurity of the anticipations.ConclusionThis work shows how multimodal data can be combined with the topological properties of an operating room in a graph-based approach. Our multimodal graph architecture serves as a basis for context-sensitive decision support systems in laparoscopic surgery considering a comprehensive intraoperative operating scene.

Click-through rate prediction model based on graph networks and feature squeeze-and-excitation mechanism

PurposePredicting a user’s click-through rate on an advertisement or item often uses deep learning methods to mine hidden information in data features, which can provide users with more accurate personalized recommendations. However, existing works usually ignore the problem that the drift of user interests may lead to the generation of new features when they compute feature interactions. Based on this, this paper aims to design a model to address this issue.Design/methodology/approachFirst, the authors use graph neural networks to model users’ interest relationships, using the existing user features as the node features of the graph neural networks. Second, through the squeeze-and-excitation network mechanism, the user features and item features are subjected to squeeze operation and excitation operation, respectively, and the importance of the features is adaptively adjusted by learning the channel weights of the features. Finally, the feature space is divided into multiple subspaces to allocate features to different models, which can improve the performance of the model.FindingsThe authors conduct experiments on two real-world data sets, and the results show that the model can effectively improve the prediction accuracy of advertisement or item click events.Originality/valueIn the study, the authors propose graph network and feature squeeze-and-excitation model for click-through rate prediction, which is used to dynamically learn the importance of features. The results indicate the effectiveness of the model.

Enhancing Chemical Reaction Monitoring with a Deep Learning Model for NMR Spectra Image Matching to Target Compounds.

In the synthetic laboratory, researchers typically rely on nuclear magnetic resonance (NMR) spectra to elucidate structures of synthesized products and confirm whether they match the desired target compounds. As chemical synthesis technology evolves toward intelligence and continuity, efficient computer-assisted structure elucidation (CASE) techniques are required to replace time-consuming manual analysis and provide the necessary speed. However, current CASE methods typically aim to derive precise chemical structures from spectroscopic data, yet they suffer from drawbacks such as low accuracy, high computational cost, and reliance on chemical libraries. In meticulously designed chemical synthesis reactions, researchers prioritize confirming the attainment of the target product based on NMR spectra, rather than focusing on identifying the specific product obtained. For this purpose, we innovatively developed a binary classification model, termed as MatCS, to directly predict the relationship between NMR spectra image (including 1H NMR and 13C NMR) and the molecular structure of the target compound. After evaluating various feature extraction methods, MatCS employs a combination of the Graph Attention Networks and Graph Convolutional Networks to learn the structural features of molecular graphs and the pretrained ResNet101 network with a Convolutional Block Attention Module to extract features from NMR spectra images. The results show that on a challenging Testsim data set, which poses difficulty in distinguishing spectra of similar molecular structures, MatCS achieves comprehensive evaluation metrics with an F1-score of 0.81 and an AUC value of 0.87. Simultaneously, it exhibited commendable performance on an external SDBS data set containing experimental NMR spectra, showcasing substantial potential for structural verification tasks in real automated chemical synthesis.

Graph Feature Refinement and Fusion in Transformer for Structural Damage Detection.

Structural damage detection is of significance for maintaining the structural health. Currently, data-driven deep learning approaches have emerged as a highly promising research field. However, little progress has been made in studying the relationship between the global and local information of structural response data. In this paper, we have presented an innovative Convolutional Enhancement and Graph Features Fusion in Transformer (CGsformer) network for structural damage detection. The proposed CGsformer network introduces an innovative approach for hierarchical learning from global to local information to extract acceleration response signal features for structural damage representation. The key advantage of this network is the integration of a graph convolutional network in the learning process, which enables the construction of a graph structure for global features. By incorporating node learning, the graph convolutional network filters out noise in the global features, thereby facilitating the extraction to more effective local features. In the verification based on the experimental data of four-story steel frame model experiment data and IASC-ASCE benchmark structure simulated data, the CGsformer network achieved damage identification accuracies of 92.44% and 96.71%, respectively. It surpassed the existing traditional damage detection methods based on deep learning. Notably, the model demonstrates good robustness under noisy conditions.

Infrastructure-assisted 3D detection networks based on camera-lidar early fusion strategy

Target detection in autonomous driving is a pivotal domain of the current research focus. The process fundamentally relies on on-board sensors tasked to identify proximate objects. However, long-range perception instability and the partial obstruction by traffic participants further complicate the challenge. These factors collectively affected the effectiveness of targeted detection from the cooperative vehicle-infrastructure system (CVIS) and urgently need to be addressed. Starting from infrastructure-side assisted detection, we propose a 3D detection network based on multi-sensor sensing. Our approach consists of three sub-networks: Diversity Balanced Feature Fusion Network (MRBNeXt), Early Multimodal Fusion Network (VBRFusion), and TwoStage Lightweight Detection Network (TSL). MRBNeXt focuses on extracting raw images fused into multilevel semantic representations to address the drawbacks of needing a rich feature-level representation; VBRFusion proposes a two-branch structure that acts on the point cloud voxelization to aggregate high-dimensional features. The point features are mapped to the sampled graphical semantic features via the coordinate features to complete the early fusion and thus improve the feature quality of a single modality. In the proposed area network, TSL enhances the sensory field processing of multidimensional features using the context-aware module in a two-stage approach to achieve fast target recognition at different scale levels. Finally, we perform comparative ablation experiments on the DAIR-V2X vehicle-infrastructure dataset. The results validated our approach and demonstrated its effectiveness and enhancement in detection accuracy at the infrastructure end compared to current state-of-the-art methods. This improvement significantly boosted the performance of 3D target detection tasks in complex traffic scenarios and provided a more robust justification for the subsequent development of vehicle-side-infrastructure-side collaborative 3D target detection.

Rethinking Feature Mining for Light Field Salient Object Detection

Light field salient object detection (LF SOD) has recently received increasing attention. However, most current works typically rely on an individual focal stack backbone for feature extraction. This manner ignores the characteristic of blurred saliency-related regions and contour within focal slices, resulting in insufficient or even inaccurate saliency responses. Aiming at addressing this issue, we rethink the feature mining (i.e., exploration) within focal slices, and focus on exploiting informative focal slice features and fully leveraging contour information for accurate LF SOD. First, we observe that the geometric relation between different regions within the focal slices is conducive to useful saliency feature mining if utilized properly. In light of this, we propose an implicit graph learning (IGL) approach. The IGL constructs graph structures to propagate informative geometric relations within the focal slices and all-focus features, and promotes crucial and discriminative focal stack feature mining via graph feature distillation. Second, unlike previous works that rarely utilize contour information, we propose a reciprocal refinement fusion (RRF) strategy. This strategy encourages saliency features and object contour cues to effectively complement each other. Furthermore, a contour hint injection mechanism is introduced to refine the feature expressions. Extensive experiments showcase the superiority of our approach over previous state-of-the-art models with an efficient real-time inference speed. Codes are available at: https://github.com/gbliao/IRNet .

NOx concentration prediction based on multi-channel fused spectral temporal graph neural network in coal-fired power plants

Establishing an accurate and stable NOx concentration prediction model is the foundation for achieving environmental protection in coal-fired power plant denitrification. In this research, a data-driven hybrid prediction model (BMFE-MFST-GNN) is proposed to improve the prediction accuracy of inlet NOx concentrations. First, we develop the adaptive variational modal decomposition method (FEVMD) to decompose historical NOx concentration data into simple and smooth subsequences and extract time-frequency features. Second, we propose the boosting mutual information feature selection algorithm (BMIFS) to determine the best set of auxiliary variables. The delay time is calculated based on the maximal information coefficient (MIC) to reconstruct the datasets. Then, the multi-channel fused spectral temporal graph neural network (MFST-GNN) is created to build the graph feature information of decomposed subsequences and reconstructed auxiliary variables to predict the concentration subsequences. Finally, we integrate the subsequence prediction results to obtain the future NOx concentrations. The experimental results demonstrate that the proposed method outperforms several comparative models in predicting NOx concentrations.

Graph features based classification of bronchial and pleural rub sound signals: the potential of complex network unwrapped.

The study presents a novel technique for lung auscultation based on graph theory, emphasizing the potential of graph parameters in distinguishing lung sounds and supporting earlier detection of various respiratory pathologies. The frequency spread and the component magnitudes are revealed from the analysis of eighty-five bronchial (BS) and pleural rub (PS) lung sounds employing the power spectral density (PSD) plot and wavelet scalogram. The low-frequency spread, and persistence of the high-intensity frequency components are visible in BS sounds emanating from the uniform cross-sectional area of the trachea. The frictional rub between the pleurae causes a higher frequency spread of low-intensity intermittent frequency components in PS signals. From the complex networks of BS and PS, the extracted graph features are - graph density ([Formula: see text], transitivity ([Formula: see text], degree centrality ([Formula: see text]), betweenness centrality ([Formula: see text], eigenvector centrality ([Formula: see text]), and graph entropy (En). The high values of [Formula: see text] and [Formula: see text] show a strong correlation between distinct segments of the BS signal originating from a consistent cross-sectional tracheal diameter and, hence, the generation of high-intense low-spread frequency components. An intermittent low-intense and a relatively greater frequency spread in PS signal appear as high [Formula: see text], [Formula: see text], [Formula: see text], and [Formula: see text] values. With these complex network parameters as input attributes, the supervised machine learning techniques- discriminant analyses, support vector machines, k-nearest neighbors, and neural network pattern recognition (PRNN)- classify the signals with more than 90% accuracy, with PRNN having 25 neurons in the hidden layer achieving the highest (98.82%).

Equivariant Line Graph Neural Network for Protein-Ligand Binding Affinity Prediction.

Binding affinity prediction of three-dimensional (3D) protein-ligand complexes is critical for drug repositioning and virtual drug screening. Existing approaches usually transform a 3D protein-ligand complex to a two-dimensional (2D) graph, and then use graph neural networks (GNNs) to predict its binding affinity. However, the node and edge features of the 2D graph are extracted based on invariant local coordinate systems of the 3D complex. As a result, these approaches can not fully learn the global information of the complex, such as the physical symmetry and the topological information of bonds. To address these issues, we propose a novel Equivariant Line Graph Network (ELGN) for binding affinity prediction of 3D protein-ligand complexes. The proposed ELGN firstly adds a super node to the 3D complex, and then builds a line graph based on the 3D complex. After that, ELGN uses a new E(3)-equivariant network layer to pass the messages between nodes and edges based on the global coordinate system of the 3D complex. Experimental results on two real datasets demonstrate the effectiveness of ELGN over several state-of-the-art baselines.

FlowX: Towards Explainable Graph Neural Networks via Message Flows.

We investigate the explainability of graph neural networks (GNNs) as a step toward elucidating their working mechanisms. While most current methods focus on explaining graph nodes, edges, or features, we argue that, as the inherent functional mechanism of GNNs, message flows are more natural for performing explainability. To this end, we propose a novel method here, known as FlowX, to explain GNNs by identifying important message flows. To quantify the importance of flows, we propose to follow the philosophy of Shapley values from cooperative game theory. To tackle the complexity of computing all coalitions' marginal contributions, we propose a flow sampling scheme to compute Shapley value approximations as initial assessments of further training. We then propose an information-controlled learning algorithm to train flow scores toward diverse explanation targets: necessary or sufficient explanations. Experimental studies on both synthetic and real-world datasets demonstrate that our proposed FlowX and its variants lead to improved explainability of GNNs.

Artistic and graphic features of visual communication of dairy market brands

Artistic and graphic features of visual communication of dairy market brands

LightSGM: Local feature matching with lightweight seeded

Addressing the quintessential challenge of local feature matching in computer vision, this study introduces a novel fast sparse seed graph structure named LightSGM. This structure aims to refine the characterization of graph features while minimizing superfluous connections. Initially, a subset of high-quality seed feature points is curated using a confidence filter. Subsequently, keypoint features are assimilated into this seed set via graph pooling, and the composite features are further processed through a memory and computation-efficient seed transformer to capture rich contextual information about the keypoints. The seed feature points are then relayed back to the original keypoints using an inverse process known as graph unpooling. The paper also introduce an adaptive mechanism to determine the optimal number of model layers based on the intricacy of matching image pairs. A Matching Point Prediction Header is employed to extract the final set of matching points. Through extensive experimentation on image matching and position estimation, LightSGM has demonstrated its prowess in delivering competitive matching accuracy while maintaining a balance with real-time processing capabilities.

Deep learning-based multimodal analysis for transition-metal dichalcogenides

In this study, we present a novel approach to enable high-throughput characterization of transition-metal dichalcogenides (TMDs) across various layers, including mono-, bi-, tri-, four, and multilayers, utilizing a generative deep learning-based image-to-image translation method. Graphical features, including contrast, color, shapes, flake sizes, and their distributions, were extracted using color-based segmentation of optical images, and Raman and photoluminescence spectra of chemical vapor deposition-grown and mechanically exfoliated TMDs. The labeled images to identify and characterize TMDs were generated using the pix2pix conditional generative adversarial network (cGAN), trained only on a limited data set. Furthermore, our model demonstrated versatility by successfully characterizing TMD heterostructures, showing adaptability across diverse material compositions.Graphical abstractImpact StatementDeep learning has been used to identify and characterize transition-metal dichalcogenides (TMDs). Although studies leveraging convolutional neural networks have shown promise in analyzing the optical, physical, and electronic properties of TMDs, they need extensive data sets and show limited generalization capabilities with smaller data sets. This work introduces a transformative approach—a generative deep learning (DL)-based image-to-image translation method—for high-throughput TMD characterization. Our method, employing a DL-based pix2pix cGAN network, transcends traditional limitations by offering insights into the graphical features, layer numbers, and distributions of TMDs, even with limited data sets. Notably, we demonstrate the scalability of our model through successful characterization of different heterostructures, showcasing its adaptability across diverse material compositions.

Predicting Drugs Suspected of Causing Adverse Drug Reactions Using Graph Features and Attention Mechanisms.

Adverse drug reactions (ADRs) refer to an unintended harmful reaction that occurs after the administration of a medication for therapeutic purposes, which is unrelated to the intended pharmacological action of the drug. In the United States, ADRs account for 6% of all hospital admissions annually. The cost of ADR-related illnesses in 2016 was estimated at USD 528.4 billion. Increasing the awareness of ADRs is an effective measure to prevent them. Assessing suspected drugs in adverse events helps to enhance the awareness of ADRs. In this study, a suspect drug assisted judgment model (SDAJM) is designed to identify suspected drugs in adverse events. This framework utilizes the graph isomorphism network (GIN) and an attention mechanism to extract features based on patients' demographic information, drug information, and ADR information. By comparing it with other models, the results of various tests show that this model performs well in predicting the suspected drugs in adverse reaction events. ADR signal detection was conducted on a group of cardiovascular system drugs, and case analyses were performed on two classic drugs, Mexiletine and Captopril, as well as on two classic antithyroid drugs. The results indicate that the model can accomplish the task of predicting drug ADRs. Validation using benchmark datasets from ten drug discovery domains shows that the model is applicable to classification tasks on the Tox21 and SIDER datasets. This study applies deep learning methods to construct the SDAJM model for three purposes: (1) identifying drugs suspected to cause adverse drug events (ADEs), (2) predicting the ADRs of drugs, and (3) other drug discovery tasks. The results indicate that this method can offer new directions for research in the field of ADRs.

Reinventing gene expression connectivity through regulatory and spatial structural empowerment via principal node aggregation graph neural network.

The intricacies of the human genome, manifested as a complex network of genes, transcend conventional representations in text or numerical matrices. The intricate gene-to-gene relationships inherent in this complexity find a more suitable depiction in graph structures. In the pursuit of predicting gene expression, an endeavor shared by predecessors like the L1000 and Enformer methods, we introduce a novel spatial graph-neural network (GNN) approach. This innovative strategy incorporates graph features, encompassing both regulatory and structural elements. The regulatory elements include pair-wise gene correlation, biological pathways, protein-protein interaction networks, and transcription factor regulation. The spatial structural elements include chromosomal distance, histone modification and Hi-C inferred 3D genomic features. Principal Node Aggregation models, validated independently, emerge as frontrunners, demonstrating superior performance compared to traditional regression and other deep learning models. By embracing the spatial GNN paradigm, our method significantly advances the description of the intricate network of gene interactions, surpassing the performance, predictable scope, and initial requirements set by previous methods.

Brain-computer interfaces inspired spiking neural network model for depression stage identification

BackgroundDepression is a global mental disorder, and traditional diagnostic methods mainly rely on scales and subjective evaluations by doctors, which cannot effectively identify symptoms and even carry the risk of misdiagnosis. Brain-Computer Interfaces inspired deep learning-assisted diagnosis based on physiological signals holds promise for improving traditional methods lacking physiological basis and leads next generation neuro-technologies. However, traditional deep learning methods rely on immense computational power and mostly involve end-to-end network learning. These learning methods also lack physiological interpretability, limiting their clinical application in assisted diagnosis. MethodologyA brain-like learning model for diagnosing depression using electroencephalogram (EEG) is proposed. The study collects EEG data using 128-channel electrodes, producing a 128×128 brain adjacency matrix. Given the assumption of undirected connectivity, the upper half of the 128×128 matrix is chosen in order to minimise the input parameter size, producing 8,128-dimensional data. After eliminating 28 components derived from irrelevant or reference electrodes, a 90×90 matrix is produced, which can be used as an input for a single-channel brain-computer interface image. ResultAt the functional level, a spiking neural network is constructed to classify individuals with depression and healthy individuals, achieving an accuracy exceeding 97.5 %. Comparison with existing methodsCompared to deep convolutional methods, the spiking method reduces energy consumption. ConclusionAt the structural level, complex networks are utilized to establish spatial topology of brain connections and analyse their graph features, identifying potential abnormal brain functional connections in individuals with depression.

Ornamental decoration of a dagger from Aytkulovo: results of graphic analysis

Bone ornamented items of the end of the Paleolithic — Mesolithic periods are very rare in the south of Western Siberia. While some of them have dating context, others are accidental finds. Despite the circumstances of their discovery and limited amount of relevant information, there is a need to consider the issues of dominant subjects, compositional morphology, technical execution of ornaments covering their surfaces and relations with the materials of adjacent territories, mainly the Ural region. The study presents the results of a palaeographic analysis of ornamental patterns (texts) created presumably in the Epipaleolithic and which are rather rare in terms of morphology. The study is focused on the ornament of a dagger from Aytkulovo. The bone artefact was accidentally discovered in July 1976 near the village of Aytkulovo on a shoal at the mouth of River Murlinka (Tara district, Omsk region). Stylistic and compositional analogues of the dagger in the Middle Irtysh region are unknown. The preservation of the artefact is satisfactory, which allows analyzing its ornamental composition. The dagger’s ornamentation consists of two iconic layers, each of them can be attributed to different chronological episodes (phases). Such combination of the non synchronous ornamental texts on a single artefact is a true rarity in paleoornamentology. While objects of the first ornamental layer form the frame of the composition, the overlapping additional elements of the second layer were added in a later chronological episode. The observed differences of the first and the second layers in specific taphonomic, technological, stylistic and graphic features raise the question of a chronological gap in their creation. The graphic and stylistic originality of the iconic design of the dagger suggests that its ornamental pattern can be considered as a “graphic dialect” belonging to a more global ornamental tradition (its preliminary name was “Ural-Chernoozerye”). The obtained results confirm the being-developed thesis about the existence of a single cultural community in the southern Trans-Urals and in the south-west of Western Siberia during the late Palaeolithic — early Mesolithic period. This community is represented by the local mutually contacting groups which used similar graphic principles of information transfer. The process of interpenetration and blending of local traditions led not only to exchange of technological innovation but also to emergence of the composite graphic “dialects” similar to the one in Aytkulovo.

Urban Perception Assessment from Street View Images Based on a Multifeature Integration Encompassing Human Visual Attention

Urban perception is a multifaceted process, spanning from vision to cognitive interpretation. Earlier studies on urban perception assessment have primarily concentrated on the analysis of graphic features of street view images such as color or semantic elements, neglecting the vital human sensory fixation features in cognitive processes. This study leveraged eye-tracking technology to accumulate human visual attention data during emotion scoring of street view images. Additionally, a deep learning network model was proposed to forecast human visual attention areas by assimilating environmental features such as image color, depth, and semantic elements, and subsequently amalgamating the aforementioned environmental features and visual attention to establish a perception prediction model, capable of predicting urban perception on a larger scale. Finally, the reliability and superiority of the urban perception prediction method were confirmed through ablation experiments and bias analysis. On the one hand, the method enhances the prediction accuracy of urban perception; on the other, it investigates the comprehensive influence of multiple features on human subjective emotions from the external environment perspective and individual perspective. This approach transcends the former limited reliance on single-image features, providing a novel and scientific approach for assessing urban perception.