Spatial Temporal Graph Research Articles

Point-of-interest recommendation based on the spatial-temporal graph

Purpose Point-of-interest (POI) recommendation techniques play a crucial role in mitigating information overload and delivering tailored services. To address limitations in conventional POI recommendation systems, constrained by sparse user-POI interactions and incomplete consideration of temporal dynamics, POI recommendation based on the spatial-temporal graph (STG-POI) is proposed. Design/methodology/approach Spatial-temporal sequence graphs from geographical locations and user interaction history data are constructed, which are used to mine spatial-temporal sequence information. Using the data filtered by the band-pass filter, graph neural networks with distance-awareness and sequence-awareness are applied to capture high-order spatial-temporal connections within diverse graph topologies. The model leverages contrastive learning for self-supervised disentanglement of graph representations, providing self-supervised signals for sequential and geographical intent perception, thereby achieving more precise POI personalization. Findings Compared to the baseline model GSTN, experiments on the Foursquare and Gowalla data sets reveal that STG-POI improves testing AUC by 2.0%, 2.1%, 2.0% and decreases logloss by 1.9%, 3.3%, 0.3%, respectively. These results indicate the model’s effectiveness in capturing spatial-temporal information, surpassing mainstream POI recommendation baseline models. Originality/value This approach constructs a dual graph from user interaction data, harnessing sequential and geographical information as self-supervised signals. It yields decoupled representations of these influences, offering a comprehensive insight into user behaviors and preferences within location-based social networks, thus enhancing recommendation accuracy and interpretability. This approach addresses the challenge in graph convolutional network where only rough and smooth features are conducive to recommendation by using band-pass filters to significantly reduce computational complexity, thereby enhancing recommendation speed by filtering out noise data that does not contribute to recommendation performance. Experimental results indicate that this model surpasses current mainstream approaches in POI recommendation tasks, effectively integrating both geographical and temporal features.

Predicting Protein-Ligand Binding Affinity Using Fusion Model of Spatial-Temporal Graph Neural Network and 3D Structure-Based Complex Graph.

The investigation of molecular interactions between ligands and their target molecules is becoming more significant as protein structure data continues to develop. In this study, we introduce PLA-STGCNnet, a deep fusion spatial-temporal graph neural network designed to study protein-ligand interactions based on the 3D structural data of protein-ligand complexes. Unlike 1D protein sequences or 2D ligand graphs, the 3D graph representation offers a more precise portrayal of the complex interactions between proteins and ligands. Research studies have shown that our fusion model, PLA-STGCNnet, outperforms individual algorithms in accurately predicting binding affinity. The advantage of a fusion model is the ability to fully combine the advantages of multiple different models and improve overall performance by combining their features and outputs. Our fusion model shows satisfactory performance on different data sets, which proves its generalization ability and stability. The fusion-based model showed good performance in protein-ligand affinity prediction, and we successfully applied the model to drug screening. Our research underscores the promise of fusion spatial-temporal graph neural networks in addressing complex challenges in protein-ligand affinity prediction. The Python scripts for implementing various model components are accessible at https://github.com/ligaili01/PLA-STGCN.

TEA-GCN: Transformer-Enhanced Adaptive Graph Convolutional Network for Traffic Flow Forecasting.

Traffic flow forecasting is crucial for improving urban traffic management and reducing resource consumption. Accurate traffic conditions prediction requires capturing the complex spatial-temporal dependencies inherent in traffic data. Traditional spatial-temporal graph modeling methods often rely on fixed road network structures, failing to account for the dynamic spatial correlations that vary over time. To address this, we propose a Transformer-Enhanced Adaptive Graph Convolutional Network (TEA-GCN) that alternately learns temporal and spatial correlations in traffic data layer-by-layer. Specifically, we design an adaptive graph convolutional module to dynamically capture implicit road dependencies at different time levels and a local-global temporal attention module to simultaneously capture long-term and short-term temporal dependencies. Experimental results on two public traffic datasets demonstrate the effectiveness of the proposed model compared to other state-of-the-art traffic flow prediction methods.

Multi-relation spatiotemporal graph residual network model with multi-level feature attention: A novel approach for landslide displacement prediction

Accurate prediction of landslide displacement is crucial for effective early warning of landslide disasters. While most existing prediction methods focus on time-series forecasting for individual monitoring points, there is limited research on the spatiotemporal characteristics of landslide deformation. This paper proposes a novel Multi-Relation Spatiotemporal Graph Residual Network with Multi-Level Feature Attention (MFA-MRSTGRN) that effectively improves the prediction performance of landslide displacement through spatiotemporal fusion. This model integrates internal seepage factors as data feature enhancements with external triggering factors, allowing for accurate capture of the complex spatiotemporal characteristics of landslide displacement and the construction of a multi-source heterogeneous dataset. The MFA-MRSTGRN model incorporates dynamic graph theory and four key modules: multi-level feature attention, temporal-residual decomposition, spatial multi-relational graph convolution, and spatiotemporal fusion prediction. This comprehensive approach enables the efficient analyses of multi-source heterogeneous datasets, facilitating adaptive exploration of the evolving multi-relational, multi-dimensional spatiotemporal complexities in landslides. When applying this model to predict the displacement of the Liangshuijing landslide, we demonstrate that the MFA-MRSTGRN model surpasses traditional models, such as random forest (RF), long short-term memory (LSTM), and spatial temporal graph convolutional networks (ST-GCN) models in terms of various evaluation metrics including mean absolute error (MAE = 1.27 mm), root mean square error (RMSE = 1.49 mm), mean absolute percentage error (MAPE = 0.026), and R-squared (R2 = 0.88). Furthermore, feature ablation experiments indicate that incorporating internal seepage factors improves the predictive performance of landslide displacement models. This research provides an advanced and reliable method for landslide displacement prediction.

Variational spatial-temporal graph attention network for state monitoring and forecasting

With the popularity of smart devices, there has been extensive collection of data structured in graphs. Spatial graphs, in particular, have garnered significant interest owing to their diverse range of applications. In this paper, we focus on applying spatial graph model for state monitoring and forecasting, with special attention to transportation systems. In current spatial modeling approaches, understanding the structure of a spatial graph usually relies on the analysis of gathered spatial–temporal data. However, spatial graph data in real world often contains temporary factors that are not easily detected. In this paper, we propose a novel variational inference-based model VISTG, which integrates such dynamics into spatial–temporal learning of spatial graph modeling. Specifically, VISTG is primarily composed of several spatial–temporal learning blocks, each encompassing both temporal and spatial learning layers. The temporal learning layer is crafted to characterize the distributions of latent factors using a variational inference-based model, aiming to capture the dynamics within the data. Subsequently, the spatial learning layer utilizes graph attention networks to describe the correlation among nodes. Additionally, an adaptive fusion module is implemented to equalize the impact of diverse temporal patterns. Finally, comprehensive experiments are carried out on two real-world datasets. The results affirm the efficacy of our model.

The Analysis of Regional Ice and Snow Tourist Destinations under Back Propagation Neural Network

This study aims to analyze the evolutionary characteristics and development levels of regional ice and snow tourist destinations by integrating the Back Propagation Neural Network (BPNN) within an Internet of Things (IoT) framework. Data from multiple sources are gathered through web scraping technology from various online platforms and are then subjected to cleaning, standardization, and normalization. A feature recognition model for ice and snow tourism is constructed based on a BPNN combined with a Spatial-Temporal Graph Convolutional Network (ST-GCN) algorithm. Experimental results demonstrate that this model excels in convergence speed and prediction accuracy, achieving a final convergence value of 0.059 and a prediction accuracy of 95.74%, which is at least 4% higher than that of the baseline BPNN algorithm. Additionally, the model yields Recall and F1 scores of 91.57% and 89.31%, respectively. After 98 iterations, the Root Mean Square Error (RMSE) is 6.26, significantly outperforming other model algorithms. These results indicate that the proposed model offers substantial advantages in enhancing the management and service quality of ice and snow tourist destinations, thereby providing valuable technical support and guidance for future intelligent tourism management.

Dynamic multi-scale spatial-temporal graph convolutional network for traffic flow prediction

This paper proposes a dynamic multi-scale spatial-temporal graph convolutional network (DS-STGCN) for traffic flow prediction. The network aims to comprehensively extract global and local dependencies in dynamic spatial-temporal data by inputting traffic network flow data to construct node feature graphs, topology graphs, and time slot feature graphs, capturing the complexity and dynamics of traffic flow. DS-STGCN interprets feature information of the traffic network from both spatial and temporal dimensions through dynamic multi-scale graph convolutional blocks. In the spatial dimension, these blocks use constraints at different levels to balance fine-grained local features and extensive global features, revealing the intrinsic structure of traffic flow data. In the temporal dimension, these blocks jointly learn with temporal convolutional blocks to capture multi-frequency time patterns and handle long sequence data, effectively extracting potential dependencies of time series. Furthermore, DS-STGCN effectively models the changing spatial-temporal relationships in road network flow by constructing dynamically adaptive updated adjacency tensors, generating dynamic graph structures to address the challenge of changing spatial-temporal relationships in the transportation system. Experimental results show that our method significantly outperforms other competing methods on five real traffic datasets (PEMS03, PEMS04, PEMS07, PEMS08 and METR-LA).

Dynamic Spatial-Temporal Embedding via Neural Conditional Random Field for Multivariate Time Series Forecasting

How to capture dynamic spatial-temporal dependencies remains an open question in multivariate time series (MTS) forecasting. Although recent advanced spatial-temporal graph neural networks (STGNNs) achieve superior forecasting performance, they either consider pre-defined spatial correlations or simply learn static graphs. Some research has tried to learn many adjacent matrices to reveal time-varying spatial correlations, but they generate discrete graphs which cannot encode evolutionary information and also face computational complexity problem. In this article, we propose two significant plugins to help automatically learn enhanced dynamic spatial-temporal embedding of MTS data: (1) a novel neural conditional random field (CRF) layer. We find that the implicit time-varying spatial dependencies are reflected by the explicit changeable links between edges, and we propose the neural CRF to encode such pairwise changeable evolutionary inter-dependencies; (2) a structure adaptive graph convolution (SAGC) that does not require pre-defined graphs to capture semantically richer spatial correlations. Then, we integrate the neural CRF, SAGC with recurrent neural network to develop a new STGNN paradigm termed Adaptive Spatial-Temporal graph neural network with Conditional Random Field (ASTCRF), which can be trained in an end-to-end fashion. We validate the effectiveness, efficiency, and scalability of ASTCRF on five public benchmark MTS datasets.

Spatial-temporal graph neural networks for groundwater data.

This paper introduces a novel application of spatial-temporal graph neural networks (ST-GNNs) to predict groundwater levels. Groundwater level prediction is inherently complex, influenced by various hydrological, meteorological, and anthropogenic factors. Traditional prediction models often struggle with the nonlinearity and non-stationary characteristics of groundwater data. Our study leverages the capabilities of ST-GNNs to address these challenges in the Overbetuwe area, Netherlands. We utilize a comprehensive dataset encompassing 395 groundwater level time series and auxiliary data such as precipitation, evaporation, river stages, and pumping well data. The graph-based framework of our ST-GNN model facilitates the integration of spatial interconnectivity and temporal dynamics, capturing the complex interactions within the groundwater system. Our modified Multivariate Time Graph Neural Network model shows significant improvements over traditional methods, particularly in handling missing data and forecasting future groundwater levels with minimal bias. The model's performance is rigorously evaluated when trained and applied with both synthetic and measured data, demonstrating superior accuracy and robustness in comparison to traditional numerical models in long-term forecasting. The study's findings highlight the potential of ST-GNNs in environmental modeling, offering a significant step forward in predictive modeling of groundwater levels.

SWL-LSE: A Dataset of Health-Related Signs in Spanish Sign Language with an ISLR Baseline Method

Progress in automatic sign language recognition and translation has been hindered by the scarcity of datasets available for the training of machine learning algorithms, a challenge that is even more acute for languages with smaller signing communities, such as Spanish. In this paper, we introduce a dataset of 300 isolated signs in Spanish Sign Language, collected online via a web application with contributions from 124 participants, resulting in a total of 8000 instances. This dataset, which is openly available, includes keypoints extracted using MediaPipe Holistic. The goal of this paper is to describe the construction and characteristics of the dataset and to provide a baseline classification method using a spatial–temporal graph convolutional network (ST-GCN) model, encouraging the scientific community to improve upon it. The experimental section offers a comparative analysis of the method’s performance on the new dataset, as well as on two other well-known datasets. The dataset, code, and web app used for data collection are freely available, and the web app can also be used to test classifier performance on-line in real-time.

Improved air traffic flow prediction in terminal areas using a multimodal spatial–temporal network for weather-aware (MST-WA) model

Accurately predicting air traffic flow in terminal areas is critical for balancing demand and capacity, particularly under challenging weather conditions. However, the complex interactions between weather patterns and air traffic make reliable predictions difficult. To address this issue, we propose a novel approach called the Multimodal Spatial-Temporal network for Weather-Aware prediction (MST-WA), designed to enhance air traffic flow prediction (ATFP) in terminal areas. Our method begins by constructing a spatial–temporal graph that captures the topology of the terminal area, including airports, routes, and fixes as nodes. A weather-aware module is then introduced, leveraging a Residual Network (ResNet) and attention mechanism to model the deep spatial–temporal correlations in the Weather Avoidance Field (WAF). The proposed model architecture integrates five key branches: arrival flow, departure flow, graph network topology, weather conditions, and flow constraint control, with predictions generated via an attention-based Long Short-Term Memory (LSTM) network. Experimental results using real-world data from Guangzhou Baiyun Airport, China, show that MST-WA outperforms baseline models in ATFP. Furthermore, a case study in convective weather scenarios demonstrates the model’s adaptability and effectiveness. We believe that the proposed model can serve as a valuable tool for air traffic controllers, enhancing decision-making and improving overall air traffic management.

Deep learning model for solar and wind energy forecasting considering Northwest China as an example

The growing demand for renewable energy sources like wind and solar power requires accurate and reliable forecasting techniques for effective planning and operation. This study presents an attention-based spatial-temporal graph neural network–long short-term memory (ASTGNN-LSTM) model designed to predict wind speed and solar radiation using 20 years of meteorological data from five regions in Northwest China. The ASTGNN-LSTM model shows significant performance improvements over traditional methods, such as the historical average model, autoregressive integrated moving average model, and graph convolutional network with LSTM. After optimizing the hidden layers and learning rate, the relative errors for predicting wind speed and solar radiation are reduced to 27.15 % and 6.11 %, respectively. Sensitivity analysis reveals that location data have the most significant impact on predictions. These findings demonstrate that the ASTGNN-LSTM model effectively captures nonlinear relationships and can enhance renewable energy planning and management.

Interpretable Spatial–Temporal Graph Convolutional Network for System Log Anomaly Detection

To ensure seamless information flow and operational integrity, computer systems need effectively to manage their system logs, but the expansion in their scale and complexity makes it hard to detect anomalies. Current methodologies exhibit deficiencies, including inefficiencies in handling abnormal sequences, lack of interpretability, and limited consideration of both temporal and spatial information. To improve, this paper develops a semi-supervised graph neural network model termed the Interpretable Spatial–Temporal Graph Convolutional Network (IST-GCN). By integrating temporal and event similarity perspectives, the IST-GCN harnesses directed and undirected graphs to capture the temporal and spatial aspects of system log events. Hence, the IST-GCN offers temporal and spatial interpretability. Further, a lightweight feature regularization technique is developed to enhance interpretability in both time and space domains, and thus facilitates anomaly detection efficiently. Comprehensive testing verifies that the IST-GCN approach surpasses nearly all state-of-the-art methods across five public log anomaly datasets. On average, IST-GCN improves Average Precision (AP) by approximately 3% and ROC AUC (RC) by about 4% compared to the best-performing baseline methods, underscoring its effectiveness and robustness.

Spatial-Temporal Transformer Networks for Traffic Flow Forecasting Using a Pre-Trained Language Model.

Most current methods use spatial-temporal graph neural networks (STGNNs) to analyze complex spatial-temporal information from traffic data collected from hundreds of sensors. STGNNs combine graph neural networks (GNNs) and sequence models to create hybrid structures that allow for the two networks to collaborate. However, this collaboration has made the model increasingly complex. This study proposes a framework that relies solely on original Transformer architecture and carefully designs embeddings to efficiently extract spatial-temporal dependencies in traffic flow. Additionally, we used pre-trained language models to enhance forecasting performance. We compared our new framework with current state-of-the-art STGNNs and Transformer-based models using four real-world traffic datasets: PEMS04, PEMS08, METR-LA, and PEMS-BAY. The experimental results demonstrate that our framework outperforms the other models in most metrics.

Multi-granularity spatial temporal graph convolution network with consecutive attention for human motion prediction

Human motion prediction is attracting increasing attention for its numerous potential applications in fields including autonomous driving, video surveillance and virtual reality. However, accurate motion prediction is challenging due to the complex spatial dependencies, dynamic temporal correlations and high dimension of human pose sequences. Existing graph-based methods rarely consider positional and channel information of the feature map, resulting in lower prediction accuracy. Therefore, we propose a novel multi-granularity spatial temporal graph convolution network with consecutive attention (MSTCA) for human motion prediction. Firstly, a multi-granularity spatial convolution network is introduced to capture spatial joint features through multiple kernel sizes. Then, consecutive attention module is proposed to capture both positional and channel information of the feature map. Next, MSTCA uses multi-granularity temporal convolutional network to extract temporal correlations with multiple receptive fields and predict future poses. Finally, a decoder composed of a 2D convolution layer and several PRelu layers integrates the output of the whole model. Experimental results on the GTA-IM and PROX datasets demonstrate that our method significantly improves the accuracy of human motion prediction in comparison to the existing approaches.

Forecasting road network functionality states during extreme rainfall events to facilitate real-time emergency response planning

Rapid prediction of Road Network Functionality (RNF) during extreme rainfall-induced flooding is crucial for supporting proactive and real-time emergency planning, such as rescue, evacuation planning, and emergency supply distribution. Unlike normal operational conditions, extreme rainfall events introduce complex non-stationary, non-Euclidean characteristics to RNF due to intricate meteorological and hydrological processes, as well as the role of a community's road network in emergency response planning. Conventional physics-based flood simulations and flow-based road network analyses typically lack the computational efficiency required for real-time RNF predictions, hindering timely risk mitigation decisions. This study leverages the accuracy of physics-based simulations and the efficacy of deep-learning technologies to develop a deep learning-based surrogate model for Rain-to-RNF (R2R) predictions. This model couples Long Short-Term Memory (LSTM) networks with Spatial-Temporal Graph Convolutional Networks (ST-GCNs) to uniquely capture the spatiotemporal dynamics of RNF under extreme rainfall events. The predictive accuracy, stability, and versatility of the R2R surrogate model are demonstrated in four flood-prone communities in Zhejiang Province. Its implementation during Typhoon Fitow (2013) over a 30-hour intense rainfall showcases its promising predictive capacity and unparalleled computational efficiency. This research advances disaster management, enhancing the resilience and responsiveness of community infrastructure during extreme weather events.

Multi-level traffic-responsive tilt camera surveillance through predictive correlated online learning

In urban traffic management, the primary challenge of dynamically and efficiently monitoring traffic conditions is compounded by the insufficient utilization of thousands of surveillance cameras along the intelligent transportation system. This paper introduces the multi-level Traffic-responsive Tilt Camera surveillance system (TTC-X), a novel framework designed for dynamic and efficient monitoring and management of traffic in urban networks. By leveraging widely deployed pan–tilt-cameras (PTCs), TTC-X overcomes the limitations of a fixed field of view in traditional surveillance systems by providing mobilized and 360-degree coverage. The innovation of TTC-X lies in the integration of advanced machine learning modules, including a detector–predictor–controller structure, with a novel Predictive Correlated Online Learning (PiCOL) methodology and the Spatial–Temporal Graph Predictor (STGP) for real-time traffic estimation and PTC control. The TTC-X is tested and evaluated under three experimental scenarios (e.g., maximum traffic flow capture, dynamic route planning, traffic state estimation) based on a simulation environment calibrated using real-world traffic data in Brooklyn, New York. The experimental results showed that TTC-X captured over 60% total number of vehicles at the network level, dynamically adjusted its route recommendation in reaction to unexpected full-lane closure events, and reconstructed link-level traffic states with best MAE less than 1.25 vehicle/hour. Demonstrating scalability, cost-efficiency, and adaptability, TTC-X emerges as a powerful solution for urban traffic management in both cyber–physical and real-world environments.

AdpSTGCN: Adaptive spatial–temporal graph convolutional network for traffic forecasting

Traffic flow forecasting plays a crucial role in applications such as intelligent transportation systems. Despite significant research in this field, the current methods have limitations that hinder the realization of highly accurate predictions. Existing GCN-based approaches typically rely on a definite graph structure derived from a physical topology or learned from node features, which is insufficient for building intricate spatial relationships among nodes. To address this challenge, we propose an adaptive spatial–temporal graph convolutional network for traffic forecasting. Our approach exploits a multi-head attention mechanism to construct multi-view feature graphs. We then introduce an adaptive graph convolution method to dynamically aggregate and propagate information from both the topology graph and multi-view feature graphs, which are capable of capturing complex spatial correlations across diverse proximity ranges. Furthermore, we designed a cascaded structural framework that combines temporal information with node features using gated dilated causal convolution to ensure the integrated modeling of spatial–temporal dynamics in traffic flow. Experiments on real-world datasets demonstrate that our proposed method outperforms the current mainstream methods, achieving better performance in traffic flow forecasting. The code is available at https://github.com/dhxdla/AdpSTGCN.git.

Multi-granular spatial-temporal synchronous graph convolutional network for robust action recognition

Graph Convolutional Networks (GCNs) have shown great potential in skeleton-based human action recognition. However, due to the diversity and complexity, modeling human actions as general graphs and capturing discriminative spatial–temporal motion patterns is challenging. Besides, the inevitable interference, especially occlusion, impairs the robustness of existing methods that depend on complete skeletons. To solve these problems, we propose a Multi-Granular Spatial-Temporal Synchronous Graph Convolutional Network (MSS-GCN). Firstly, we investigate three partition strategies: attribute, activity, and mixed partition strategy to optimize the weight-sharing mechanism of GCNs, which facilitates the novel Extended Adaptive Graph Convolution (EAGC) module. Secondly, we elaborate on a Multi-sliced Spatial–temporal Graph (MSTG) for multi-granular action modeling. Thirdly, we present a Synchronized Slice Encoder (Syn-STE) to simultaneously embed spatial and temporal action patterns. Then, we design Multi-granular Spatial–temporal Encoders (Multi-STE) with multi-branch Syn-STE to generate multi-granular context. The extensive experiments verified that MSS-GCN is more robust and outperforms benchmarks on NTU-RGB+D, NTU-RGB+D 120, and NW-UCLA datasets.

Spatial and temporal attention embedded spatial temporal graph convolutional networks for skeleton based gait recognition with multiple IMUs

Gait recognition is one of the key technologies for exoskeleton robot control, while the current IMU-based gait recognition methods only use inertial data and do not fully consider the interconnections of human spatial structure and human joints. In this regard, a skeleton-based gait recognition approach with inertial measurement units using spatial temporal graph convolutional networks with spatial and temporal attention is proposed. A human forward kinematics solver module was used for constructing different human skeleton models and a temporal attention module was added for capturing the more important time frames in the gait cycle. Moreover, the two-stream structure was used to construct spatial temporal graph convolutional networks with spatial and temporal attention for gait recognition, and an average accuracy of about 99% was obtained in user experiments, which is the best performance compared to other algorithms, provides certain reference for gait recognition and real-time control of exoskeleton robots.