Attention-based Neural Network Research Articles

ABCNN-IDS: Attention-Based Convolutional Neural Network for Intrusion Detection in IoT Networks

This paper proposes an attention-based convolutional neural network (ABCNN) for intrusion detection in the Internet of Things (IoT). The proposed ABCNN employs an attention mechanism that aids in the learning process for low-instance classes. On the other hand, the Convolutional Neural Network (CNN) employed in the ABCNN framework converges toward the most important parameters and effectively detects malicious activities. Furthermore, the mutual information technique is employed during the pre-processing stage to filter out the most significant features from the datasets, thereby improving the effectiveness of the ABCN model. To assess the effectiveness of the ABCNN approach, we utilized the Edge-IoTset, IoTID20, ToN_IoT, and CIC-IDS2017 datasets. The performance of the proposed architecture was assessed using various evaluation metrics, such as precision, recall, F1-score, and accuracy. Additionally, the performance of the proposed model was compared to multiple ML and DL methods to evaluate its effectiveness. The proposed model exhibited impressive performance on all the utilized datasets, achieving an average accuracy of 99.81%. Furthermore, it demonstrated excellent scores for other evaluation metrics, including 98.02% precision, 98.18% recall, and 98.08% F1-score, which outperformed other ML and DL models.

MPSA: Multi-Position Supervised Soft Attention-based convolutional neural network for histopathological image classification

In recent years, significant achievements have been made in the field of histopathological image analysis using convolutional neural networks (CNNs). However, existing CNNs fail to fully capture the important local structures and regional information in histopathological images due to the complex tissue structures and variable pathological features present in these images. They often treat all regions equally, which further exacerbates the challenge of accurately analyzing such images. Current network model can’t extract deep layer features efficiently without guiding. To alleviate this problem, we propose a novel network model called Multi-Position Supervised Soft Attention (MPSA). MPSA adds regions of interest (RoI) labels at multiple feature layers for deep supervision, and then uses the supervised layers as soft attention to guide the learning of the classification network, enabling the network to accurately extract features of the lesion target. Additionally, we design a Multi-level Attention Feature Enhancement Module (MAFEM), which combines multiple levels of attention mechanisms to enhance the performance of the convolutional neural network in histopathological image classification. MAFEM includes spatial attention, soft attention of the main branch, and our proposed soft attention for multi-branch feature fusion. The proposed soft attention for multi-branch feature fusion aims to enhance the predictive performance of the classification model by activating relevant neurons in the diagnostic area in a highly activated state, while effectively avoiding noise activation. This innovative approach ensures that the model can focus on the most pertinent information, leading to improved classification accuracy. We conducted classification experiments on the liver cancer histopathological images dataset and the results showed that our method achieved a classification accuracy of 95.79%, indicating that it is very effective in the analysis of liver histopathological images. Our proposed network architecture has also demonstrated good generalization ability in other medical datasets, achieving a classification accuracy of 84.41% on the ultrasound carotid plaque dataset.

CBAR-UNet: A novel methodology for segmentation of cardiac magnetic resonance images using block attention-based deep residual neural network

CBAR-UNet: A novel methodology for segmentation of cardiac magnetic resonance images using block attention-based deep residual neural network

Multivariate Attention-Based Orbit Uncertainty Propagation and Orbit Determination Method for Earth–Jupiter Transfer

Current orbit uncertainty propagation (OUP) and orbit determination (OD) methods suffer from drawbacks related to high computational burden, limiting their applications in deep space missions. To this end, this paper proposes a multivariate attention-based method for efficient OUP and OD of Earth–Jupiter transfer. First, a neural network-based OD framework is utilized, in which the orbit propagation process in a traditional unscented transform (UT) and unscented Kalman filter (UKF) is replaced by the neural network. Then, the sample structure of training the neural network for the Earth–Jupiter transfer is discussed and designed. In addition, a method for efficiently generating a large number of samples for the Earth–Jupiter transfer is presented. Next, a multivariate attention-based neural network (MANN) is designed for orbit propagation, which shows better capacity in terms of accuracy and generalization than the deep neural network. Finally, the proposed method is successfully applied to solve the OD problem in an Earth–Jupiter transfer. Simulations show that the proposed method can obtain a similar estimation to the UKF while saving more than 90% of the computational cost.

ERSegDiff: a diffusion-based model for edge reshaping in medical image segmentation

Medical image segmentation is a crucial field of computer vision. Obtaining correct pathological areas can help clinicians analyze patient conditions more precisely. We have observed that both CNN-based and attention-based neural networks often produce rough segmentation results around the edges of the regions of interest. This significantly impacts the accuracy of obtaining the pathological areas. Without altering the original data and model architecture, further refining the initial segmentation outcomes can effectively address this issue and lead to more satisfactory results. Recently, diffusion models have demonstrated outstanding results in image generation, showcasing their powerful ability to model distributions. We believe that this ability can greatly enhance the accuracy of the reshaping results. This research proposes ERSegDiff, a neural network based on the diffusion model for reshaping segmentation borders. The diffusion model is trained to fit the distribution of the target edge area and is then used to modify the segmentation edge to produce more accurate segmentation results. By incorporating prior knowledge into the diffusion model, we can help it more accurately simulate the edge probability distribution of the samples. Moreover, we introduce the edge concern module, which leverages attention mechanisms to produce feature weights and further refine the segmentation outcomes. To validate our approach, we employed the COVID-19 and ISIC-2018 datasets for lung segmentation and skin cancer segmentation tasks, respectively. Compared with the baseline model, ERSegDiff improved the dice score by 3%–4% and 2%–4%, respectively, and achieved state-of-the-art scores compared to several mainstream neural networks, such as swinUNETR.

Manifold attention-enhanced multi-domain convolutional network for decoding motor imagery intention

Research in brain-computer interface (BCI), particularly in brain intention decoding, has made significant strides relying on the remarkable capabilities of deep learning (DL). However, many current DL framework-based models struggle to effectively utilize complementary information present in various domains of electroencephalographic (EEG) signals. This limitation may lead to suboptimal performance, particularly exacerbated by the presence of noise and artifacts. Therefore, this study proposed a manifold attention-based multi-domain convolutional neural network, known as MAMCNet, to benefit from complementary strengths across different domains of EEG signals. Specifically, the EEG signals were divided into multi-band data representations based on frequency. Multiple spatiotemporal convolutional blocks were then devised to simultaneously extract the spatiotemporal feature maps from these sub-band components. To enhance the model's robustness, these maps were mapped onto the Riemannian manifold. Additionally, manifold attention was utilized to emphasize salient spatiotemporal feature maps with attention focused on the target. A frequency convolutional block was specifically designed to merge optimized feature maps from different bands, extracting temporospatiofrequency features in EEG signals comprehensively. The experimental results on two datasets demonstrated that the proposed model outperformed the mainstream DL architecture-based model. These results suggest that the proposed model could offer an alternative scheme for facilitating BCI applications.

Intelligent pest forecasting with meteorological data: An explainable deep learning approach

Accurate pest outbreak forecasting is crucial for protecting agricultural yields and environmental health. This study addresses limitations in existing meteorological data-driven approaches by introducing a novel, interpretable deep learning architecture: the Attention-based Long Short-Term Memory Interaction Convolutional Neural Network (ALIC) model. The ALIC model excels at extracting intricate interrelationships within multivariate time series data encompassing both meteorological and historical pest data. The proposed architecture employs a meticulous three-stage processing pipeline. The initial stage, a feature attention layer, pinpoints the most influential forecasting factors within the input data. Subsequently, the feature interaction extraction layer leverages Long Short-Term Memory (LSTM) networks to capture temporal dynamics and a novel Interaction Convolutional Neural Network (ICNN) to extract feature interactions between meteorological and historical pest data. Finally, the output layer generates accurate pest outbreak forecasts. The ALIC model’s effectiveness is rigorously validated using real-world data obtained from observation stations in Huiyang and Shantou, Guangdong Province, China. The model demonstrably outperforms benchmarks, achieving significantly lower forecasting errors across diverse forecast horizons. This finding underscores the ALIC model’s efficacy in capturing intricate relationships between pest outbreaks and meteorological variables. Importantly, our feature importance analysis pinpoints temperature, rainfall as crucial for pest forecasting, bolstering the model’s utility in pest management.

Quality Prediction Modeling for Industrial Processes Using Multiscale Attention-Based Convolutional Neural Network.

Soft sensors have been increasingly applied for quality prediction in complex industrial processes, which often have different scales of topology and highly coupled spatiotemporal features. However, the existing soft sensing models usually face difficulties in extracting the multiscale local spatiotemporal features in multicoupled complex process data and harnessing them to their full potential to improve the prediction performance. Therefore, a multiscale attention-based CNN (MSACNN) is proposed in this article to alleviate such problems. In MSACNN, convolutional kernels of different sizes are first designed in parallel in the convolutional layers, which can generate feature maps containing local spatiotemporal features at different scales. Meanwhile, a channel-wise attention mechanism is designed on the feature maps in parallel to get their attention weights, representing the significance of the local spatiotemporal feature at different scales. The superiority of the proposed MSACNN over the other state-of-the-art methods is validated through the performance evaluation in two real industrial processes.

An efficient convolutional neural network for detecting the crime of stealing in videos

In the current age of technological progress, surveillance cameras are extensively placed in densely populated areas to encourage public safety. However, detecting stealing activities within surveillance footage remains a challenge. The global issue of stealing leads to significant casualties and financial losses annually. There has been limited research on efficient techniques to identify this anomaly. In this manuscript, an efficient multi-scale attention-based convolutional neural network with skill optimization algorithm (MSAC-SOA) is proposed for detecting theft during day and night in surveillance videos. This approach integrates with the enhanced single-shot multibook detector (ESSD) for object detection in video footage, facilitating the precise identification and localization of objects within each frame. Subsequently, the proposed MSAC-SOA effectively detects and classifies instances of stealing. Finally, a theft detection alert message is sent to the control room. This approach is assessed with two datasets: University of Central Florida (UCF) crime dataset for daytime theft detection and real-time video data for nighttime theft detection. The proposed method demonstrates faster computation times compared to previous techniques, highlighting its efficiency and suitability in terms of various merits for real-life videos of diverse scenarios. It exhibits robust performance across various metrics, including 99.88% accuracy, 99.66% precision, 100% recall, 99.89% F1-score, 99.83% area under the ROC curve (AUC), and 99.83% specificity.

Learning to Generate Temporal Origin-destination Flow Based-on Urban Regional Features and Traffic Information

Origin-destination (OD) flow contains population mobility information between every two regions in the city, which is of great value in urban planning and transportation management. Nevertheless, the collection of OD flow data is extremely difficult due to the hindrance of privacy issues and collection costs. Significant efforts have been made to generate OD flow based on urban regional features, e.g., demographics, land use, and so on, since spatial heterogeneity of urban function is the primary cause that drives people to move from one place to another. On the other hand, people travel through various routes between OD, which will have effects on urban traffic, e.g., road travel speed and time. These effects of OD flows reveal the fine-grained spatiotemporal patterns of population mobility. Few works have explored the effectiveness of incorporating urban traffic information into OD generation. To bridge this gap, we propose to generate real-world daily temporal OD flows enhanced by urban traffic information in this paper. Our model consists of two modules: Urban2OD and OD2Traffic . In the Urban2OD module, we devise a spatiotemporal graph neural network to model the complex dependencies between daily temporal OD flows and regional features. In the OD2Traffic module, we introduce an attention-based neural network to predict urban traffic based on OD flow from the Urban2OD module. Then, by utilizing gradient backpropagation, these two modules are able to enhance each other to generate high-quality OD flow data. Extensive experiments conducted on real-world datasets demonstrate the superiority of our proposed model over the state of the art.

Lung Cancer Classification using Optimized Attention-based Convolutional Neural Network with DenseNet-201 Transfer Learning Model on CT image

In this paper, the Lung Cancer Classification using Convolutional Neural Network with DenseNet-201 Transfer Learning model optimized through Namib Beetle Optimization Algorithm on CT image (AtCNN-DenseNet-201 TL-NBOA-CT) is proposed. The input data are gathered from the CT Lung image. In pre-processing section, it removes the noise and enhances input images by Modified Sage-Husa Kalman Filtering (MSHKF).The pre-processed image is given into feature extraction phase. Then, six statistical features including mean, variance, entropy, energy, Average Amplitude, kurtosis are extracted based on Improved Empirical Wavelet Transforms (IEWT). Then, the extracted features are given to the Attention-based Convolutional Neural Network with DenseNet-201Transfer Learning (AtCNN-DenseNet-201 TL) to classify the Cancer and Non-Cancer of the CT image, where batch normalization layer of At CNN eliminated and added by DenseNet-201 layer. Namib Beetle Optimization Algorithm (NBOA) proposed in this work to enhance the AtCNN-DenseNet-201 classifier, which precisely classifies the lung cancer. The proposed AtCNN-DenseNet-201 TL-NBOA-CT method is implemented and the effectiveness is assessed with some performance measures. The proposed AtCNN-DenseNet-201 TL-NBOA-CT method attains 18.30 %, 21.37 % and 23.07 % greater precision, 24.84 %, 16.32 % and 31.36 % greater accuracy and 14.32 %, 21.97 % and 23.38 % greater F1-Score compared with existing techniques like detection and categorization of lung cancer CT pictures utilizing improved deep belief network along Gabor filters (CLC-CT-EDBN), presented categorization of lung cancer CT pictures utilizing a three dimensional deep CNN with multi-layer filter (CLC-CT-3D-DCNN), and novel hybrid deep learning technique for early identification of lung cancer utilizing neural networks (CLC-CT-3D-CNN) respectively.

Attention-based convolutional neural network with multi-modal temporal information fusion for motor imagery EEG decoding

Convolutional neural network (CNN) has been widely applied in motor imagery (MI)-based brain computer interface (BCI) to decode electroencephalography (EEG) signals. However, due to the limited perceptual field of convolutional kernel, CNN only extracts features from local region without considering long-term dependencies for EEG decoding. Apart from long-term dependencies, multi-modal temporal information is equally important for EEG decoding because it can offer a more comprehensive understanding of the temporal dynamics of neural processes. In this paper, we propose a novel deep learning network that combines CNN with self-attention mechanism to encapsulate multi-modal temporal information and global dependencies. The network first extracts multi-modal temporal information from two distinct perspectives: average and variance. A shared self-attention module is then designed to capture global dependencies along these two feature dimensions. We further design a convolutional encoder to explore the relationship between average-pooled and variance-pooled features and fuse them into more discriminative features. Moreover, a data augmentation method called signal segmentation and recombination is proposed to improve the generalization capability of the proposed network. The experimental results on the BCI Competition IV-2a (BCIC-IV-2a) and BCI Competition IV-2b (BCIC-IV-2b) datasets show that our proposed method outperforms the state-of-the-art methods and achieves 4-class average accuracy of 85.03% on the BCIC-IV-2a dataset. The proposed method implies the effectiveness of multi-modal temporal information fusion in attention-based deep learning networks and provides a new perspective for MI-EEG decoding. The code is available at https://github.com/Ma-Xinzhi/EEG-TransNet.

Multi-layered knowledge graph neural network reveals pathway-level agreement of three breast cancer multi-gene assays

Multi-gene assays have been widely used to predict the recurrence risk for hormone receptor (HR)-positive breast cancer patients. However, these assays lack explanatory power regarding the underlying mechanisms of the recurrence risk. To address this limitation, we proposed a novel multi-layered knowledge graph neural network for the multi-gene assays. Our model elucidated the regulatory pathways of assay genes and utilized an attention-based graph neural network to predict recurrence risk while interpreting transcriptional subpathways relevant to risk prediction. Evaluation on three multi-gene assays—Oncotype DX, Prosigna, and EndoPredict—using SCAN-B dataset demonstrated the efficacy of our method. Through interpretation of attention weights, we found that all three assays are mainly regulated by signaling pathways driving cancer proliferation especially RTK-ERK-ETS-mediated cell proliferation for breast cancer recurrence. In addition, our analysis highlighted that the important regulatory subpathways remain consistent across different knowledgebases used for constructing the multi-level knowledge graph. Furthermore, through attention analysis, we demonstrated the biological significance and clinical relevance of these subpathways in predicting patient outcomes. The source code is available at http://biohealth.snu.ac.kr/software/ExplainableMLKGNN.

Attention-based convolution neural network for magnetic tile surface defect classification and detection

Effectively identifying surface defects in magnetic tiles has proven to be highly challenging due to limited sample availability and irrelevant background interference, which also plays a crucial role in significantly influencing the lifespan and reliability of permanent magnet motors. To address these challenges, our study draws inspiration from a comprehensive analysis of the retinal attention mechanism and proposes three guiding criteria: multi-level resolution, what to look for, and where to look at. These criteria are utilized as foundational principles to enhance the representation learning capability of designed neural network structures through the incorporation of the retinal attention mechanism. Subsequently, based on these guiding criteria, we introduce a novel convolutional retinal attention block (CRAB) to learn discriminative and robust feature representations for magnetic tile surface defect classification and detection. The proposed CRAB comprises three modules: multi-resolution module (MRM), global attention aggregation module (GAAM), and local attention aggregation module (LAAM), designed to extract discriminative and robust features by refining meaningful information and suppressing redundant ones. Comprehensive experimental results across image classification and object detection tasks demonstrate that the proposed CRAB outperforms existing methods such as SE, ECA, and CBAM, and can effectively amplify the representation power across various backbone networks, including VGG-16, GoogLeNet, ResNet-18, and ResNet-50. An evaluation on surface defect classification and detection tasks for industrial magnetic tiles further shows that CRAB achieves accuracies of 99.50% and 96.98%, respectively. These results emphasize the promising application prospects of the proposed method in detecting industrial surface defects amid expansive and inconsequential backgrounds. The code of the proposed method is available at: https://github.com/KWflyer/CRAB.

A single-joint multi-task motor imagery EEG signal recognition method based on Empirical Wavelet and Multi‐Kernel Extreme Learning Machine

BackgroundIn the pursuit of finer Brain-Computer Interface commands, research focus has shifted towards classifying EEG signals for multiple tasks. While single-joint multitasking motor imagery provides support, distinguishing between EEG signals from the same joint remains challenging due to their similar brain spatial distribution. New methodWe designed experiments involving three motor imagery tasks—wrist extension, wrist flexion, and wrist abduction—with six participants. Based on this, a single-joint multi-task motor imagery EEG signal recognition method using Empirical Wavelet Decomposition and Multi-Kernel Extreme Learning Machine is proposed. This method employs Empirical Wavelet Decomposition (EWT) for modal decomposition, screening, and reconstruction of raw EEG signals, feature extraction using Common Spatial Patterns (CSP), and classification using Multi-Kernel Extreme Learning Machine (MKELM). ResultsAfter EWT processing, differences in time and frequency characteristics between EEG signals of different classes were enhanced, with the MKELM model achieving an average recognition accuracy of 91.93 %. Comparison with other methods and conclusionsWe compared EWT with Empirical Mode Decomposition (EMD), Variational Mode Decomposition (VMD), Local Mean Decomposition (LMD), and Wavelet Packet Decomposition (WPD). The results showed that the differences between various types of EEG signals processed by EWT were the most pronounced. The MKELM model outperformed traditional machine learning models such as Extreme Learning Machine (ELM), Support Vector Machine (SVM), K-Nearest Neighbors (KNN), and Linear Discriminant Analysis (LDA) in terms of recognition performance, and also exhibited faster training speeds than deep learning models such as Bayesian Convolutional Neural Network (BCNN) and Attention-based Dual-scale Fusion Convolutional Neural Network (ADFCNN). In summary, the proposed method provides a new approach for achieving finer Brain-Computer Interface commands.

Automatic Building Roof Plane Extraction in Urban Environments for 3D City Modelling Using Remote Sensing Data

Delineating and modelling building roof plane structures is an active research direction in urban-related studies, as understanding roof structure provides essential information for generating highly detailed 3D building models. Traditional deep-learning models have been the main focus of most recent research endeavors aiming to extract pixel-based building roof plane areas from remote-sensing imagery. However, significant challenges arise, such as delineating complex roof boundaries and invisible boundaries. Additionally, challenges during the post-processing phase, where pixel-based building roof plane maps are vectorized, often result in polygons with irregular shapes. In order to address this issue, this study explores a state-of-the-art method for planar graph reconstruction applied to building roof plane extraction. We propose a framework for reconstructing regularized building roof plane structures using aerial imagery and cadastral information. Our framework employs a holistic edge classification architecture based on an attention-based neural network to detect corners and edges between them from aerial imagery. Our experiments focused on three distinct study areas characterized by different roof structure topologies: the Stadsveld–‘t Zwering neighborhood and Oude Markt area, located in Enschede, The Netherlands, and the Lozenets district in Sofia, Bulgaria. The outcomes of our experiments revealed that a model trained with a combined dataset of two different study areas demonstrated a superior performance, capable of delineating edges obscured by shadows or canopy. Our experiment in the Oude Markt area resulted in building roof plane delineation with an F-score value of 0.43 when the model trained on the combined dataset was used. In comparison, the model trained only on the Stadsveld–‘t Zwering dataset achieved an F-score value of 0.37, and the model trained only on the Lozenets dataset achieved an F-score value of 0.32. The results from the developed approach are promising and can be used for 3D city modelling in different urban settings.

Fault severity recognition in axial piston pumps using attention-based adversarial discriminative domain adaptation neural network

Axial piston pumps are the ‘hearts’ of hydraulic systems whose fault recognition is necessary for the safety and reliability of hydraulic equipment. These pumps operate under different operating conditions and the fault recognition model trained at one operating point cannot be applicable at another operating point due to the problem of domain shifts. This paper proposes a transfer learning method for the fault severity recognition of axial piston pumps based on adversarial discriminative domain adaptation fused with a convolutional channel attention module. First, a convolutional neural network is pre-trained with labeled vibration data from the source domain, and a convolutional channel attention module is added to assign weights to different convolution kernels. Second, the trained source model is transferred to the target domain, and its parameters are updated by an adversarial training process between the labeled source data and the unlabeled target data. Finally, vibration data are collected from an axial piston pump at different fault levels under various operating conditions to validate the proposed method. Experimental results indicate that the proposed method achieves an average recognition accuracy of 98.3% and outperforms some other transfer learning methods by a large margin.

AC-CfC: An attention-based convolutional closed-form continuous-time neural network for raw multi-channel EEG-based emotion recognition

Emotion recognition based on electroencephalogram (EEG) is a critical task in the field of affective brain-computer interfaces. However, due to the non-stationarity and individual variability of EEG, hand-designed features cannot adequately capture the nonlinear and high-dimensional properties of raw EEG. Currently, spatial–temporal models have been verified to effectively capture the spatial–temporal information for EEG. However, these models are characterized by complex structures, large parameter counts, and the need for extensive training data. To overcome these disadvantages, this paper propose an end-to-end spatial–temporal model for emotion recognition based on raw EEG, called attention-based convolutional closed-form continuous-time neural network (AC-CfC). This model employs a channel attention mechanism to weight and encode EEG, capturing channel dependencies. Subsequently, one-dimensional convolutional neural networks and closed-form continuous-time neural networks are used to extract deep spatial–temporal features. Additionally, an adaptive loss-controlling mechanism is designed to enhance the model's decision-making ability between classes that are easily confused. To verify the effectiveness of the proposed model, experiments are conducted on the DEAP and DREAMER datasets. The average accuracies of the proposed model reach to 94.76% and 93.01% for valence and arousal in subject-independent experiments on the DEAP dataset, with an improvement of 11.8% and 8.73% respectively compared with the state-of-art model ACRNN. On the DREAMER dataset, the average accuracies reach to 81.83%, 81.22%, and 80.63% for valence, arousal and dominance, with an improvement of 2.55%, 6.64%, and 6.98% respectively over ACRNN. These results show that our proposed model exhibits better performance than some state-of-art models in the same category.

ResMatch: Residual Attention Learning for Feature Matching

Attention-based graph neural networks have made great progress in feature matching. However, the literature lacks a comprehensive understanding of how the attention mechanism operates for feature matching. In this paper, we rethink cross- and self-attention from the viewpoint of traditional feature matching and filtering. To facilitate the learning of matching and filtering, we incorporate the similarity of descriptors into cross-attention and relative positions into self-attention. In this way, the attention can concentrate on learning residual matching and filtering functions with reference to the basic functions of measuring visual and spatial correlation. Moreover, we leverage descriptor similarity and relative positions to extract inter- and intra-neighbors. Then sparse attention for each point can be performed only within its neighborhoods to acquire higher computation efficiency. Extensive experiments, including feature matching, pose estimation and visual localization, confirm the superiority of the proposed method. Our codes are available at https://github.com/ACuOoOoO/ResMatch.

A Temporal Fusion Transformer Model to Forecast Overflow from Sewer Manholes during Pluvial Flash Flood Events

This study employs a temporal fusion transformer (TFT) for predicting overflow from sewer manholes during heavy rainfall events. The TFT utilised is capable of forecasting overflow hydrographs at the manhole level and was tested on a sewer network with 975 manholes. As part of the investigations, the TFT was compared to other deep learning architectures to evaluate its predictive performance. In addition to precipitation measurements and forecasts, the issue of how the additional consideration of measurements in the sewer network as model inputs impacts forecast accuracy was investigated. A varying number of sensors and different measurement signals were compared. The results indicate high performance for the TFT compared to other model architectures like a long short-term memory (LSTM) network or a dual-stage attention-based recurrent neural network (DA-RNN). Additionally, results suggest that considering a single measuring point at the outlet of the sewer network instead of an entire measuring network yields better forecasts. One possible explanation is the high correlation between measurements, which increases model and training complexity without adding much value.