Reduction In Mean Square Error Research Articles

Convolutional Neural Network-Based Bidirectional Gated Recurrent Unit–Additive Attention Mechanism Hybrid Deep Neural Networks for Short-Term Traffic Flow Prediction

To more accurately predict short-term traffic flow, this study posits a sophisticated integrated prediction model, CNN-BiGRU-AAM, based on the additive attention mechanism of a convolutional bidirectional gated recurrent unit neural network. This model seeks to enhance the precision of traffic flow prediction by integrating both historical and prospective data. Specifically, the model achieves prediction through two steps: encoding and decoding. In the encoding phase, convolutional neural networks are used to extract spatial correlations between weather and traffic flow in the input sequence, while the BiGRU model captures temporal correlations in the time series. In the decoding phase, an additive attention mechanism is introduced to weigh and fuse the encoded features. The experimental results demonstrate that the CNN-BiGRU model, coupled with the additive attention mechanism, is capable of dynamically capturing the temporal patterns of traffic flow, and the introduction of isolation forests can effectively handle data anomalies and missing values, improving prediction accuracy. Compared to benchmark models such as GRU, the CNN-BiGRU-AAM model shows significant improvement on the test set, with a 47.49 reduction in the Root Mean Square Error (RMSE), a 30.72 decrease in the Mean Absolute Error (MAE), and a 5.27% reduction in the Mean Absolute Percentage Error (MAPE). The coefficient of determination (R2) reaches 0.97, indicating the high accuracy of the CNN-BiGRU-AAM model in traffic flow prediction. It provides a good solution for short-term traffic flow with spatio-temporal features, thereby enhancing the efficiency of traffic management and planning and promoting the sustainable development of transportation.

Exploring a spatiotemporal hetero graph-based long short-term memory model for multi-step-ahead flood forecasting

Operational flood prevention platforms and systems rely upon the advance notice provided by flood forecasts to formulate efficient measures for flood mitigation. Capturing complex spatial heterogeneity and correlation of hydro-meteorological variables is fundamentally challenging for artificial neural networks. This challenge becomes even more significant when the complexity involved introduces systematic biases and time-lag phenomena in flood forecasts. For the first time, this study proposed a Spatiotemporal Hetero Graph-based Long Short-term Memory (SHG-LSTM) model for multi-step-ahead flood forecasting. The case study focused on the Jianxi basin in China. 25,341 hydro-meteorological data, with a temporal resolution of three hours, collected during flood events were divided into training and test datasets for model construction purpose. The model was fed with 3-h streamflow and precipitation data from 23 gauge stations, covering a time span of the preceding 21 h, for generating flood forecasts at 1 up to 7 horizons. To make a comparative analysis, both LSTM and the Spatiotemporal Graph Convolutional Network (S-GCN) were constructed. This study conducted multiple rounds of model training with varying initial parameters to assess the accuracy, stability, and reliability of the LSTM, S-GCN, and SHG-LSTM models. The results demonstrated that the SHG-LSTM model outperformed LSTM and S-GCN models, with an average reduction in the volume error (VE) of 6.5% and 11.1%, respectively, a decrease in the Mean Absolute Error (MAE) of 6.7% and 8.1%, respectively, and a reduction in the Root Mean Square Error (RMSE) of 5.0% and 12.9%, respectively. Furthermore, the SHG-LSTM model not only could efficiently overcome the under-prediction bottleneck, but also could largely mitigate the time-lag phenomenon in flood forecasts, even during the testing stages. These findings indicate that the proposed SHG-LSTM model can provide a general framework for modelling the spatial heterogeneity and correlation of hydro-meteorological variables and achieve accurate and reliable flood forecasts, thereby enhancing the model’s applicability in flood prevention platforms and systems.

RSPSSL: A novel high-fidelity Raman spectral preprocessing scheme to enhance biomedical applications and chemical resolution visualization

Raman spectroscopy has tremendous potential for material analysis with its molecular fingerprinting capability in many branches of science and technology. It is also an emerging omics technique for metabolic profiling to shape precision medicine. However, precisely attributing vibration peaks coupled with specific environmental, instrumental, and specimen noise is problematic. Intelligent Raman spectral preprocessing to remove statistical bias noise and sample-related errors should provide a powerful tool for valuable information extraction. Here, we propose a novel Raman spectral preprocessing scheme based on self-supervised learning (RSPSSL) with high capacity and spectral fidelity. It can preprocess arbitrary Raman spectra without further training at a speed of ~1 900 spectra per second without human interference. The experimental data preprocessing trial demonstrated its excellent capacity and signal fidelity with an 88% reduction in root mean square error and a 60% reduction in infinite norm (L∞\\documentclass[12pt]{minimal} \\usepackage{amsmath} \\usepackage{wasysym} \\usepackage{amsfonts} \\usepackage{amssymb} \\usepackage{amsbsy} \\usepackage{mathrsfs} \\usepackage{upgreek} \\setlength{\\oddsidemargin}{-69pt} \\begin{document}$${L}_{{\\infty }}$$\\end{document}) compared to established techniques. With this advantage, it remarkably enhanced various biomedical applications with a 400% accuracy elevation (ΔAUC) in cancer diagnosis, an average 38% (few-shot) and 242% accuracy improvement in paraquat concentration prediction, and unsealed the chemical resolution of biomedical hyperspectral images, especially in the spectral fingerprint region. It precisely preprocessed various Raman spectra from different spectroscopy devices, laboratories, and diverse applications. This scheme will enable biomedical mechanism screening with the label-free volumetric molecular imaging tool on organism and disease metabolomics profiling with a scenario of high throughput, cross-device, various analyte complexity, and diverse applications.

A hybrid denoising approach for PPG signals utilizing variational mode decomposition and improved wavelet thresholding.

Photoplethysmography (PPG) signals are sensitive to motion-induced interference, leading to the emergence of motion artifacts (MA) and baseline drift, which significantly affect the accuracy of PPG measurements. The objective of our study is to effectively eliminate baseline drift and high-frequency noise from PPG signals, ensuring that the signal's critical frequency components remain within the range of 1 ∼ 10Hz. This paper introduces a novel hybrid denoising method for PPG signals, integrating Variational Mode Decomposition (VMD) with an improved wavelet threshold function. The method initially employs VMD to decompose PPG signals into a set of narrowband intrinsic mode function (IMF) components, effectively removing low-frequency baseline drift. Subsequently, an improved wavelet thresholding algorithm is applied to eliminate high-frequency noise, resulting in denoised PPG signals. The effectiveness of the denoising method was rigorously assessed through a comprehensive validation process. It was tested on real-world PPG measurements, PPG signals generated by the Fluke ProSim™8 Vital Signs Simulator with synthesized noise, and extended to the MIMIC-III waveform database. The application of the improved threshold function let to a substantial 11.47% increase in signal-to-noise ratio (SNR) and an impressive 26.75% reduction in root mean square error (RMSE) compared to the soft threshold function. Furthermore, the hybrid denoising method improved SNR by 15.54% and reduced RMSE by 37.43% compared to the improved threshold function. This study proposes an effective PPG denoising algorithm based on VMD and an improved wavelet threshold function, capable of simultaneously eliminating low-frequency baseline drift and high-frequency noise in PPG signals while faithfully preserving their morphological characteristics. This advancement establishes the foundation for time-domain feature extraction and model development in the domain of PPG signal analysis.

Transmission Line Icing Prediction Based on Dynamic Time Warping and Conductor Operating Parameters

Aiming to improve on the low accuracy of current transmission line icing prediction models and ignoring the objective law of icing of transmission lines, a transmission line icing prediction model considering the effect of transmission line tension on the bundle of icing thickness is proposed, based on a convolutional neural network (CNN) and bidirectional gated recurrent unit (BiGRU). Firstly, the finite element calculation model of the conductor and insulator system was established, and the change rule between transmission line tension and icing thickness was studied. Then, the convolutional neural network and bidirectional gated recurrent unit were used to construct a transmission line icing thickness prediction model The model incorporated a weighted fusion of soft−dynamic time warping (Soft−DTW) and the icing change rule as the loss function. Optimal weights were determined through the utilization of the grid search algorithm and cross−validation, contributing to an enhancement of the model’s generalization capabilities and a reduction in prediction errors. The results indicate that the proposed prediction model can consider the impact of line operating parameters, avoiding the shortcomings of prediction results conflicting with actual physical laws. Compared with traditional non−mechanical models, the proposed model showed reductions in root mean square error (RMSE), mean absolute error (MAE), and mean absolute percentage error (MAPE) by 0.26–0.51%, 0.24–0.44%, and 5.77–13.33%, respectively, while the coefficient of determination (R2) increased by 0.07–0.13.

Multiscale dilated denoising convolution with channel attention mechanism for micro-seismic signal denoising

Denoising micro-seismic signals is paramount for ensuring reliable data for localizing mining-related seismic events and analyzing the state of rock masses during mining operations. However, micro-seismic signals are commonly contaminated by various types of complex noise, which can hinder micro-seismic accurate P-wave pickup and analysis. In this study, we propose the Multiscale Dilated Convolutional Attention denoising method, referred to as MSDCAN, to eliminate complex noise interference. The MSDCAN denoising model consists of an encoder, an improved attention mechanism, and a decoder. To effectively capture the neighborhood features and multiscale features of the micro-seismic signal, we construct an initial dilated convolution block and a multiscale dilated convolution block in the encoder, and the encoder focuses on extracting the relevant feature information, thus eliminating the noise interference and improving the signal-to-noise ratio (SNR). In addition, the attention mechanism is improved and introduced between the encoder and decoder to emphasize the key features of the micro-seismic signal, thus removing the complex noise and further improving the denoising performance. The MSDCAN denoising model is trained and evaluated using micro-seismic data from Stanford University. Experimental results demonstrate an impressive increase in SNR by 11.237 dB and a reduction in root mean square error (RMSE) by 0.802. Compared to the denoising results of the DeepDenoiser, CNN-denoiser and Neighbor2Neighbor methods, the MSDCAN denoising model outperforms them by enhancing the SNR by 2.589 dB, 1.584 dB and 2dB, respectively, and reducing the RMSE by 0.219, 0.050 and 0.188, respectively. The MSDCAN denoising model presented in this study effectively improves the SNR of micro-seismic signals, offering fresh insights into micro-seismic signal denoising methodologies.

Spatiotemporal stacking method with daily‐cycle restrictions for reconstructing missing hourly PM2.5 records

AbstractThe reliability of hourly PM2.5 data obtained from air quality monitoring stations is compromised as a result of the missing values, thereby impeding the thorough examination of crucial information. In this paper, we present a spatiotemporal (ST) stacking machine learning (ML) method with daily‐cycle restrictions for reconstructing missing hourly PM2.5 records. First, the ST neighbors for the target station with missing values are selected at a daily scale. Subsequently, the non‐null data within the ST neighbors undergo an iterative P‐BSHADE interpolation process for re‐interpolation. Next, a stacking ML model is constructed using the re‐interpolation values and several environmental factors associated with PM2.5 as the predictors, while the observed PM2.5 is taken as the independent variable. Finally, the missing values are reconstructed by inputting the predictors into the trained stacking model. The study utilized hourly PM2.5 data in the Beijing‐Tianjin‐Hebei region as a case study to assess the effectiveness of the proposed method, using daily missing ratios of 10%, 30%, and 50%, respectively. The accuracy of the proposed method was then compared to four contemporary ST interpolation methods. The results indicate that the proposed method exhibits superior performance compared to the classical methods. Specifically, it achieves a reduction in the average root mean square error and mean absolute error by at least 40.6% and 40.1%, respectively. Additionally, the proposed method demonstrates the successful recovery of extreme values in the hourly PM2.5 records, in contrast to the classical methods which often exhibit a tendency to overestimate low values and underestimate high values. Overall, the proposed method presents a viable and efficient approach to recover missing values in the hourly PM2.5 records that demonstrate evident daily periodic patterns.

Enhancing data-driven soil moisture modeling with physically-guided LSTM networks

In recent years, deep learning methods have shown significant potential in soil moisture modeling. However, a prominent limitation of deep learning approaches has been the absence of physical mechanisms. To address this challenge, this study introduces two novel loss functions designed around physical mechanisms to guide deep learning models in capturing physical information within the data. These two loss functions are crafted to leverage the monotonic relationships between surface water variables and shallow soil moisture as well as deep soil water. Based on these physically-guided loss functions, two physically-guided Long Short-Term Memory (LSTM) networks, denoted as PHY-LSTM and PHYs-LSTM, are proposed. These networks are trained on the global ERA5-Land dataset, and the results indicate a notable performance improvement over traditional LSTM models. When used for global soil moisture forecasting for the upcoming day, PHY-LSTM and PHYs-LSTM models exhibit closely comparable results. In comparison to conventional data-driven LSTM models, both models display a substantial enhancement in various evaluation metrics. Specifically, PHYs-LSTM exhibits improvements in several key performance indicators: an increase of 13.6% in Kling-Gupta Efficiency (KGE), a 20.7% increase in Coefficient of Determination (R2), an 8.2% reduction in Root Mean Square Error (RMSE), and a 4.4% increase in correlation coefficient (R). PHY-LSTM also demonstrates improvements, with a 14.8% increase in KGE, a 19.6% increase in R2, an 8.2% reduction in RMSE, and a 4.4% increase in R. Additionally, both models exhibit enhanced physical consistency over a wide geographical area. Experimental results strongly emphasize that the incorporation of physical mechanisms can significantly bolster the predictive capabilities of data-driven soil moisture models.

Confidence intervals for intentionally biased estimators

. We propose and study three confidence intervals (CIs) centered at an estimator that is intentionally biased to reduce mean squared error. The first CI simply uses an unbiased estimator’s standard error; compared to centering at the unbiased estimator, this CI has higher coverage probability for confidence levels above 91. 7%, even if the biased and unbiased estimators have equal mean squared error. The second CI trades some of this “excess” coverage for shorter length. The third CI is centered at a convex combination of the two estimators to further reduce length. Practically, these CIs apply broadly and are simple to compute.

Quantitative Analysis of Near-Infrared Spectroscopy Using the BEST-1DConvNet Model

In the quest for enhanced precision in near-infrared spectroscopy (NIRS), in this study, the application of a novel BEST-1DConvNet model for quantitative analysis is investigated against conventional support vector machine (SVM) approaches with preprocessing such as multiplicative scatter correction (MSC) and standard normal variate (SNV). We assessed the performance of these methods on NIRS datasets of diesel, gasoline, and milk using a Fourier Transform Near-Infrared (FT-NIR) spectrometer having a wavelength range of 900–1700 nm for diesel and gasoline and 4000–10,000 nm for milk, ensuring comprehensive spectral capture. The BEST-1DConvNet’s effectiveness in chemometric predictions was quantitatively gauged by improvements in the coefficient of determination (R2) and reductions in the root mean square error (RMSE). The BEST-1DConvNet model achieved significant performance enhancements compared to the MSC + SNV + 1D + SVM model. Notably, the R2 value for diesel increased by approximately 48.85% despite a marginal RMSE decrease of 0.92%. R2 increased by 11.30% with a 3.32% RMSE reduction for gasoline, and it increased by 8.71%, accompanied by a 3.51% RMSE decrease for milk. In conclusion, the BEST-1DConvNet model demonstrates superior predictive accuracy and reliability in NIRS data analysis, marking a substantial leap forward in spectral analysis technology. This advancement could potentially streamline their integration into various industrial applications and highlight the role of convolutional neural networks in future chemometric methodologies.

Tropical cyclone intensity estimation through convolutional neural network transfer learning using two geostationary satellite datasets

Accurate prediction and monitoring of tropical cyclone (TC) intensity are crucial for saving lives, mitigating damages, and improving disaster response measures. In this study, we used a convolutional neural network (CNN) model to estimate TC intensity in the western North Pacific using Geo-KOMPSAT-2A (GK2A) satellite data. Given that the GK2A data cover only the period since 2019, we applied transfer learning to the model using information learned from previous Communication, Ocean, and Meteorological Satellite (COMS) data, which cover a considerably longer period (2011–2019). Transfer learning is a powerful technique that can improve the performance of a model even if the target task is based on a small amount of data. Experiments with various transfer learning methods using the GK2A and COMS data showed that the frozen–fine-tuning method had the best performance due to the high similarity between the two datasets. The test results for 2021 showed that employing transfer learning led to a 20% reduction in the root mean square error (RMSE) compared to models using only GK2A data. For the operational model, which additionally used TC images and intensities from 6 h earlier, transfer learning reduced the RMSE by 5.5%. These results suggest that transfer learning may represent a new breakthrough in geostationary satellite image–based TC intensity estimation, for which continuous long-term data are not always available.

Research on micro/nano scale 3D reconstruction based on scanning electron microscope

Scanning electron microscopy (SEM) has an important application in the petroleum field, which is often used to analyze the microstructure of reservoir rocks, etc. Most of these analyses are based on two-dimensional images. In fact, SEM can carry out micro-nano scale three-dimensional measurement, and three-dimensional models can provide more accurate information than two-dimensional images. Among the commonly used SEM 3D reconstruction methods, parallax depth mapping is the most commonly used method. Multiple SEM images can be obtained by continuously tilting the sample table at a certain Angle, and multiple point clouds can be generated according to the parallax depth mapping method, and a more complete point clouds recovery can be achieved by combining the point clouds registration. However, the root mean square error of the point clouds generated by this method is relatively large and unstable after participating in point clouds registration. Therefore, this paper proposes a new method for generating point clouds. Firstly, the sample stage is rotated by a certain angle to obtain two SEM images. This operation makes the rotation matrix a known quantity. Then, based on the imaging model, an equation system is constructed to estimate the unknown translation parameters, and finally, triangulation is used to obtain the point clouds. The method proposed in this paper was tested on a publicly available 3D SEM image set, and the results showed that compared to the disparity depth mapping method, the point clouds generated by our method showed a significant reduction in root mean square error and relative rotation error in point clouds registration.

Improved estimation of extreme floods with data pooling and mixed probability distribution

The accurate estimation of flood probability is crucial for designing water storage and flood retention structures. However, the assumption of identical distribution in flood samples is unrealistic, given the influence of various flood mechanisms. To address this challenge, we proposed a novel framework based on flood clustering and data pooling that encompasses the key steps such as 1) flood event separation based on a peak-detection flood separation algorithm, 2) grouping flood events using the k-prototypes algorithm, 3) application of the UNprecedented Simulated Extreme ENsemble (UNSEEN) approach to pool reforecast ensemble datasets, and 4) statistical mixing approach to derive common quantiles from all the flood groups. We applied the framework to the Dresden gauge in the Elbe River for a detailed case study. Various tests have been performed to assess the applicability of the UNSEEN approach and the reforecast dataset consistently shows the potential for data pooling. The proposed methodology outperformed the classical approach in terms of goodness-of-fit. The relative difference between the classical and the proposed approach ((classical-proposed)/proposed) for the 100-year return level is 0.16, with a reduction in root mean square error (RMSE) value from 163 to 98 m3/s. Further, replication of the approach to the gauges in North Germany exhibited a relative difference ranging from −0.3 to +0.15 and produced better estimates in terms of RMSE compared with the traditional model. In summary, the proposed framework offers a better estimation of flood probability by addressing the inherent sample inhomogeneity along with the inclusion of unprecedented flood samples.

Vessel turnaround time prediction: A machine learning approach

Uncertainty in vessel turnaround time (VTT) is troublesome and would reduce the operational efficiency in port management, potentially causing economic losses. Despite vessels generally providing their estimated departure time (EDT), there is frequently a considerable difference between the EDT and the actual departure time (ADT) of vessels due to various factors such as unexpected port handling inefficiency. This variability complicates the coordination of efficient port operations. Our research aims to address this issue by employing an extreme gradient boosting (XGBoost) regression model to predict the VTT, using vessel arrival and departure data at the Hong Kong Port for the year 2022 and the first quarter of 2023. The proposed machine learning approach can provide more accurate predictions on VTT on average compared to the EDT data reported by vessels themselves, with a substantial reduction in both mean absolute error (MAE) and root mean square error (RMSE) of 23% (from 5.1 h to 3.9 h) and 24% (from 8.0 h to 6.1 h), respectively. These results present a significant leap forward in the predictive capabilities for the VTT and lay the foundation for further research into improving vessel scheduling efficiency, reducing port congestion and enhancing overall port performance.

A Deep Neural Network for Predicting Synergistic Drug Combinations on Cancer.

The exploration of drug combinations presents an opportunity to amplify therapeutic effectiveness while alleviating undesirable side effects. Nevertheless, the extensive array of potential combinations poses challenges in terms of cost and time constraints for experimental screening. Thus, it is crucial to narrow down the search space. Deep learning approaches have gained widespread popularity in predicting synergistic drug combinations tailored for specific cell lines in vitro settings. In the present study, we introduce a novel method termed GTextSyn, which utilizes the integration of gene expression data and chemical structure information for the prediction of synergistic effects in drug combinations. GTextSyn employs a sentence classification model within the domain of Natural Language Processing (NLP), wherein drugs and cell lines are regarded as entities possessing biochemical relevance. Meanwhile, combinations of drug pairs and cell lines are construed as sentences with biochemical relational significance. To assess the efficacy of GTextSyn, we conduct a comparative analysis with alternative deep learning approaches using a standard benchmark dataset. The results from a five-fold cross-validation demonstrate a 49.5% reduction in Mean Square Error (MSE) achieved by GTextSyn, surpassing the performance of the next best method in the regression task. Furthermore, we conduct a comprehensive literature survey on the predicted novel drug combinations and find substantial support from prior experimental studies for many of the combinations identified by GTextSyn.

A Reconstructing Model Based on Time–Space–Depth Partitioning for Global Ocean Dissolved Oxygen Concentration

Dissolved oxygen (DO) is essential for assessing and monitoring the health of marine ecosystems. The phenomenon of ocean deoxygenation is widely recognized. Nevertheless, the limited availability of observations poses a challenge in achieving a comprehensive understanding of global ocean DO dynamics and trends. The study addresses the challenge of unevenly distributed Argo DO data by developing time–space–depth machine learning (TSD-ML), a novel machine learning-based model designed to enhance reconstruction accuracy in data-sparse regions. TSD-ML partitions Argo data into segments based on time, depth, and spatial dimensions, and conducts model training for each segment. This research contrasts the effectiveness of partitioned and non-partitioned modeling approaches using three distinct ML regression methods. The results reveal that TSD-ML significantly enhances reconstruction accuracy in areas with uneven DO data distribution, achieving a 30% reduction in root mean square error (RMSE) and a 20% decrease in mean absolute error (MAE). In addition, a comparison with WOA18 and GLODAPv2 ship survey data confirms the high accuracy of the reconstructions. Analysis of the reconstructed global ocean DO trends over the past two decades indicates an alarming expansion of anoxic zones.

Urban wind field prediction based on sparse sensors and physics‐informed graph‐assisted auto‐encoder

AbstractThe urban flow wind field is a critical element for downstream research, such as mitigation of urban wind disasters, assessment of urban wind environment, and urban drone route planning. However, it is impractical to arrange a large number of sensors to monitor an urban wind flow field. Hence, acquiring the entire urban wind flow field via sparse sensors would be highly valuable. To date, no scheme including deep learning (DL) model has been specifically designed for this purpose. This study presents an innovative approach to reconstruct complex high‐resolution urban wind fields based on sparse sensors, using a physics‐informed graph neural network (GNN)‐assisted auto‐encoder. The proposed method leverages the relationship between sensors and their surrounding environment enabled by deep mining capabilities of GNNs. As a result, the utilization and emphasis on sparse sensors data are significantly enhanced. The continuity equation of fluid flow is incorporated into the loss function of the convolution neural network to improve the stability and performance of the model. The findings suggest that, in contrast to prevalent generative DL models, the proposed model yields an approximate 50% reduction in root mean square error for reconstructing high‐resolution urban wind fields for multiple wind attack angles.

Enhancing K-Nearest Neighbors Algorithm in Wireless Sensor Networks through Stochastic Fractal Search and Particle Swarm Optimization

The utilization of wireless sensor networks (WSNs) holds significant importance in diverse data collection applications. Efficient operation of computers, especially in predictive tasks, is imperative for obtaining accurate results within WSNs. This research introduces an innovative approach employing Stochastic Fractal Search-Particle Swarm Optimization (SFS-PSO) to enhance the performance of the K-Nearest Neighbors (KNN) algorithm. The proposed methodology initiates with the establishment of a particle population, dynamically adjusting their positions and velocities and integrating a diffusion process. Through an iterative process of incremental adjustments and evaluations, the algorithm fine-tunes its parameters, resulting in a refined KNN regression model. The enhanced model exhibits substantial improvements, as indicated by the notable reduction in root mean square error (RMSE) and mean absolute error (MAE), accompanied by a strengthened correlation between variables. The favorable outcomes underscore the efficacy of the SFS-PSO optimization technique in augmenting the KNN algorithm's performance within wireless sensor networks. In simpler terms, the application of SFS-PSO in conjunction with KNN leads to a significant decrease in RMSE, reaching a value as low as 0.00894, demonstrating the notable effectiveness of this optimization approach in refining the predictive capabilities of the KNN algorithm in the context of WSNs.

Prediction of the drainage coefficient of steeply crested inclined weirs using different neural network techniques

The main objective of this work is to accurately predict in irrigation and hydraulic systems the discharge coefficient of the used sharp-crested inclined dams. Training algorithms on radial basis function RBF and multilayer perceptron MLP, and input variables such as weir height, length, inclination, and flow rates. From a tilted weir, researchers have used these training techniques as a model for various neural networks. In addition, the performance of CFNN is better than other neural networks such as RBF and MLP. The discharge coefficient Cd was the output variable. 95 test results were analysed. CFNN achieved a significant reduction in mean square errors (MSE), with values of 9.4363×10-12 and 1.6336×10-05, respectively, in the training and testing phases.

Residual-aware deep attention graph convolutional network via unveiling data latent interactions for product quality prediction in industrial processes

Data-driven modeling based on deep learning is crucial for online product quality prediction in industrial processes. Extracting latent data interactions from sensor variables lies at the core of various data-driven modeling applications. Typically, the observed variables exhibit non-stationary properties due to changes in operating conditions and sensor tuning issues. These fluctuations inevitably affect the reliability of traditional feature extraction methods, thus hindering their applications. Hence, this paper proposes a novel method named residual-aware deep attention graph convolutional network (RaDA-GCN) to explore potential interactions among sensor variables. RaDA-GCN ingeniously incorporates an attention mechanism into the graph convolution layer to extract nonlinear variable-related features according to their importance. Then, a novel residual-aware connection module is designed to reduce data uncertainty and alleviate over-smoothing. By skillfully stacking multiple attention map convolutional layers with the integration of residual-aware connections, deep structural features are obtained to facilitate the effective quantification and revelation of potential relationships among data variables. Finally, the application of the predictive modeling framework based on the proposed method is used to validate its effectiveness in actual industrial process data. The experimental results demonstrate that the proposed RaDA-GCN method exhibits a 23% improvement in the R-squared (R2) indicator and a 13% reduction in the root mean square error (RMSE) compared to the traditional graph convolutional network method.