Deep Learning Forecasts of Soil Moisture: Convolutional Neural Network and Gated Recurrent Unit Models Coupled with Satellite-Derived MODIS, Observations and Synoptic-Scale Climate Index Data

For a drought-prone agricultural nation such as Australia, hydro-meteorological imbalances and increasing demand for water resources are immensely constraining terrestrial water reservoirs and regional-scale agricultural productivity. Two important components of the terrestrial water reservoir i.e., streamflow water level (SWL) and soil moisture (SM), are imperative both for agricultural and hydrological applications. Forecasted SWL and SM can enable prudent and sustainable decisionmaking for agriculture and water resources management. To feasibly emulate SWL and SM, machine learning data-intelligent models are a promising tool in today’s rapidly advancing data science era. Yet, the naturally chaotic characteristics of hydro-meteorological variables that can exhibit non-linearity and non-stationarity behaviors within the model dataset, is a key challenge for non-tuned machine learning models. Another important issue that could confound model accuracy or applicability is the selection of relevant features to emulate SWL and SM since the use of too fewer inputs can lead to insufficient information to construct an accurate model while the use of an excessive number and redundant model inputs could obscure the performance of the simulation algorithm. This research thesis focusses on the development of hybridized dataintelligent models in forecasting SWL and SM in the upper layer (surface to 0.2 m) and the lower layer (0.2–1.5 m depth) within the agricultural region of the Murray-Darling Basin, Australia. The SWL quantifies the availability of surface water resources, while, the upper layer SM (or the surface SM) is important for surface runoff, evaporation, and energy exchange at the Earth-Atmospheric interface. The lower layer (or the root zone) SM is essential for groundwater recharge purposes, plant uptake and transpiration. This research study is constructed upon four primary objectives designed for the forecasting of SWL and SM with subsequent robust evaluations by means of statistical metrics, in tandem with the diagnostic plots of observed and modeled datasets. The first objective establishes the importance of feature selection (or optimization) in the forecasting of monthly SWL at three study sites within the Murray-Darling Basin. Artificial neural network (ANN) model optimized with iterative input selection (IIS) algorithm named IIS-ANN is developed whereby the IIS algorithm achieves feature optimization. The IIS-ANN model outperforms the standalone models and a further hybridization is performed by integrating a nondecimated and advanced maximum overlap discrete wavelet transformation (MODWT) technique. The IIS selected inputs are transformed into wavelet subseries via MODWT to unveil the embedded features leading to IIS-W-ANN model. The IIS-W-ANN outperforms the comparative IIS-W-M5 Model Tree, IIS-based and standalone models. In the second objective, improved self-adaptive multi-resolution analysis (MRA) techniques, ensemble empirical mode decomposition (EEMD) and complete ensemble empirical mode decomposition with adaptive noise (CEEMDAN) are utilized to address the non-stationarity issues in forecasting monthly upper and lower layer soil moisture at seven sites. The SM time-series are decomposed using EEMD/CEEMDAN into respective intrinsic mode functions (IMFs) and residual components. Then the partial-auto correlation function based significant lags are utilized as inputs to the extreme learning machine (ELM) and random forest (RF) models. The hybrid EEMD-ELM yielded better results in comparison to the CEEMDAN-ELM, EEMD-RF, CEEMDAN-RF and the classical ELM and RF models. Since SM is contingent upon many influential meteorological, hydrological and atmospheric parameters, for the third objective sixty predictor inputs are collated in forecasting upper and lower layer soil moisture at four sites. An ANN-based ensemble committee of models (ANN-CoM) is developed integrating a two-phase feature optimization via Neighborhood Component Analysis based feature selection algorithm for regression (fsrnca) and a basic ELM. The ANN-CoM shows better predictive performance in comparison to the standalone second order Volterra, M5 Model Tree, RF, and ELM models. In the fourth objective, a new multivariate sequential EEMD based modelling is developed. The establishment of multivariate sequential EEMD is an advancement of the classical single input EEMD approach, achieving a further methodological improvement. This multivariate approach is developed to allow for the utilization of multiple inputs in forecasting SM. The multivariate sequential EEMD optimized with cross-correlation function and Boruta feature selection algorithm is integrated with the ELM model in emulating weekly SM at four sites. The resulting hybrid multivariate sequential EEMD-Boruta-ELM attained a better performance in comparison with the multivariate adaptive regression splines (MARS) counterpart (EEMD-Boruta-MARS) and standalone ELM and MARS models. The research study ascertains the applicability of feature selection algorithms integrated with appropriate MRA for improved hydrological forecasting. Forecasting at shorter and near-real-time horizons (i.e., weekly) would help reinforce scientific tenets in designing knowledge-based systems for precision agriculture and climate change adaptation policy formulations.

Soil moisture forecasting by a hybrid machine learning technique: ELM integrated with ensemble empirical mode decomposition

In this study, different kinds of hybrid Complete Ensemble Empirical Mode Decomposition with Adaptive Noise (CEEMDAN) algorithms with forecasting models including Random Forest (RF), Gated Recurrent Unit (GRU), and Long Short-Term Memory (LSTM) neural networks, are developed to estimate the mean daily wind speed at the height of 2 m in Ağrı city (WS st12 ), Turkey. In these hybrid models, different layer networks of single and integrated LSTM and GRU models include general single LSTM, general single GRU, simple coupled LSTM-GRU, and novel coupled LSTM with GRU through Addition layer (i.e., LSTM + GRU model) structures are applied. The most effective parameters on the WS st12 , from a list of on-site potential meteorological parameters and wind speed values in its adjacent cities of Ağrı province from Jan 2015–Dec 2019 through the Pearson correlation coefficient method, are determined. In the hybrid CEEMDAN and DNNs-based models, State activation functions (SAF), numbers of hidden neurons (NHN), dropout rates (P-rate), and network structural architect (NSA) as the meta-parameters are tuned for lessening the impact of overfitting/underfitting dilemmas and improving modeling performance. According to the comparison plots, performance evaluation measures, and total learnable parameter (TLP), the novel developed hybrid CEEMDAN-RF-(LSTM + GRU) model is confirmed as the best approach with an R 2 of 0.86 while, in the optimal scenario using the RF model, R 2 was 0.47. Graphical Abstract Based on the graphical snapshot, this study focuses on estimating daily mean wind speed at a 2-meter height in Ağrı, Turkey, using hybrid data-driven models. The research integrates the Complete Ensemble Empirical Mode Decomposition with Adaptive Noise (CEEMDAN) algorithm with advanced forecasting techniques, including Random Forest (RF), Long Short-Term Memory (LSTM), and Gated Recurrent Unit (GRU) neural networks. The modeling framework explores various configurations, such as standalone LSTM and GRU, coupled LSTM-GRU structures, and a novel LSTM + GRU model using an Addition layer to enhance predictive accuracy.

Soil moisture prediction based on integrating the CEEMDAN decomposition technique with LSTM in the proximity of Prosopis Juliflora

To improve the forecasting accuracy of traffic flow, this paper proposes a traffic flow forecasting algorithm based on Principal Component Analysis (PCA) and Complete Ensemble Empirical Mode Decomposition with Adaptive Noise (CEEMDAN) for data processing. The Grey Wolf Optimizer (GWO) algorithm is used to optimize the weights of a combined model called the GWO-PC-CGLX model, which consists of the Convolutional Neural Network (CNN), Gated Recurrent Unit (GRU), Long Short-Term Memory (LSTM), and Extreme Gradient Boosting (XGBoost). Initially, PCA and CEEMDAN are used to reduce the dimensionality and noise in the air quality index (AQI) data and traffic flow data. The smoothed data are then input into the CNN, GRU, LSTM, and XGboost models for forecasting. To improve the forecasting accuracy, the GWO algorithm is used to find the optimal weight combination of the four single models. Taking the data from Jiayuguan and Lanzhou in Gansu Province as an example, compared with the actual data, the values of the evaluation indicator R2 (Coefficient of Determination) reached 0.9452 and 0.9769, respectively, which are superior to those of the comparison models. The research results not only improve the accuracy of traffic flow forecasting but also provide effective support for the construction of intelligent transportation systems and sustainable traffic management.

Accurate and timely forecasting is critical for grid-connected solar power safety and stability, achieved through machine learning (ML) for both common and real-time applications. To mitigate the impact of nonstationarity and volatility in solar power generation, we employed empirical mode decomposition (EMD), ensemble empirical mode decomposition (EEMD), variational mode decomposition (VMD), and complete EEMD with adaptive noise (CEEMDAN) to decompose time series into frequency components, reducing fluctuations and noise. A combination of four decomposition methods (EMD, EEMD, VMD, and CEEMDAN) and two ML models, bidirectional gated recurrent unit (BiGRU) and bidirectional long short-term memory (BiLSTM) were utilized to construct six hybrid forecasting models (EMD-BiLSTM, EMD-BiGRU, EEMD-BiLSTM, EEMD-BiGRU, VMD-BiGRU, and CEEMDAN-BiGRU), which were validated on a dataset from a 20 MW solar power station in Hebei, compared to the seven standalone ML models, backpropagation neural networks (BPNN), support vector machines (SVM), long short-term memory (LSTM), gated recurrent unit (GRU), convolutional neural networks (CNN), BiLSTM, and BiGRU, these six hybrid models demonstrated enhanced forecast accuracy. Of these, EEMD-BiGRU, VMD-BiGRU, and CEEMDAN-BiGRU significantly reduced prediction errors, with percentage reductions in root mean square error (RMSE), mean absolute error (MAE), and mean absolute percentage error (MAPE) ranging from 44.18 ~ 49.43%, 43.67 ~ 48.59%, and 44.64% ~53.53%, respectively. The EEMD-BiGRU model outperformed all hybrid models, achieving an RMSE of 0.7662, MAE of 0.3990, MAPE of 7.982%, and R2 of 0.9865. The findings of this study can provide insights and support for applying a hybrid model based on decomposition methods for the short-term forecasting of solar power generation.

Accurate prediction of network traffic trends is important for self-management, intelligent scheduling and network resource optimization of base stations. Network traffic prediction is a prerequisite for intelligent scheduling of base stations, and accurate prediction will be beneficial for improving network utilization and energy saving in scheduling. In this paper, a hybrid deep learning method for network traffic prediction, CEEMDAN-TGA which consists of Complete Ensemble Empirical Mode Decomposition with Adaptive Noise (CEEMDAN), Temporal Convolutional Network (TCN), Gated Recurrent Unit (GRU), and Attention Mechanism is proposed. Firstly, CEEMDAN is introduced to decompose the original network traffic data into different modes, then reconstruct the modes into trend sequence and noise sequence. Secondly, TCN is used to extract the short-term local features in the network traffic, GRU is used to obtain the long-term data-dependent features, and the attention mechanism is used to improve the prediction accuracy and stability. Finally, through the comparison of experiments, the prediction effect and accuracy of the proposed method are verified to have significant advantages, and the network traffic scheduling strategy is proposed on the basis of prediction.

The performance of tissue imaging is improved by tissue harmonic imaging (THI) to expand and enhance the range and level of clinical diagnosis for many diseases. The separation based on High-pass filtering (S_HPF) is a commonly used method for extracting harmonic components from ultrasonic echo signals. However, the cut-off frequency, order and algorithm to realize a high-pass filter have a great influence on the separation accuracy of harmonic signals. In present study, a novel separation method (S_CEEMDAN) based on the complete ensemble empirical mode decomposition with adaptive noise (CEEMDAN) algorithm is proposed for adaptively separating harmonic components from ultrasonic echo signals. First, we calculate the ensemble size of CEEMDAN adaptively based on the added noise level, and draw a sum of intrinsic mode functions (IMFs) from the ultrasonic echo signals by CEEMDAN. Then, the spectrum of each IMF is computed and evaluated, and the IMFs containing both fundamental and harmonic components are further decomposed by using the CEEMDAN algorithm. This separation process is end until all of IMFs have been divided into either fundamental or harmonic categories. Finally, the corresponding fundamental and harmonic echo signals are yielded by accumulating separately these two categories. In experiments, simulated ultrasonic echo signals with a center frequency of 3.5MHz are separated by the proposed S_CEEMDAN method, and the results are compared with those processed by S_HPF. The edge of the harmonic image by S_CEEMDAN marginally better defined than S_HPF. The indices for the harmonic signals separated by S_CEEMDAN and S_HPF, respectively, are as follows: the center frequencies of 6.66 MHz and 6.65 MHz, 3 dB bandwidths of 1.04 MHz and 1.05 MHz, 6 dB bandwidths of 1.59 MHz and 1.55 MHz, signal-to-noise ratios (SNRs) of 14.00 and 13.63, and image contrasts of 7.01 and 7.06. In conclusion, due to good adaptive characteristics, and lower reconstruction errors, the proposed S_CEEMD method is superior to S_HPF in the performance of spectral accuracy and harmonic imaging. This method could be potentially alternative to the current method for the ultrasonic harmonic separation.

Complete ensemble empirical mode decomposition with adaptive noise (CEEMDAN) effectively separates the fault vibration signals of rolling bearings and improves the diagnosis of rolling bearing faults. However, CEEMDAN has high memory requirements and low computational efficiency. In each iteration of CEEMDAN, fault vibration signals are added with noises, both the vibration signals added with noises and the added noises are decomposed with classical empirical mode decomposition (EMD). This paper proposes a rolling bearing fault diagnosis method that combines piecewise aggregate approximation (PAA) with CEEMDAN. PAA enables CEEMDAN to decompose long signals and to achieve enhanced diagnosis. In particular, the method first yields the vibration envelope using bandpass filtering and demodulation, then compresses the envelope using PAA, and finally decomposes the compressed signal with CEEMDAN. Test data verification results show that the proposed method is more effective and more efficient than CEEMDAN.

Accurate power load forecasting plays an important role in smart grid analysis. To improve the accuracy of forecasting through the three-level “decomposition–optimization–prediction” innovation, this study proposes a prediction model that integrates complete ensemble empirical mode decomposition with adaptive noise (CEEMDAN), the improved sparrow search algorithm (ISSA), a convolutional neural network (CNN), and bidirectional long short-term memory (BiLSTM). A series of simpler intrinsic mode functions (IMFs) with different frequency characteristics can be decomposed by CEEMDAN from data, then each IMF is reconstructed based on calculating the sample entropy of each IMF. The ISSA introduces three significant enhancements over the standard sparrow search algorithm (SSA), including that the initial distribution of the population is determined by the optimal point set, the position of the discoverer is updated by the golden sine strategy, and the random walk of the population is enhanced by the Lévy flight strategy. By the optimization of the ISSA to the parameters of the CNN-BiLSTM model, integrating the prediction results of the reconstructed IMFs in the sub-models can obtain the final prediction result of the data. Through the performance indexes of the designed prediction model, the application case results show that the proposed combined prediction model has a smaller prediction error and higher prediction accuracy than the eight comparison models.

Offshore platform pipeline leakage detection faces severe challenges from complex marine environments, where intense environmental noise interference and complex signal characteristics make traditional methods difficult to achieve accurate leakage valve localization. To address this technical challenge, this study proposes an offshore platform pipeline leakage valve localization method based on dynamic time warping distance-based complete ensemble empirical mode decomposition with adaptive noise (DCEEMDAN) and adaptive temporal–spatial fusion network (ATSFN). First, by introducing dynamic time warping distance similarity measurement into the complete ensemble empirical mode decomposition with adaptive noise (CEEMDAN) framework and combining probability density function feature extraction, adaptive denoising of acoustic emission signals in marine environments is achieved. Second, a temporal–spatial feature extraction architecture with a parallel multiscale convolutional neural network (CNN) and a hierarchical GRU is designed, realizing deep fusion of CNN spatial features and GRU temporal features through a cross-attention mechanism. Finally, an end-to-end intelligent monitoring system is constructed, achieving high-precision localization of 10 valve positions through dual-stage verification combining laboratory experiments and offshore platform field measurements. Experimental results show that DCEEMDAN outperforms traditional EMD series algorithms, achieving a signal-to-noise ratio (SNR) of 19.69 dB with 16.6% improvement over CEEMDAN. ATSFN achieves average localization accuracies of 94.38% and 95.75% under 4 MPa and 5 MPa conditions, respectively, representing improvements of 10.9% and 10.77% over best baseline models. Under extreme noise conditions, the model maintains localization accuracy above 82.3%, demonstrating excellent noise robustness. This research provides an effective technical solution for offshore platform pipeline leakage detection.

Sea level rise is an important and topical issue in the South Pacific region and needs an urgent assessment of trends for informed decision making. This paper presents mean sea level trend assessment using harmonic analysis and a hybrid deep learning (DL) model based on the Complete Ensemble Empirical Mode Decomposition with Adaptive Noise (CEEMDAN) technique, Convolutional Neural Network (CNN), Gated Recurrent Unit (GRU) and Neighbourhood Component Analysis (NCA) to build a highly accurate sea level forecasting model for three small islands (Fiji, Marshall Island and Papua New Guinea (PNG)) in the South Pacific. For a 20-year period, the estimated mean sea level rise per year from the harmonic computation is obtained: 112 mm for PNG, 98 mm for Marshall Island and 52 mm for Fiji. The DL procedure uses climate and environment-based remote sensing satellite (MODIS, GLDAS-2.0, MODIS TERRA, MERRA-2) predictor variables with tide gauge base mean sea level (MSL) data for model training and development for forecasting. The developed CEEMDAN-CNN-GRU as the objective model is benchmarked by comparison to the hybrid model without data decomposition, CNN-GRU and standalone models, Decision Trees (DT) and Support Vector Regression (SVR). All model performances are evaluated using reliable statistical metrics. The CEEMDAN-CNN-GRU shows superior accuracy when compared with other standalone and hybrid models. It shows an accuracy of >96% for correlation coefficient and an error of <1% for all study sites.

An accurate and efficient forecasting of solar energy is necessary for managing the electricity generation and distribution in today’s electricity supply system. However, due to its random character in its time series, accurate forecasting of solar irradiation is a difficult task; but it is important for grid management, scheduling and its balancing. To fully utilize the solar energy in order to balance the generation and consumption, this paper proposed an ensemble approach using CEEMDAN-BiLSTM combination to forecast short term solar irradiation. In this, Complete Ensemble Empirical Mode Decomposition with adaptive noise (CEEMDAN) extract the inherent characteristics of time series data by decomposing it into low and high frequency Intrinsic Mode Functions (IMF’s) and Bidirectional Long Short Term Memory (BiLSTM) used as a forecasting tool to forecast the solar Global Horizontal Irradiance (GHI). Furthermore, using extensive experimental analysis, the research minimizes the number of IMF’s by integrating the CEEMDAN decomposed component (IMF1–IMF14) in order to increase the prediction accuracy. Then, for each IMF subseries, the trained standalone BiLSTM network are assigned to carry out the forecasting. In last stage, the forecasted results of each BiLSTM network are aggregate to compile final results. Two year data (2012–13) of Delhi, India from National Solar Radiation Database (NSRDB) has been used for training while one year data (2014) used for testing purpose for the same location. The proposed model performance is measured in terms of root mean square error (RMSE), mean absolute percentage error (MAPE), Correlation coefficient (R22) and forecast skill (FS). For the comparative analysis of proposed model, several others models: persistence model, unidirectional deep learning models: long short term memory (LSTM), gated recurrent unit (GRU), BiLSTM and two CEEMDAN based BiLSTM models are developed. The proposed model achieved lowest annual average RMSE (18.86 W/m22, 22.24 W/m22, 26.25 W/m22) and MAPE (2.19%, 4.81%, 6.77%) among the other developed models for 1-hr, 2-hr and 3-hr ahead solar GHI forecasting respectively. The maximum correlation coefficient (R22) obtained by the proposed model is 96.4 for 1-hr ahead respectively; on the other hand, forecast skill (%) of 89% with reference to benchmark model. Various test such as: Diebold Mariano Hypothesis test (DMH) and directional change in forecasting (DC) are used to analyze the sensitivity with reference to the difference in forecasted and observed value.

Development of MCS based-ensemble models using CEEMDAN decomposition and machine intelligence

The cutting sound signal of a coal mining shearer is an important signal source for identifying the coal–rock cutting mode and load state. However, the coal–rock cutting sound signal directly collected from the industrial field always contains a large amount of background noise, which is not conducive to the subsequent feature extraction and recognition. Therefore, efficient noise elimination for the original signal is required. An intelligent processing method based on an improved complete ensemble empirical mode decomposition with adaptive noise (CEEMDAN) denoising algorithm is constructed for the cutting sound signal in this paper. CEEMDAN first decomposes the sound to generate a series of intrinsic modal functions (IMFs). Because the denoising threshold of each IMF is usually obtained by an experimental test or an empirical formula in the traditional CEEMDAN method, obtaining an optimal threshold set for each IMF is difficult. The processing effect is often restricted. To overcome this problem, the fruit fly optimization algorithm (FOA) was introduced for CEEMDAN threshold determination. Moreover, in the basic FOA, the scouting bee mutation operation and adaptive dynamic adjustment search strategy are applied to maintain the convergence speed and global search ability. The simulation result shows that the signal waveform processed by the improved CEEMDAN denoising algorithm is smoother than the other four typical eliminate noise signal algorithms. The output signal’s signal-to-noise ratio and mean square error are significantly improved. Finally, an industrial application of a shearer in a coal mining working face is performed to demonstrate the practical effect.