Efficient Algorithm Research Articles

Comparative study of ten machine learning algorithms for short-term forecasting in gas warning systems

This research aims to explore more efficient machine learning (ML) algorithms with better performance for short-term forecasting. Up-to-date literature shows a lack of research on selecting practical ML algorithms for short-term forecasting in real-time industrial applications. This research uses a quantitative and qualitative mixed method combining two rounds of literature reviews, a case study, and a comparative analysis. Ten widely used ML algorithms are selected to conduct a comparative study of gas warning systems in a case study mine. We propose a new assessment visualization tool: a 2D space-based quadrant diagram can be used to visually map prediction error assessment and predictive performance assessment for tested algorithms. Overall, this visualization tool indicates that LR, RF, and SVM are more efficient ML algorithms with overall prediction performance for short-term forecasting. This research indicates ten tested algorithms can be visually mapped onto optimal (LR, RF, and SVM), efficient (ARIMA), suboptimal (BP-SOG, KNN, and Perceptron), and inefficient algorithms (RNN, BP_Resilient, and LSTM). The case study finds results that differ from previous studies regarding the ML efficiency of ARIMA, KNN, LR, LSTM, and SVM. This study finds different views on the prediction performance of a few paired algorithms compared with previous studies, including RF and LR, SVM and RF, KNN and ARIMA, KNN and SVM, RNN and ARIMA, and LSTM and SVM. This study also suggests that ARIMA, KNN, LR, and LSTM should be investigated further with additional prediction error assessments. Overall, no single algorithm can fit all applications. This study raises 20 valuable questions for further research.

The Robust Supervised Learning Framework: Harmonious Integration of Twin Extreme Learning Machine, Squared Fractional Loss, Capped L2,p-norm Metric, and Fisher Regularization

As a novel learning algorithm for feedforward neural networks, the twin extreme learning machine (TELM) boasts advantages such as simple structure, few parameters, low complexity, and excellent generalization performance. However, it employs the squared L2-norm metric and an unbounded hinge loss function, which tends to overstate the influence of outliers and subsequently diminishes the robustness of the model. To address this issue, scholars have proposed the bounded capped L2,p-norm metric, which can be flexibly adjusted by varying the p value to adapt to different data and reduce the impact of noise. Therefore, we substitute the metric in the TELM with the capped L2,p-norm metric in this paper. Furthermore, we propose a bounded, smooth, symmetric, and noise-insensitive squared fractional loss (SF-loss) function to replace the hinge loss function in the TELM. Additionally, the TELM neglects statistical information in the data; thus, we incorporate the Fisher regularization term into our model to fully exploit the statistical characteristics of the data. Drawing upon these merits, a squared fractional loss-based robust supervised twin extreme learning machine (SF-RSTELM) model is proposed by integrating the capped L2,p-norm metric, SF-loss, and Fisher regularization term. The model shows significant effectiveness in decreasing the impacts of noise and outliers. However, the proposed model’s non-convexity poses a formidable challenge in the realm of optimization. We use an efficient iterative algorithm to solve it based on the concave-convex procedure (CCCP) algorithm and demonstrate the convergence of the proposed algorithm. Finally, to verify the algorithm’s effectiveness, we conduct experiments on artificial datasets, UCI datasets, image datasets, and NDC large datasets. The experimental results show that our model is able to achieve higher ACC and F1 scores across most datasets, with improvements ranging from 0.28% to 4.5% compared to other state-of-the-art algorithms.

Multimodel regional frequency analysis of CMIP extreme precipitation

Abstract A recurrent question in climate risk analysis is determining how climate change will affect
heavy precipitation patterns.
Dividing the globe into homogeneous sub-regions should improve the modeling of heavy precipitation by inferring common regional distributional parameters.
In addition, biases due to model errors in global climate models (GCMs) should be considered to understand the climate response to diffrent forcing effects.
Within this context, we propose an efficient clustering algorithm that, compared to classical regional frequency analysis (RFA) techniques, is covariate-free and accounts for dependence.
It is based on a new non-parametric dissimilarity that combines both the RFA constraint and the pairwise dependence.
We derive asymptotic properties of our dissimilarity estimator, and we interpret it for generalized extreme value distributed pairs.

As an application, we cluster annual daily precipitation maxima of 16 GCMs from the coupled model intercomparison project.
We combine the climatologically consistent subregions identified for all GCMs.
This improves the spatial clusters coherence and outperforms methods either based on margins or on dependence.
Finally, by comparing the natural forcings partition with the one with all forcings, we assess the impact of anthropogenic forcing on precipitation extreme patterns.

Synthesis of Marine (-)-Pelorol and Future Perspectives

Meroterpenoid-type marine natural compounds have attracted an increasing amount of attention due to their peculiar chemical structures and their potential for the development of therapeutically important probes. Within this group of substances pelorol stands out; it is a natural compound isolated from marine organisms with a unique structure and an interesting biological profile. In this article, we summarize and highlight the most interesting aspects of the synthetic procedures towards this compound, which have two common key steps. The first is the coupling of a drimanyl derivative with a compound derived from an arene. The second is a Friedel–Crafts cyclization which forms the C ring of the natural product. Despite the synthetic advances achieved so far, we consider that a more efficient synthetic procedures could be carried out, since their synthetic routes are difficult to scale up due to numerous reaction steps and the limitations imposed by the use of some reagents. In this article, we present a new and versatile retrosynthetic analysis of (-)-pelorol and analogs, which is highly desirable for their easy preparation and subsequent broad study of their biological activities. This is a retrosynthetic route that could improve those reported in the literature in terms of cost-effectiveness.

A Thermal Model for a Hybrid Gas Bearing System in Oil-Free Turbochargers

Abstract With little drag friction, gas bearings operate at high rotor speed and high temperature and thus enable long operating life along with material damping for mechanical energy dissipation. However, most computational tools for modeling gas bearings are not accessible to bearing manufacturers or potential end-users, and the models are restricted to specific geometries and operating conditions or are missing important features, thus limiting their utility. This paper presents the thermal energy transport in a hybrid gas bearing for oil-free turbochargers with integrated heat and fluid flow models to produce a comprehensive thermo-hydrodynamic analysis predictive tool, and to design and evaluate air-lubricated gas bearings by predictions and experiments. An efficient algorithm couples the solution of the Reynolds equations and the thermal energy transport equations in the film between the rotor and a pad of the hybrid gas bearing, and updates the temperature-dependent viscosity and film thicknesses during the iterative process. The test repeats and averaged for each rotor speed from 2 krpm to 22 krpm at intervals of 2 krpm, for supply pressure varying along 25 psi to 100 psi and predicted film temperature matches well with the measured one. The parameters of interest in this analysis include the gas supply condition, bearing configuration, and the gas properties at high altitudes and high rotation speeds. The parametric study results show the density and kinematic viscosity are the most dominant properties of the gas lubrication for the film temperature.

Failure Probability-Based Optimal Seismic Design of Reinforced Concrete Structures Using Genetic Algorithms

Artificial intelligence (AI) has enabled several optimization techniques for structural design, including machine learning, evolutionary algorithms, as in the case of genetic algorithms, reinforced learning, deep learning, etc. Although the use of AI for weight optimization in steel and concrete buildings has been extensively studied in recent decades, multi-objective optimization for reinforced concrete (RC) and steel buildings remains challenging due to the difficulty in establishing independent objective functions and obtaining Pareto fronts. The well-known Non-Dominated Sorting Genetic Algorithm II (NSGA-II) is an efficient genetic algorithm approach for multi-objective optimization. In this work, the NSGA-II approach is considered for the multi-objective structural optimization of three-dimensional RC buildings subjected to earthquakes. For the objective of this study, two function objectives are considered: minimizing total cost and the probability of structural failure, which are obtained via several nonlinear seismic analyses of the RC buildings. Beams and columns’ cross-sectional dimensions are selected as design variables, and the Mexican Building Code (MBC) specifications are imposed as design constraints. Pareto fronts are obtained for two RC-framed buildings located in Mexico City (soft soil sites), which demonstrate the efficiency and accuracy of NSGA-II for structural optimization.

Optimal estimation of SoC, SoH using machine learning models and design of control algorithm for active cell balancing in lithium ion batteries

Abstract Electric vehicles transform the automotive industry by replacing
traditional vehicles powered by fossil fuels with less polluting and efficient vehicles.
They are powered by rechargeable Li-ion batteries. While there are drawbacks
associated with Li-ion battery technology, it’s important to note that these challenges
can be addressed or mitigated effectively. A battery management system ensures the
tracking of all functions performed by the battery. An advanced battery management
system should accurately estimate the battery’s state of health and state of charge.
This paper aims to develop machine learning models for the estimation of the state of
health and state of charge and to implement cell balancing in a battery management
system. A dataset of battery charging and discharging profiles was used to train
various machine learning models for estimation. These methods are computationally
less complex than conventional methods. In addition, a cell balancing algorithm is
implemented to control the charging and discharging of individual cells in a battery
pack and balance the state of charge of each cell. The machine learning solution is
created using several machine learning models, including Gradient Boosting, Random
Forest, Linear Regression, AdaBoost, and Multi-layer Perceptron. Among the models

Gradient Boosting and Random Forest provide good MSE and R2 score. The use of
machine learning algorithms for the assessment of state of health and charge estimation
combined with the design of an efficient control algorithm for active cell balancing
offers significant advancements in the battery management system to optimise the
performance, reliability, and useful life of Li-ion batteries. The paper also presents
a case study utilising a combination of deep learning-based SoC, SoH estimation
algorithms in a simulated data set. A well-designed control algorithm for active
cell balancing presents a holistic and effective approach to optimise Li-ion batteries' performance,
reliability, and lifespan.

Rapid Characterization of Point Defects in Solid-State Ion Conductors Using Raman Spectroscopy, Machine-Learning Force Fields, and Atomic Raman Tensors.

The successful design of solid-state photo- and electrochemical devices depends on the careful engineering of point defects in solid-state ion conductors. Characterization of point defects is critical to these efforts, but the best-developed techniques are difficult and time-consuming. Raman spectroscopy─with its exceptional speed, flexibility, and accessibility─is a promising alternative. Raman signatures arise from point defects due to local symmetry breaking and structural distortions. Unfortunately, the assignment of these signatures is often hampered by a shortage of reference compounds and corresponding reference spectra. This issue can be circumvented by calculation of defect-induced Raman signatures from first principles, but this is computationally demanding. Here, we introduce an efficient computational procedure for the prediction of point defect Raman signatures in solid-state ion conductors. Our method leverages machine-learning force fields and "atomic Raman tensors", i.e., polarizability fluctuations due to motions of individual atoms. We find that our procedure reduces computational cost by up to 80% compared to existing first-principles frozen-phonon approaches. These efficiency gains enable synergistic computational-experimental investigations, in our case allowing us to precisely interpret the Raman spectra of Sr(Ti0.94Ni0.06)O3-δ, a model oxygen ion conductor. By predicting Raman signatures of specific point defects, we determine the nature of dominant defects and unravel impacts of temperature and quenching on in situ and ex situ Raman spectra. Specifically, our findings reveal the temperature-dependent distribution and association behavior of oxygen vacancies and nickel substitutional defects. Overall, our approach enables rapid Raman-based characterization of point defects to support defect engineering in novel solid-state ion conductors.

Coordinate-based simulation of pair distance distribution functions for small and large molecular assemblies: implementation and applications

X-ray scattering has become a major tool in the structural characterization of nanoscale materials. Thanks to the widely available experimental and computational atomic models, coordinate-based X-ray scattering simulation has played a crucial role in data interpretation in the past two decades. However, simulation of real-space pair distance distribution functions (PDDFs) from small- and wide-angle X-ray scattering, SAXS/WAXS, has been relatively less exploited. This study presents a comparison of PDDF simulation methods, which are applied to molecular structures that range in size from β-cyclodextrin [1 kDa molecular weight (MW), 66 non-hydrogen atoms] to the satellite tobacco mosaic virus capsid (1.1 MDa MW, 81 960 non-hydrogen atoms). The results demonstrate the power of interpretation of experimental SAXS/WAXS from the real-space view, particularly by providing a more intuitive method for understanding of partial structure contributions. Furthermore, the computational efficiency of PDDF simulation algorithms makes them attractive as approaches for the analysis of large nanoscale materials and biological assemblies. The simulation methods demonstrated in this article have been implemented in stand-alone software, SolX 3.0, which is available to download from https://12idb.xray.aps.anl.gov/solx.html.

Noise suppression in pulsed IR thermographic NDT: Efficiency of data processing algorithms

Various types of noise, which accompany active TNDT procedures using optical heating, have been analyzed, both numerically and experimentally. An emphasis has been made on the suppression of surface clutter, which represents local areas of varying absorptivity/emissivity. The concept of signal-to-noise that is typically used in defect detection has been applied to fixed pattern noise in order to compare capabilities of data processing algorithms in reducing surface clutter. The experimental investigation has been fulfilled on a special sample containing both subsurface air-filled defects and areas with varying emissivity/absorptivity. The best suppression of the fixed pattern noise was provided by the complex wavelet transform and principle component analysis. Because of 3D heat diffusion, clutter spot boundaries are often underlined by particular data processing algorithms thus producing specific contours. The test situations where subsurface defects are located under localized clutter spots have been analyzed to demonstrate an overshadowing effect of such spots when detecting hidden defects.

Forecasting Urban Traffic States with Sparse Data Using Hankel Temporal Matrix Factorization

Forecasting urban traffic states is crucial to transportation network monitoring and management, playing an important role in the decision-making process. Despite the substantial progress that has been made in developing accurate, efficient, and reliable algorithms for traffic forecasting, most existing approaches fail to handle sparsity, high-dimensionality, and nonstationarity in traffic time series and seldom consider the temporal dependence between traffic states. To address these issues, this work presents a Hankel temporal matrix factorization (HTMF) model using the Hankel matrix in the lower dimensional spaces under a matrix factorization framework. In particular, we consider an alternating minimization scheme to optimize the factor matrices in matrix factorization and the Hankel matrix in the lower dimensional spaces simultaneously. To perform traffic state forecasting, we introduce two efficient estimation processes on real-time incremental data, including an online imputation (i.e., reconstruct missing values) and an online forecasting (i.e., estimate future data points). Through extensive experiments on the real-world Uber movement speed data set in Seattle, Washington, we empirically demonstrate the superior forecasting performance of HTMF over several baseline models and highlight the advantages of HTMF for addressing sparsity, nonstationarity, and short time series. History: Accepted by Ram Ramesh, Area Editor for Data Science & Machine Learning. Funding: This research was supported by the Institute for Data Valorisation, the Interuniversity Research Centre on Enterprise Networks, Logistics and Transportation, the National Natural Science Foundation of China [Grants 12371456, 72101049, 72232001], the Sichuan Science and Technology Program [Grant 2024NSFJQ0038], and the Fundamental Research Funds for the Central Universities [Grant DUT23RC(3)045].

Wasserstein-Kaplan-Meier Survival Regression

Survival analysis plays a pivotal role in medical research, offering valuable insights into the timing of events such as survival time. One common challenge in survival analysis is the necessity to adjust the survival function to account for additional factors, such as age, gender, and ethnicity. We propose an innovative regression model for right-censored survival data across heterogeneous populations, leveraging the Wasserstein space of probability measures. Our approach models the probability measure of survival time and the corresponding non-parametric Kaplan-Meier estimator for each subgroup as elements of the Wasserstein space. The Wasserstein space provides a flexible framework for modeling heterogeneous populations, allowing us to capture complex relationships between covariates and survival times. We address an underexplored aspect by deriving the non-asymptotic convergence rate of the Kaplan-Meier estimator to the underlying probability measure in terms of the Wasserstein metric. The proposed model is supported with a solid theoretical foundation including pointwise and uniform convergence rates, along with an efficient algorithm for model fitting. The proposed model effectively accommodates random variation that may exist in the probability measures across different subgroups, demonstrating superior performance in both simulations and two case studies compared to the Cox proportional hazards model and other alternative models.

A Multi-Strategy Improved Northern Goshawk Optimization Algorithm for Optimizing Engineering Problems

Northern Goshawk Optimization (NGO) is an efficient optimization algorithm, but it has the drawbacks of easily falling into local optima and slow convergence. Aiming at these drawbacks, an improved NGO algorithm named the Multi-Strategy Improved Northern Goshawk Optimization (MSINGO) algorithm was proposed by adding the cubic mapping strategy, a novel weighted stochastic difference mutation strategy, and weighted sine and cosine optimization strategy to the original NGO. To verify the performance of MSINGO, a set of comparative experiments were performed with five highly cited and six recently proposed metaheuristic algorithms on the CEC2017 test functions. Comparative experimental results show that in the vast majority of cases, MSINGO’s exploitation ability, exploration ability, local optimal avoidance ability, and scalability are superior to those of competitive algorithms. Finally, six real world engineering problems demonstrated the merits and potential of MSINGO.

A Novel Efficient Algorithm for Magnetic Biplanar Coils

A Novel Efficient Algorithm for Magnetic Biplanar Coils

Efficient path algorithms for clustered Lasso and OSCAR

AbstractIn high dimensional regression, clustering features according to their effects on outcomes is often as important as feature selection. For example, insurance premiums are set for each rate class pertaining to risk factors related to claim risk. To calculate reliable insurance premiums, it is often necessary to group the numerous rate classes into fewer classes. However, the combinations of ways to consolidate rate classes are vast, and it is computationally challenging to consider each combination individually. Under such circumstances, sparse regularization techniques for feature clustering are extremely useful as methods that automatically consolidate rate classes with no significant differences in risk levels during the estimation process. For this purpose, clustered Lasso and octagonal shrinkage and clustering algorithm for regression (OSCAR) can be used to generate feature groups automatically using pairwise $$L_1$$ L 1 norm and pairwise $$L_\infty $$ L ∞ norm, respectively. This paper proposes efficient path algorithms for clustered Lasso and OSCAR to construct solution paths with respect to their regularization parameters. Despite the excessive terms in exhaustive pairwise regularization, their computational costs are reduced by using the symmetry of those terms. Simple equivalent conditions to check subgradient equations in each feature group are derived using the graph theory. The proposed algorithms are shown to be more efficient than existing algorithms via numerical experiments.

Self-calibratable absolute modular rotary encoder: a theoretical feasibility study

Abstract This paper introduces a self-calibratable absolute modular rotary encoder based on the Equal Division Average (EDA) method, designed to significantly enhance measurement accuracy and simplify installation. The proposed design integrates multiple optical sensors into the encoder stator Printed Circuit Board (PCB), enabling precise absolute position measurement through the averaging of sensors data. This multi-sensor approach compensates for alignment and installation inaccuracies, which are common issues in conventional modular encoders. To validate the design and predict encoder behaviour prior to manufacturing, a theoretical modelling of virtual optical sensors is performed. Based on experimentally collected cross-calibration data from a real optical encoder, this modelling framework enables to estimate the efficiency of self-calibration algorithm with sufficient accuracy and optimize the design and performance of the encoder. The obtained results confirm that the proposed measurement system significantly reduces error margin, improving the reliability and precision of position feedback. The initial position deviation of several hundreds of arcseconds might be reduced and kept below 8 arcseconds by using two or more additional optical sensors, even with the 0.5 mm misalignment of the encoder stator.

[formula omitted]-space physics-informed neural network (k-PINN) for compressed spectral mapping and efficient inversion of vibrations in thin composite laminates

The vibrational response of structural components carries valuable information about their underlying mechanical properties, health status and operational conditions. This underscores the need for the development of efficient physics-based inversion algorithms which, given a limited set of sensing data points and in the presence of measurement noise, can reconstruct the response at locations where measurement data is not available and/or identify the unknown mechanical properties. Addressing this challenge, Physics-Informed Neural Networks (PINNs) have emerged as a promising approach. PINNs seamlessly integrate governing equations into their architecture and have gained significant interest in solving inversion problems. In the context of learning and inversion of multimodal, multiscale vibrational responses, this paper introduces a novel spectral extension of PINNs, utilizing Fourier basis functions in the wavenumber domain, commonly known as k-space. The proposed method, referred to as k-space PINN (k-PINN), offers a robust framework for adjusting complexity and wavenumber composition of the response. Notably, the spectral formulation of k-PINN, coupled with the generally sparse representation of vibrations in k-space, facilitate efficient reconstruction and learning of broadband vibrations and alleviate the spectral bias associated with standard PINN. Additionally, the spectral solution space introduced by k-PINN substantially reduces the computational cost associated with computing physics-informed loss terms. We evaluate the effectiveness of the proposed methodology on reconstructing the bending vibrational mode shapes of a thin composite laminate and identifying its effective bending stiffness coefficients. Mode shapes are initially obtained from finite element simulation, and virtual test data with added noise are generated for evaluation purposes. It is shown that the proposed k-PINN methodology outperforms the standard PINN in terms of both learning and computational efficiency. The performance of k-PINN is further demonstrated by show casing its capability in learning different selections of symmetric, anti-symmetric and asymmetric mode shapes.

Performance analysis of the FB-PLL applied to real time monitoring of deep sleep brainwaves

Repose is indispensable for the human body, one of its main functions being to replenish energy. During sleep, the body's important restorative activities are performed by the organism, which is a basic human need. With awareness of the dimension that sleep represents and the need to improve its quality, the importance of monitoring in real time becomes evident. Based on this, the fast fourier transform is a technique capable of obtaining characteristics of a signal, such as its frequency, as well as being able to be applied to sleep waves. However, to have a good use, a considerable number of sample experimental cycles is necessary, which demands a certain computational effort. In this sense, this work we sought to apply the Phase-Locked Loop technique. Thus, a Fourier-based synchronization algorithm is proposed to track low-frequency brain waves during sleep. It is also worth noting that this method is capable of performing the estimates in just one cycle. Therefore, the objective is to obtain the estimated curve referring to the frequency and an efficient synchronization algorithm that is able to track deep sleep in real time.

An efficient one-step synthesis of a new series of mutifunctional olefins and direct hydroxymethylation of α-substituted β-keto esters

An efficient one-step procedure for the synthesis of a new series of multifunctional olefins by condensation of α-substituted β-diketones as well as β-phosphonoesters and benzoylated β-ketoesters with formaldehyde, using potassium carbonate in refluxing THF, followed by a deacylation reaction, is herein described. In contrast, the α-substituted β-keto esters, bearing an acyl moiety, only undergo a hydroxymethylation reaction, with no metal catalysts/activating agents, as is usually required for the process, affording the corresponding α-hydroxymethyl β-keto esters in high yields.

118 DHGLMF90: A software tool using double hierarchical generalized linear models for estimating the genetic heterogeneity of residual variance

Abstract In animal breeding, there is a growing interest in selecting animals that exhibit uniform responses to environmental conditions, aiming for product consistency as a desirable breeding objective. This could be achieved by modeling heteroskedastic residuals when estimating breeding values through a hierarchical single-trait model that includes a mean and dispersion part. The latter could be influenced by genetic and non-genetic features. Bayesian methods can estimate heteroskedastic residuals using the Metropolis-Hastings algorithm, which is a slow and inefficient approach. Double hierarchical generalized linear models (DHGLM) provide a faster alternative to Bayesian methods. This study aimed to develop software named DHGLMF90 to implement DHGLM using a highly efficient algorithm to accurately estimate heterogeneous residual variances and breeding values, particularly suited for handling large datasets. We improved the reweighted least squares algorithm (IRWLS) to enhance convergence properties compared with prior implementations. IRWLS iteratively computes variance components and leverages them for a bivariate model, covering both the mean and dispersion part of the original model. In DHGLMF90, variance component estimation is performed using REML through BLUPF90+. The software was tested using both simulated and real datasets, the latter from previous studies. Additionally, the simulations were replicated to ensure a comprehensive evaluation of the DHGLMF90 performance. Results indicated that, in most cases, there were no significant differences in estimation compared with results obtained from previous studies. DHGLMF90 converged in order of magnitude faster than Bayesian methods. Future developments will include analyzing datasets with genomic information and multiple-trait models.