Automatic Selection Algorithm Research Articles

Pflacco: Feature-Based Landscape Analysis of Continuous and Constrained Optimization Problems in Python.

The herein proposed Python package pflacco provides a set of numerical features to characterize single-objective continuous and constrained optimization problems. Thereby, pflacco addresses two major challenges in the area of optimization. Firstly, it provides the means to develop an understanding of a given problem instance, which is crucial for designing, selecting, or configuring optimization algorithms in general. Secondly, these numerical features can be utilized in the research streams of automated algorithm selection and configuration. While the majority of these landscape features are already available in the R package flacco, our Python implementation offers these tools to an even wider audience and thereby promotes research interests and novel avenues in the area of optimization.

Integrated packing and routing: A model and its solutions

This paper introduces the two-level vehicle routing and loading problem (2L-VRLP), an innovative model integrating the two-level bin packing and vehicle routing problems to address real-world logistics challenges that require simultaneous packing and transportation decisions. By capturing the essence of dual-level packing (boxes onto pallets, pallets onto vehicles) and optimising vehicle routing, the 2L-VRLP offers an integrated framework that outperforms traditional separated models, demonstrating superior solutions that align closely with practical logistics operations. We propose a set of heuristic algorithms tailored for the 2L-VRLP’s unique requirements and explore automated algorithm selection using an artificial neural network (ANN), marking a step towards incorporating machine learning in logistics optimisation. This work not only showcases the 2L-VRLP model’s potential to enhance logistics management but also sets the groundwork for future research and applications in this domain.

Opt2Vec - a continuous optimization problem representation based on the algorithm's behavior: A case study on problem classification

Characterization of the optimization problem is a crucial task in many recent optimization research topics (e.g., explainable algorithm performance assessment, and automated algorithm selection and configuration). The state-of-the-art approaches use exploratory landscape analysis to represent the optimization problem, where for each one, a set of features is extracted using a set of candidate solutions sampled by a sampling strategy over the whole decision space. This paper proposes a novel representation of continuous optimization problems by encoding the information found in the interaction between an algorithm and an optimization problem. The new problem representation is learned using the information from the states/positions in the optimization run trajectory (i.e., the candidate solutions visited by the algorithm). With the novel representation, the problem can be characterized dynamically during the optimization run, instead of using a set of candidate solutions from the whole decision space that have never been observed by the algorithm. The novel optimization problem representation is called Opt2Vec and uses an autoencoder type of neural network to encode the information found in the interaction between an optimization algorithm and optimization problem into an embedded subspace. The Opt2Vec representation efficiency is shown by enabling different optimization problems to be successfully identified using only the information obtained from the optimization run trajectory.

Suppression of negative transfer in motor imagery brain-computer interface based on mutual information and Pearson correlation coefficient.

The focus of this paper is on the main challenges in brain-computer interface transfer learning: how to address data characteristic length and the source domain sample selection problems caused by individual differences. To overcome the negative migration that results from feature length, we propose a migration algorithm based on mutual information transfer (MIT), which selects effective features by calculating the entropy value of the probability distribution and conditional distribution, thereby reducing negative migration and improving learning efficiency. Source domain participants who differ too much from the target domain distribution can affect the overall classification performance. On the basis of MIT, we propose the Pearson correlation coefficient source domain automatic selection algorithm (PDAS algorithm). The PDAS algorithm can automatically select the appropriate source domain participants according to the target domain distribution, which reduces the negative migration of participant data among the source domain participants, improves experimental accuracy, and greatly reduces training time. The two proposed algorithms were tested offline and online on two public datasets, and the results were compared with those from existing advanced algorithms. The experimental results showed that the MIT algorithm and the MIT + PDAS algorithm had obvious advantages.

Locate hyperbolas on Ground Penetrating Radar slices with auto filter selection algorithm

Ground Penetrating Radar (GPR) is a geophysical method of using high frequency electromagnetic waves to study shallow objects below the ground. In the GPR sections, the position of point anomalies is represented as reflected hyperbola. In some cases, the reflected hyperbolas on the GPR cross-section have a relatively large number and overlap which making the positioning very complicated and time-consuming. This article presents the development of an automatic selection algorithm with the aim of accurately determining the position of hyperbolas on GPR cross-sections. The automatic selection algorithm is a combination of an edge detection algorithm and the establishment of filtering conditions based on image and physical properties of geological objects. The algorithm is applied to determine the hyperbolic position of several GPR cross-sections at specific locations and provides relatively accurate results. This result will enhance the accuracy in problems related to drawing tree root maps, underground construction, landslide surveys, subsidence, and soil pollution research.

Information System for the Selection of Hydropneumatic Capacitive Vessels

This article describes an algorithm for the automatic selection of hydropneumatic capacitive vessels used for household and industrial purposes. The suggested informational system makes it possible to reduce the working time spent on the selection of equipment and increase the relevance of the analyzed information. The article discusses a detailed description of the design of pneumohydroaccumulators, as well as provides examples of calculations of their main characteristics. The main task we needed to solve was a multi-criteria choice, and the article provides an overview of methods for solving this problem. In addition to these methods, we analyzed information systems that allow one to select suitable equipment among various alternatives. Based on the analysis of methods and similar software solutions, the authors suggested an information system and an algorithm for automatic selection of hydraulic accumulators by searching for options that meet the parameters specified by the system user. Also, the article discusses the process of purchasing capacitive equipment. There was demonstrated a logical model of the database structure storing the technical characteristics of the equipment which reflects objects of the information system and their connections. In this article we presented and argued the software for development of a specified information system. The development of the information system was based on the "1С platform: The enterprise". The task of selecting hydropneumatic capacitive vessels was solved by a request that can be interacted with through a report in the information system. This report allows the user to search for equipment by quantitative and qualitative characteristics: volume, operating pressure, vessel material, flange material, installation type (vertical or horizontal), availability of legs, cost, manufacturer or supplier. The report options allow users to search for equipment both in accordance with the specified parameters and with a deviation from them but only if the parameter is quantitative. The results of the report are ordered by relevance to the criteria specified by the user. The operation of the report query aggregating data was reflected in the flowchart. The article presents a situation where the user solves the selection problem by using capabilities of the report. The problem of multi-criteria selection was formulated in a way to demonstrate how a clear parameter of the report becomes fuzzy, and our solution of it allows you to find more alternative options with sorting by relevance helping you to identify the most suitable pneumohydroaccumulator. This software package was registered in the state registry of computer programs.

Automatic constraint programming solver selection method based on machine learning for the cable tree wiring problem

AbstractCable trees are primarily employed in industrial products to facilitate energy transfer and information exchange among various components. When utilizing machines for assembly, it is essential to convert the wiring plan into a sequence of cable insertion operations executed by the machine under various constraints. This poses a combinatorial optimization problem. In this domain, constraint programming (CP) solvers often exhibit outstanding performance by leveraging their robust problem‐modelling capabilities, excellent scalability, and precise solving capabilities. However, CP solvers may achieve various performances for different problem instances. Selecting the most suitable CP solver for each problem instance is crucial. This paper introduces an automatic selection algorithm for CP solvers to solve the cable tree wiring problem (CTW). Firstly, a scoring system is used to conduct an in‐depth analysis and compare four well‐known CP solvers: CPLEX, Chuffed, OR‐Tools, and Gurobi. The results indicate that OR‐Tools and CPLEX outperform other solvers in performance. Moreover, these two solvers exhibit complementary advantages in quickly finding optimal and feasible solutions within specified time limits. Therefore, CP and machine learning are ingeniously integrated, harnessing their complementary advantages. 4240 instances covering various scenarios are randomly generated to form the problem space. This method incorporates decision trees, random forests, K‐nearest neighbours, and naive Bayes, utilizing these four machine learning techniques. The proposed method can achieve better results than traditional single CP solvers. Among all the evaluated machining learning techniques, the automatic solver selection methods based on decision trees and random forests can achieve accuracy rates of 91.29% and 84.15%, respectively.

Automatic deep learning method for third lumbar selection and body composition evaluation on CT scans of cancer patients.

The importance of body composition and sarcopenia is well-recognized in cancer patient outcomes and treatment tolerance, yet routine evaluations are rare due to their time-intensive nature. While CT scans provide accurate measurements, they depend on manual processes. We developed and validated a deep learning algorithm to automatically select and segment abdominal muscles [SM], visceral fat [VAT], and subcutaneous fat [SAT] on CT scans. A total of 352 CT scans were collected from two cancer centers. The detection of the third lumbar vertebra and three different body tissues (SM, VAT, and SAT) were annotated manually. The 5-fold cross-validation method was used to develop the algorithm and validate its performance on the training cohort. The results were validated on an external, independent group of CT scans. The algorithm for automatic L3 slice selection had a mean absolute error of 4 mm for the internal validation dataset and 5.5 mm for the external validation dataset. The median DICE similarity coefficient for body composition was 0.94 for SM, 0.93 for VAT, and 0.86 for SAT in the internal validation dataset, whereas it was 0.93 for SM, 0.93 for VAT, and 0.85 for SAT in the external validation dataset. There were high correlation scores with sarcopenia metrics in both internal and external validation datasets. Our deep learning algorithm facilitates routine research use and could be integrated into electronic patient records, enhancing care through better monitoring and the incorporation of targeted supportive measures like exercise and nutrition.

AAUConvNeXt: Enhancing Crop Lodging Segmentation with Optimized Deep Learning Architectures

Rice lodging, a phenomenon precipitated by environmental factors or crop characteristics, presents a substantial challenge in agricultural production, notably impacting yield prediction and disaster assessment. Despite that the application of conventional methodologies like visual assessment, mathematical models, and satellite remote sensing technologies has been employed in the segmentation of crop lodging, these approaches are still constrained in precision, immediacy, and capacity for large-scale evaluation. This study introduces an innovative convolutional neural network architecture, AFOA + APOM + UConvNeXt, that integrates intelligent optimization algorithms for automatic selection of optimal network parameters, thereby enhancing the accuracy and efficiency of crop lodging segmentation. The proposed model, empirically validated, outperforms recent state-of-the-art models in crop lodging segmentation, demonstrating higher accuracy, lower computational resource requirements, and greater efficiency, thereby markedly reducing the cost of segmentation. In addition, we investigated the segmentation on half lodging rice, and the results indicate that the model exhibits commendable performance on the half lodging dataset. This outcome holds significant implications for the prediction of rice lodging trends. The fusion of deep learning with intelligent optimization algorithms in this study offers a new effective tool for crop lodging monitoring in agricultural production, providing strong technical support for accurate crop phenotypic information extraction, and is expected to play a significant role in agricultural production practices.

Anytime Automatic Algorithm Selection for the Multi-Agent Path Finding Problem

Anytime Automatic Algorithm Selection for the Multi-Agent Path Finding Problem

Automated algorithm selection using meta-learning and pre-trained deep convolution neural networks

Automated machine learning (AutoML), which explores the automation of various machine learning tasks, has seen significant progress in recent years. One of the fundamental tasks in this field is the selection of effective algorithms for a given dataset. This task is particularly challenging for tabular datasets where, unlike images or text, one cannot use pre-trained embeddings from other datasets. In this study, we present AutoIRAD, a novel meta-learning and vision-based approach for automatic classification algorithm selection for tabular datasets. Our approach is the first to generate image-based representations of entire tabular datasets, enabling us to model the features and interactions of all the dataset samples. Our image-based representation has two significant advantages. First, training our model across multiple datasets enables it to simultaneously learn from diverse domains and create more generalized and effective dataset representations. This representation can also be effectively applied to previously unseen datasets. Secondly, using images enables us to leverage large pre-trained networks (e.g., VGG). By tuning existing networks rather than training new ones, we can both speed up the training of our model and reduce the needed amounts of training data. An extensive evaluation of 150 datasets shows that AutoIRAD achieves results comparable to the leading state-of-the-art AutoML solution but at a fraction of their computation time.

A Computational Tool for Recoloring Based on User Emotions

This work describes a system to recolor a user’s painting based on the perceived emotional state of the viewer. An automatic palette selection algorithm is used to generate color palettes for a set of emotions. A user can create a painting using one of the generated palettes. To notify the end of the painting, the user clicks on the DONE button. Once the button is pressed, the colors of the user's painting change as the facial expression of the user changes. Facial emotion recognition is used in this process to classify the emotional status of the user’s face.

Hierarchical Automated Machine Learning Approach for Self-Optimizable Driving Distraction Recognition Based on Driver’s Lane-Keeping Performance

With the enrichment of smartphone uses, phone-related driving distractions have become a threat to driving safety. One way to mitigate driving distractions is to detect them and provide real-time warnings. However, most existing driving distraction recognition algorithms are pretrained models composed of structures, hyperparameters, and parameters that may not be able to account for drivers’ individual differences and, thus, might result in low model accuracy. This study proposes a domain-specific hierarchical automated machine learning (HAT-ML) model that self-learns personalized optimal models to detect driving distractions from vehicle movement data. The HAT-ML model integrates key modeling steps into auto-optimizable layers, including knowledge-based feature extraction, feature selection by recursive feature elimination, automated algorithm selection, and hyperparameter autotuning by Bayesian optimization. In our eight-degrees-of-freedom driving simulator experiment, we demonstrated the effectiveness of the proposed model using three driving distraction tasks: browsing a short message, browsing a long message, and answering a phone call. The HAT-ML model was found to be reliable and robust for predicting phone-related driving distraction, achieving satisfactory results with a predictive accuracy of 80% at the group level and 90% at the individual level. Moreover, the results revealed that each distraction and driver type required different optimized hyperparameter values, which demonstrated the value of utilizing HAT-ML to detect driving distractions. The key elements that dominated the performance of the model have several theoretical and practical implications. The proposed method not only enhanced performance, but also provided data-driven insights about model development.

Automatic Variable Selection Algorithms in Prognostic Factor Research in Neck Pain.

This study aims to compare the variable selection strategies of different machine learning (ML) and statistical algorithms in the prognosis of neck pain (NP) recovery. A total of 3001 participants with NP were included. Three dichotomous outcomes of an improvement in NP, arm pain (AP), and disability at 3 months follow-up were used. Twenty-five variables (twenty-eight parameters) were included as predictors. There were more parameters than variables, as some categorical variables had >2 levels. Eight modelling techniques were compared: stepwise regression based on unadjusted p values (stepP), on adjusted p values (stepPAdj), on Akaike information criterion (stepAIC), best subset regression (BestSubset) least absolute shrinkage and selection operator [LASSO], Minimax concave penalty (MCP), model-based boosting (mboost), and multivariate adaptive regression splines (MuARS). The algorithm that selected the fewest predictors was stepPAdj (number of predictors, p = 4 to 8). MuARS was the algorithm with the second fewest predictors selected (p = 9 to 14). The predictor selected by all algorithms with the largest coefficient magnitude was "having undergone a neuroreflexotherapy intervention" for NP (β = from 1.987 to 2.296) and AP (β = from 2.639 to 3.554), and "Imaging findings: spinal stenosis" (β = from -1.331 to -1.763) for disability. Stepwise regression based on adjusted p-values resulted in the sparsest models, which enhanced clinical interpretability. MuARS appears to provide the optimal balance between model sparsity whilst retaining high predictive performance across outcomes. Different algorithms produced similar performances but resulted in a different number of variables selected. Rather than relying on any single algorithm, confidence in the variable selection may be increased by using multiple algorithms.

An algorithm for automatic selection and combination of forecast models

In this paper, we present an algorithm designed to automatically merge predictions from a collection of individual prediction methods coded in R. The algorithm employs varying weights and decision rules to ascertain the optimal amalgamation of these methods, with the aim of forecasting historical time series data while minimizing human intervention. The algorithm serves as an automated component within the artificial intelligence toolkit.The proposed algorithm (al), denoted as “alPCA” is founded on principal component analysis (PCA), hence the acronym. Commencing with 52 configurations of 11 distinct methods available in R, we calculate several loss functions: specifically, scaled Mean Absolute Percentage Error (sMAPE) and Mean Absolute Scaled Error (MASE) for both fitting (Training Phase) and prediction (Validation Phase), along with Root Mean Squared Error (RMSE) and Overall Weighted Average (OWA) solely for prediction (Validation Phase). We then employ PCA to reduce the error matrix derived from this data to one or two dimensions. Subsequently, the methods are ranked based on their proximity to the highest score. A probability distribution is fitted to this proximity metric, and utilizing the percentiles of these values, the optimal methods for combination are selected. We propose three categories of weights derived from the PCA scores, encompassing the fitting sMAPE (Training Phase) and the prediction sMAPE (Validation Phase), to facilitate the amalgamation process.This approach is applied to seven distinct univariate time series across diverse domains, including automobile sales, electricity production, and CO2 levels. Additionally, a set of 100 random monthly series from the M4 competition is included in the analysis. To assess the predictive precision of our algorithm, we compare its performance against three widely utilized combined prediction algorithms available in R. We evaluate the outcomes in Test Phase (unseen data) using four distinct loss functions and conduct a sensitivity analysis to gauge the algorithm's robustness and efficacy across various specifications.

Visual Coherence for Augmented Reality

Introduction. The 2020s were marked by the emergence of a new generation of computer simulators using augmented reality. One of the promising advantages of augmented reality technology is the ability to safely simulate hazardous situations real-world. A prerequisite for realizing this advantage is to provide the visual coherence of augmented reality scenes: virtual objects must be indistinguishable from real ones. All IT leaders consider augmented reality as a next “big wave”; thus, the visual coherence is becoming a key issue for IT in general. However, it is in aerospace applications that the visual coherence has already acquired practical significance. An example is Boeing's development of an augmented reality flight simulator, which began in 2022. Visual coherence is a complex problem, one of the aspects of which is to provide the correct overall coloration of virtual objects in an augmented reality scene. The objective of the research was to develop a new method of such tinting.Materials and Methods. The developed method (called spectral transplantation) uses two-dimensional spectral image transformations.Results. A spectral transplantation technology is proposed that provides direct transfer of color, brightness, and contrast characteristics from the real background to virtual objects. An algorithm for automatic selection of the optimal type of spectral transformation has been developed.Discussion and Conclusion. Being a fully automatic process without recording lighting conditions, spectral transplantation solves a number of complex problems of visual coherence. Spectral transplantation can be a valuable addition to other methods of providing visual coherence.

Optimal periodicity-enhanced group sparse for bearing incipient fault feature extraction

Efficient and automatic fault feature extraction of rotating machinery, especially for incipient faults is a challenging task of great significance. In this article, an optimal periodicity-enhanced group sparse method is proposed. Firstly, a period sequence determination method without any prior information is proposed, and the amplitude is calculated by the numerical characteristics of the vibration signal to obtain period square waves. Secondly, the periodic square waves are embedded into the group sparse algorithm, to eliminate the influence of random impulses, and intensify the periodicity of the acquisition signal. Thirdly, a fault feature indicator reflecting both signal periodicity and sparsity within and across groups is proposed as the fitness of the marine predator algorithm for parameter automatic selection. In addition, the method proposed is evaluated and compared by simulation and experiment. The results show that it can effectively extract incipient fault features and outperforms traditional overlapping group shrinkage and Fast Kurtogram.

An automatic band selection algorithm based on connection centre evolution

ABSTRACT The characteristics of high dimensionality, strong band correlation, and high information redundancy make band selection become a necessary step for efficient processing of hyperspectral images. In this paper, a new band selection method based on connection centre evolution (CCE) is proposed, named -nearest neighbour CCE band selection (NNCCEBS). First, according to CCE, we measure the band similarity under different observation scales by iteratively calculating the connectivity at different scales. Therefore, NNCCEBS can achieve multi-scale band selection, and is able to complete it at one time. Next, to avoid the selected bands being aggregated, an -nearest neighbour similarity matrix is introduced, which only retains the connectivity of -nearest bands for a band. By doing so, the new method is less sensitive to the parameter settings, and can select more accurate band centres. Experiments on real hyperspectral datasets prove the effectiveness of our method.

Noise-aware physics-informed machine learning for robust PDE discovery

This work is concerned with discovering the governing partial differential equation (PDE) of a physical system. Existing methods have demonstrated the PDE identification from finite observations but failed to maintain satisfying results against noisy data, partly owing to suboptimal estimated derivatives and found PDE coefficients. We address the issues by introducing a noise-aware physics-informed machine learning framework to discover the governing PDE from data following arbitrary distributions. We propose training a couple of neural networks, namely solver and preselector, in a multi-task learning paradigm, which yields important scores of basis candidates that constitute the hidden physical constraint. After they are jointly trained, the solver network estimates potential candidates, e.g. partial derivatives, for the sparse regression to initially unveil the most likely parsimonious PDE, decided according to information criterion. Denoising physics-informed neural networks, based on discrete Fourier transform, is proposed to deliver the optimal PDE coefficients respecting the noise-reduced variables. Extensive experiments on five canonical PDEs affirm that the proposed framework presents a robust and interpretable approach for PDE discovery, leading to a new automatic PDE selection algorithm established on minimization of the information criterion decay rate.

Technique for Automatic Algorithm Selection for Computational Intelligence in Cloud-Based Computing Environments

This research presents an Auto-Algorithm selection technique for Computational Intelligence in Cloud-Based computing environment. By leveraging the capabilities of a network information processing platform, users can effortlessly and intelligently build Computational Intelligence models tailored to their specific problems without the need for manually configuring the Computational Intelligence environment, selecting algorithms, or adjusting complex Computational Intelligence functions and parameters. The proposed procedure allows users to simply upload sample data through a web interface, freeing Computational Intelligence applications from environmental constraints and taking advantage of the network information processing platform's capabilities. This approach transparently handles the model building process, significantly reducing the barriers to entry for utilizing Computational Intelligence. By addressing the issues of unpredictable model selection, manual parameter adjustment, and the challenges faced by common users, this auto selection procedure empowers the practical application of Computational Intelligence in various domains.