Evolutionary Search Research Articles

Evoattack: suppressive adversarial attacks against object detection models using evolutionary search

Evoattack: suppressive adversarial attacks against object detection models using evolutionary search

An Artificial Intelligence-Based Hybrid Approach to Detect the Type of Buried Objects with Broad Frequency Band Antenna Systems

Knowing the type of buried object before excavation prevents unnecessary excavation. Moreover, it saves time and money. In this study, an experiment set was prepared for the detection of buried objects. The experimental set was composed of an antenna that sends and receives electromagnetic waves in a wide frequency band, software that records and processes reflections, and a sandbox. In the study, metallic and non-metallic objects with different depths, sizes and shapes were buried in this sand pool and measurements were taken along a profile. 2D images were created from the measurements and image processing techniques were applied to these images. Classification algorithms were used to detect the type of bruied object from processed images. To increase the success of the algorithms, correlation-based attribute selection (CFS) and Principal Component Analysis (PCA) were used as attribute selection techniques. Genetic algorithm (GA), Particle Swarm Optimization (PSO), Harmony search (HA), and Evolutionary search (EA), which are among the metaheuristic optimization algorithms, were preferred as search methods in attribute selection with CFS. The performance of the algorithms was analyzed using the 10-fold cross-validation method. As a result, it was understood that the use of the PCA algorithm in attribute selection increases the classification success more than metaheuristic algorithms. The most successful among the classification algorithms used is the Random tree algorithm. After PCA, the accuracy value of this algorithm was 95.8 Therefore, a hybrid approach is proposed in which PCA and Random tree algorithms are used in the software embedded in the measurement system.

Evolutions and paths: Voluntary employee turnover theories in search of new empirical tests

The retention of human capital remains a vital point of interest for both organizations and scholars today, as it has for over a century. While many models of voluntary turnover exist, we identify two turnover theories, Steel's (2002) Evolutionary Job Search Model of Turnover and Lee and Mitchell's Unfolding Model of Turnover, that we believe offer significant opportunities for future research. In this editorial, we review these two theories, highlighting the impact of each and offering several recommendations for future replication. Specifically, after reviewing 183 articles that cited Steel, we found that only a few of these directly tested the core propositions of the model, likely due to the complexity of the challenges of sufficiently capturing the dynamic components, and none have fully tested the model. Additionally, despite being published only six years prior, we identified 748 articles that cited Lee and Mitchell, yet we found that only 127 empirically examined the model, with most focused on specific components of the model, and only 15 attempted to test the entire model. We provide several methodological and theoretical suggestions for progressing these two models towards a better understanding of voluntary turnover.

Adaptive Bi-Operator Evolution for Multitasking Optimization Problems.

The field of evolutionary multitasking optimization (EMTO) has been a highly anticipated research topic in recent years. EMTO aims to utilize evolutionary algorithms to concurrently solve complex problems involving multiple tasks. Despite considerable advancements in this field, numerous evolutionary multitasking algorithms continue to use a single evolutionary search operator (ESO) throughout the evolution process. This strategy struggles to completely adapt to different tasks, consequently hindering the algorithm's performance. To overcome this challenge, this paper proposes multitasking evolutionary algorithms via an adaptive bi-operator strategy (BOMTEA). BOMTEA adopts a bi-operator strategy and adaptively controls the selection probability of each ESO according to its performance, which can determine the most suitable ESO for various tasks. In an experiment, BOMTEA showed outstanding results on two well-known multitasking benchmark tests, CEC17 and CEC22, and significantly outperformed other comparative algorithms.

Particle Swarm Optimization for Efficiently Evolving Deep Convolutional Neural Networks Using an Autoencoder-Based Encoding Strategy

Deep convolutional neural networks (DCNNs) have achieved surpassing success in the field of computer vision, and a number of elaborately designed networks refresh the performance records in benchmark datasets. Recently, evolutionary neural architecture search (ENAS) has become an emerging area, which could employ an evolutionary computation (EC) technique to automatically construct promising network architectures without human intervention. However, existing algorithms still have limitations: most standard EC approaches cannot process flexible-length architecture representations directly, and most fitness evaluation processes suffer from the exhibitive computational cost and the unreliable prediction results. To overcome these shortcomings, we propose an efficient particle swarm optimization (PSO)-based neural architecture search algorithm to search for appropriate dense blocks on image classification tasks, named EAEPSO. EAEPSO addresses the first limitation by designing an autoencoder to encode variable-length network representations as fixed-length latent vectors, which converts the original search space to a latent space that can facilitate the downstream search. Besides, an efficient and effective hierarchical fitness evaluation method is designed to guide the search process to address the second limitation. The experimental results show that EAEPSO is a very competitive ENAS algorithm that achieves an error rate of 2.74% on CIFAR-10 and 16.17% on CIFAR-100, and reduces the computational cost from hundreds or thousands of GPU-days to only 2.2 and 4 GPU-days, respectively. Further analyses investigate the reduced training data’s effect and confirm the effectiveness of both the proposed autoencoder and the proposed hierarchical fitness evaluation method.

Multi-Objective Short-Term Operation of Hydro–Wind–Photovoltaic–Thermal Hybrid System Considering Power Peak Shaving, the Economy and the Environment

In recent years, renewable, clean energy options such as hydropower, wind energy and solar energy have been attracting more and more attention as high-quality alternatives to fossil fuels, due to the depletion of fossil fuels and environmental pollution. Multi-energy power systems have replaced traditional thermal power systems. However, the output of solar and wind power is highly variable, random and intermittent, making it difficult to integrate it directly into the grid. In this context, a multi-objective model for the short-term operation of wind–solar–hydro–thermal hybrid systems is developed in this paper. The model considers the stability of the system operation, the operating costs and the impact in terms of environmental pollution. To solve the model, an evolutionary cost value region search algorithm is also proposed. The algorithm is applied to a hydro–thermal hybrid system, a multi-energy hybrid system and a realistic model of the wind–solar–hydro experimental base of the Yalong River Basin in China. The experimental results demonstrate that the proposed algorithm exhibits superior performance in terms of both convergence and diversity when compared to the reference algorithm. The integration of wind and solar energy into the power system can enhance the economic efficiency and mitigate the environment impact from thermal power generation. Furthermore, the inherent unpredictability of wind and solar energy sources introduces operational inconsistencies into the system loads. Conversely, the adaptable operational capacity of hydroelectric power plants enables them to effectively mitigate peak loads, thereby enhancing the stability of the power system. The findings of this research can inform decision-making regarding the economic, ecological and stable operation of hybrid energy systems.

SaDENAS: A self-adaptive differential evolution algorithm for neural architecture search

Evolutionary neural architecture search (ENAS) and differentiable architecture search (DARTS) are all prominent algorithms in neural architecture search, enabling the automated design of deep neural networks. To leverage the strengths of both methods, there exists a framework called continuous ENAS, which alternates between using gradient descent to optimize the supernet and employing evolutionary algorithms to optimize the architectural encodings. However, in continuous ENAS, there exists a premature convergence issue accompanied by the small model trap, which is a common issue in NAS. To address this issue, this paper proposes a self-adaptive differential evolution algorithm for neural architecture search (SaDENAS), which can reduce the interference caused by small models to other individuals during the optimization process, thereby avoiding premature convergence. Specifically, SaDENAS treats architectures within the search space as architectural encodings, leveraging vector differences between encodings as the basis for evolutionary operators. To achieve a trade-off between exploration and exploitation, we integrate both local and global search strategies with a mutation scaling factor to adaptively balance these two strategies. Empirical findings demonstrate that our proposed algorithm achieves better performance with superior convergence compared to other algorithms.

Digging Its Own Site: Linear Coordination Stabilizes a Pt1/Fe2O3 Single-Atom Catalyst.

Determining the local coordination of the active site is a prerequisite for the reliable modeling of single-atom catalysts (SACs). Obtaining such information is difficult on powder-based systems and much emphasis is placed on density functional theory computations based on idealized low-index surfaces of the support. In this work, we investigate how Pt atoms bind to the (11̅02) facet of α-Fe2O3; a common support material in SACs. Using a combination of scanning tunneling microscopy, X-ray photoelectron spectroscopy, and an extensive computational evolutionary search, we find that Pt atoms significantly reconfigure the support lattice to facilitate a pseudolinear coordination to surface oxygen atoms. Despite breaking three surface Fe-O bonds, this geometry is favored by 0.84 eV over the best configuration involving an unperturbed support. We suggest that the linear O-Pt-O configuration is common in reactive Pt-based SAC systems because it balances thermal stability with the ability to adsorb reactants from the gas phase. Moreover, we conclude that extensive structural searches are necessary to determine realistic active site geometries in single-atom catalysis.

Discovery of novel silicon allotropes with optimized band gaps to enhance solar cell efficiency through evolutionary algorithms and machine learning

In the pursuit of advancing solar energy technologies, this study presents 20 direct and quasi-direct band gap silicon crystalline semiconductors that satisfy the Shockley-Queisser limit, a benchmark for solar cell efficiency. Employing two evolutionary algorithm-based searches, we optimize structures and calculate fitness function using the DFTB method and Gaussian approximation potential. Following the preselection of structures based on energy considerations, we further optimize them using PBEsol DFT. Subsequently, we screen the structures based on their band gap, employing a DFTB method tailored for band gap calculation of silicon crystals. To ensure accurate band gap determination, we employ HSE and GW methods. To validate the structural stability, we employ phonon analysis via linear regression algorithm applied to PBEsol DFT data. Significantly, the structures unveiled in this study are of great importance due to their proven stability from both mechanical and dynamic perspectives. Furthermore, the ductility and low density of certain structures enhance their potential application. We examine the optical properties by studying the imaginary part of the dielectric function by solving the Bethe–Salpeter Equation on top of GW approximation. By calculating the SLME, we achieve an efficiency of 32.7% for Si22 at a thickness of 500 nm. Moreover, the study harnesses various machine learning algorithms to develop a predictive model for the band gap energy of these silicon structures. Input data for machine learning models are derived from structural MBTR and SOAP descriptors, as well as DFT outputs. Notably, the results reveal that features extracted from DFT outperform the MBTR and SOAP descriptors.

Evolutionary neural architecture search for automated MDD diagnosis using multimodal MRI imaging

Major depressive disorder (MDD) is a prevalent mental disorder with serious impacts on life and health. Neuroimaging offers valuable diagnostic insights. However, traditional computer-aided diagnosis methods are limited by reliance on researchers' experience. To address this, we proposed an evolutionary neural architecture search (M-ENAS) framework for automatically diagnosing MDD using multi-modal magnetic resonance imaging (MRI). M-ENAS determines the optimal weight and network architecture through a two-stage search method. Specifically, we designed a one-shot network architecture search (NAS) strategy to train supernet weights and a self-defined evolutionary search to optimize the network structure. Finally, M-ENAS was evaluated on two datasets, demonstrating that M-ENAS outperforms existing hand-designed methods. Additionally, our findings reveal that brain regions within the somatomotor network play important roles in the diagnosis of MDD, providing additional insight into the biological mechanisms underlying the disorder.

Wind power forecasting based on ensemble deep learning with surrogate-assisted evolutionary neural architecture search and many-objective federated learning

Deep neural networks (DNN) have been widely used in wind power forecasting (WPF), however, they still encounter difficulties such as delayed variable selection, DNN architecture design, and network weight optimization. Therefore, an ensemble cascaded DNN (ECDNN) with surrogate-assisted evolutionary neural architecture search (SEANS) and many-objective federated learning (MOFL) is proposed and referred to as ECDNN-SENAS-MOFL. SEANS is proposed to determine the delayed variables and network architecture efficiently, which allows significantly enhancing the evolutionary search efficiency than traditional evolutionary neural architecture search (ENAS) approaches by employing a surrogate model to achieve fast fitness evaluations. Meanwhile, MOFL is developed by embedding the federated learning into many-objective optimization to obtain more reliable network weights based on the distributed modeling data than traditional centralized learning and federated learning, as well as solving the problems of data privacy protection and data islands. Furthermore, selective ensemble learning is introduced to build high-performance ensemble WPF model by combining the merits of multiple highly influential Pareto solutions. The effectiveness and superiority of the proposed ECDNN-SENAS-MOFL method are verified using an actual wind power dataset. The application results show that the proposed method can provide new insights into data-driven WPF modeling and has a great potential for practical applications.

Multi-objective evolutionary neural architecture search for network intrusion detection

Network Intrusion Detection (NID) becomes significantly important for protecting the security of information systems, as the frequency and complexity of network attacks are increasing with the rapid development of the Internet. Recent research studies have proposed various neural network models for NID, but they need to manually design the network architectures based on expert knowledge, which is very time-consuming. To solve this problem, this paper proposes a Multi-objective Evolutionary Neural Architecture Search (MENAS) method, which can automatically design neural network models for NID. First, a comprehensive search space is designed and then a weight-sharing mechanism is used to construct a supernet for NID, allowing each subnet to inherit weights from the supernet for direct performance evaluation. Subsequently, the subnets are encoded as chromosomes for multi-objective evolutionary search, which simultaneously optimizes two objectives: enhancing the model’s detection performance and reducing its complexity. To improve the search capability, a path-based crossover method is designed, which can iteratively refine the subnets’ architectures by simultaneously optimizing their accuracy and complexity for NID. At last, our MENAS method has been validated through extensive experiments on three well-known NID datasets: NSL-KDD, UNSW-NB15, and CICIDS2017. The experiments show that our MENAS method obtains an average 1.45% improvement on accuracy and an average 68.70% reduction on floating-point operations through multi-objective optimization process on six scenarios, which outperforms some state-of-the-art NID methods.

Comparative Analysis of Solar Radiation Forecasting Techniques in Zacatecas, Mexico

This work explores the prediction of daily Global Horizontal Irradiance (GHI) patterns in the region of Zacatecas, Mexico, using a diverse range of predictive models, encompassing traditional regressors and advanced neural networks like Evolutionary Neural Architecture Search (ENAS), Convolutional Neural Networks (CNN), Recurrent Neural Networks (RNN), and Meta’s Prophet. This work addressing a notable gap in regional research, and aims to democratize access to accurate solar radiation forecasting methodologies. The evaluations carried out using the time series data obtained by Comisión Nacional del Agua (Conagua) covering the period from 2015 to 2018 reveal different performances of the model in different sky conditions, showcasing strengths in forecasting clear and partially cloudy days while encountering challenges with cloudy conditions. Overall, correlation coefficients (r) ranged between 0.55 and 0.72, with Root Mean Square Error % (RMSE %) values spanning from 20.05% to 20.54%, indicating moderate to good predictive accuracy. This study underscores the need for longer datasets to bolster future predictive capabilities. By democratizing access to these predictive tools, this research facilitates informed decision-making in renewable energy planning and sustainable development strategies tailored to the unique environmental dynamics of the region of Zacatecas and comparable regions.

Highly parallelized laboratory evolution of wine yeasts for enhanced metabolic phenotypes

Adaptive Laboratory Evolution (ALE) of microorganisms can improve the efficiency of sustainable industrial processes important to the global economy. However, stochasticity and genetic background effects often lead to suboptimal outcomes during laboratory evolution. Here we report an ALE platform to circumvent these shortcomings through parallelized clonal evolution at an unprecedented scale. Using this platform, we evolved 104 yeast populations in parallel from many strains for eight desired wine fermentation-related traits. Expansions of both ALE replicates and lineage numbers broadened the evolutionary search spectrum leading to improved wine yeasts unencumbered by unwanted side effects. At the genomic level, evolutionary gains in metabolic characteristics often coincided with distinct chromosome amplifications and the emergence of side-effect syndromes that were characteristic of each selection niche. Several high-performing ALE strains exhibited desired wine fermentation kinetics when tested in larger liquid cultures, supporting their suitability for application. More broadly, our high-throughput ALE platform opens opportunities for rapid optimization of microbes which otherwise could take many years to accomplish.

Modeling and identification of hysteresis of marine damper considering shock environment based on evolutionary sparrow search algorithm

The mechanical properties of marine dampers are usually highly nonlinear in order to adapt to dynamic and shock environments. The dampers are subjected to dynamic and shock tests and the hysteresis curves are found to be rate-dependent and asymmetric. To be able to describe the dynamic hysteresis and shock hysteresis, a rate-dependent generalized Prandtl-Ishlinskii (RDGPI) model is proposed based on the generalized Prandtl-Ishlinskii (GPI) model, which is a hybrid of the GPI model and the radial basis function (RBF) neural network. Due to the large number of parameters in the model, thus aiming to improve the effect of parameter identification, an evolutionary sparrow search algorithm mixed with sparrow search algorithm and differential evolutionary algorithm is proposed. Compared with other algorithms, sparrow search algorithm is verified to have ideal optimization effect and convergence speed, and it is not easy to fall into the local optimum. Finally, the RDGPI model is experimentally verified, and the results show that the prediction error of the RDGPI model for dynamic hysteresis is within 0.06 kN, and the prediction error for shock hysteresis is within 0.8 kN, which is capable of describing the rate-dependent characteristics of the damper hysteresis. And it has a very good generalization ability, which makes it very suitable to be used in the modeling of the mechanical characteristics of the marine damper.

A bi-evolutionary cooperative multi-objective algorithm for blocking group flow shop with outsourcing option

In this study, a multi-objective blocking group flow shop scheduling problem with outsourcing option (BGFSP_OO) is addressed, where three objectives, including makespan, total energy consumption (TEC) and outsourcing cost, are considered simultaneously. To solve the BGFSP_OO, a bi-evolutionary cooperative multi-objective algorithm (BECMOA) is proposed. First, a machine switching strategy based on machine idle and blocking time is used in the decoding part to optimize the objective value TEC. Then, an effective heuristic for classifying outsourcing groups is proposed. To balance convergence and diversity abilities, a bi-evolutionary mechanism is proposed. The particle swarm optimization algorithm based on the gravity factor (IPSO) is employed, which exploiting individual performance, can enhance the convergence ability. Cross evolutionary search (CES) strategy is developed which can improve search ability, aiming to ensure diversity of solutions and access to more non-dominated solutions. Finally, the experimental results show that BECMOA is effective in solving BGFSP_OO compared to the state-of-the-art methods.

Evolving Novel Gene Regulatory Networks for Structural Engineering Designs.

Engineering design optimization poses a significant challenge, usually requiring human expertise to discover superior solutions. Although various search techniques have been employed to generate diverse designs, their effectiveness is often limited by problem-specific parameter tuning, making them less generalizable and scalable. This article introduces a framework inspired by evolutionary and developmental (evo-devo) concepts, aiming to automate the evolution of structural engineering designs. In biological systems, evo-devo governs the growth of single-cell organisms into multicellular organisms through the use of gene regulatory networks (GRNs). GRNs are inherently complex and highly nonlinear, and this article explores the use of neural networks and genetic programming as artificial representations of GRNs to emulate such behaviors. To evolve a wide range of Pareto fronts for artificial GRNs, this article introduces a new technique, a real value-encoded neuroevolutionary method termed real-encoded NEAT (RNEAT). The performance of RNEAT is compared with that of two well-known evolutionary search techniques across different 2-D and 3-D problems. The experimental results demonstrate two key findings. First, the proposed framework effectively generates a population of GRNs that can produce diverse structures for both 2-D and 3-D problems. Second, the proposed RNEAT algorithm outperforms its competitors on more than 50% of the problems examined. These results validate the proof of concept underlying the proposed evo-devo-based engineering design evolution.

Multi-Task Multi-Objective Evolutionary Search Based on Deep Reinforcement Learning for Multi-Objective Vehicle Routing Problems with Time Windows

The vehicle routing problem with time windows (VRPTW) is a widely studied combinatorial optimization problem in supply chains and logistics within the last decade. Recent research has explored the potential of deep reinforcement learning (DRL) as a promising solution for the VRPTW. However, the challenge of addressing the VRPTW with many conflicting objectives (MOVRPTW) still remains for DRL. The MOVRPTW considers five conflicting objectives simultaneously: minimizing the number of vehicles required, the total travel distance, the travel time of the longest route, the total waiting time for early arrivals, and the total delay time for late arrivals. To tackle the MOVRPTW, this study introduces the MTMO/DRP-AT, a multi-task multi-objective evolutionary search algorithm, by making full use of both DRL and the multitasking mechanism. In the MTMO/DRL-AT, a two-objective MOVRPTW is constructed as an assisted task, with the objectives being to minimize the total travel distance and the travel time of the longest route. Both the main task and the assisted task are simultaneously solved in a multitasking scenario. Each task is decomposed into scalar optimization subproblems, which are then solved by an attention model trained using DRL. The outputs of these trained models serve as the initial solutions for the MTMO/DRL-AT. Subsequently, the proposed algorithm incorporates knowledge transfer and multiple local search operators to further enhance the quality of these promising solutions. The simulation results on real-world benchmarks highlight the superior performance of the MTMO/DRL-AT compared to several other algorithms in solving the MOVRPTW.

Improving quality of service for Internet of Things(IoT) in real life application: A novel adaptation based Hybrid Evolutionary Algorithm

In this paper, we address critical challenges in IoT sensor lifespan, service latency, and coverage area, all impacting energy consumption in smart agriculture applications. To enhance the quality of service (QoS) while prolonging the energy efficiency of smart sensors, a novel optimization algorithm is introduced. Referred to as the ”Adaptation-Based Hybrid Evolutionary Algorithm,” this innovative approach combines the strengths of Grey Wolf Optimizers (GWO) and Differential Evolution (DE) algorithms. The methodology involves a new adaptation-based strategy and incorporates a hybrid algorithm that synergizes the exploratory and exploitative capabilities of both GWO and DE algorithms. This hybrid approach is leveraged to meticulously select optimal mutation new adaptation services, drawing from the GWO and DE algorithm frameworks. Notably, the algorithm’s control parameters autonomously adjust through insights gained from prior evolutionary searches. Furthermore, we enhance the DE-based crossover technique by integrating the proficient search capabilities of the GWO algorithm, renowned for tackling continuous global optimization problems. To validate our approach, we apply it to IoT scenarios and optimize QoS through a fitness function that comprehensively accounts for energy consumption, coverage rate, lifespan, and latency. Comparative evaluations against standard algorithms underscore the superior performance of our proposed methodology, particularly evident in its application to IoT-smart agriculture settings.

Graph-Based Evolutionary Search for Optimal Hybrid Modularization of Building Construction Projects

Graph-Based Evolutionary Search for Optimal Hybrid Modularization of Building Construction Projects