Using Covariance Matrix Adaptation Evolutionary Strategy to boost the search accuracy in hierarchic memetic computations

Abstract

Many global optimization problems arising naturally in science and engineering exhibit some form of intrinsic ill-posedness, such as multimodality and insensitivity. Severe ill-posedness precludes the use of standard regularization techniques and necessitates more specialized approaches, usually comprised of two separate stages – global phase, that determines the problem's modality and provides rough approximations of the solutions, and a local phase, which refines these approximations.In this work, we attempt to improve one of the most efficient currently known approaches - Hierarchic Memetic Strategy (HMS) - by incorporating the Covariance Matrix Adaptation Evolutionary Strategy (CMA-ES) into its local phase. CMA-ES is a stochastic optimization algorithm that in some sense mimics the behavior of population-based evolutionary algorithms without explicitly evolving the population. This way, it avoids, to an extent, the associated cost of multiple evaluations of the objective function.We compare the performance of the HMS on relatively simple multimodal benchmark problems and on an engineering problem. To do so, we consider two configurations: the CMA-ES and the standard SEA (Simple Evolutionary Algorithm). The results demonstrate that the HMS with CMA-ES in the local phase requires less objective function evaluations to provide the same accuracy, making this approach more efficient than the standard SEA.