Gene-pool Optimal Mixing Evolutionary Algorithm Research Articles

A model-based evolutionary algorithm for home health care scheduling

In this paper, for the first time a model-based evolutionary algorithm is presented for a real-life Home Health Care Routing and Scheduling Problem (HHCRSP). The algorithm generates routes consisting of care activities jointly with the underlying shift schedule, while taking into account the qualification levels. The performance is optimized in terms of travel time, time window waiting time and shift overtime. The algorithm is a novel extension of the permutation Gene-Pool Optimal Mixing Evolutionary Algorithm. Numerical experiments, using real-life data, show that the algorithm performs close to optimal for small instances, and outperforms schedules from a case study, leading to efficiency gains of 41%. Furthermore, it is shown that the model-based evolutionary algorithm performs better than a more traditional evolutionary algorithm, which demonstrates the importance of learning and exploiting a model to guide the optimization in HHCRSP.

Uncrowded Hypervolume-Based Multiobjective Optimization with Gene-Pool Optimal Mixing.

Domination-based multiobjective (MO) evolutionary algorithms (EAs) are today arguably the most frequently used type of MOEA. These methods, however, stagnate when the majority of the population becomes nondominated, preventing further convergence to the Pareto set. Hypervolume-based MO optimization has shown promising results to overcome this. Direct use of the hypervolume, however, results in no selection pressure for dominated solutions. The recently introduced Sofomore framework overcomes this by solving multiple interleaved single-objective dynamic problems that iteratively improve a single approximation set, based on the uncrowded hypervolume improvement (UHVI). It thereby however loses many advantages of population-based MO optimization, such as handling multimodality. Here, we reformulate the UHVI as a quality measure for approximation sets, called the uncrowded hypervolume (UHV), which can be used to directly solve MO optimization problems with a single-objective optimizer. We use the state-of-the-art gene-pool optimal mixing evolutionary algorithm (GOMEA) that is capable of efficiently exploiting the intrinsically available grey-box properties of this problem. The resulting algorithm, UHV-GOMEA, is compared with Sofomore equipped with GOMEA, and the domination-based MO-GOMEA. In doing so, we investigate in which scenarios either domination-based or hypervolume-based methods are preferred. Finally, we construct a simple hybrid approach that combines MO-GOMEA with UHV-GOMEA and outperforms both.

Improving Model-Based Genetic Programming for Symbolic Regression of Small Expressions.

The Gene-pool Optimal Mixing Evolutionary Algorithm (GOMEA) is a model-based EA framework that has been shown to perform well in several domains, including Genetic Programming (GP). Differently from traditional EAs where variation acts blindly, GOMEA learns a model of interdependencies within the genotype, that is, the linkage, to estimate what patterns to propagate. In this article, we study the role of Linkage Learning (LL) performed by GOMEA in Symbolic Regression (SR). We show that the non-uniformity in the distribution of the genotype in GP populations negatively biases LL, and propose a method to correct for this. We also propose approaches to improve LL when ephemeral random constants are used. Furthermore, we adapt a scheme of interleaving runs to alleviate the burden of tuning the population size, a crucial parameter for LL, to SR. We run experiments on 10 real-world datasets, enforcing a strict limitation on solution size, to enable interpretability. We find that the new LL method outperforms the standard one, and that GOMEA outperforms both traditional and semantic GP. We also find that the small solutions evolved by GOMEA are competitive with tuned decision trees, making GOMEA a promising new approach to SR.

Achieving Highly Scalable Evolutionary Real-Valued Optimization by Exploiting Partial Evaluations.

It is known that to achieve efficient scalability of an Evolutionary Algorithm (EA), dependencies (also known as linkage) must be properly taken into account during variation. In a Gray-Box Optimization (GBO) setting, exploiting prior knowledge regarding these dependencies can greatly benefit optimization. We specifically consider the setting where partial evaluations are possible, meaning that the partial modification of a solution can be efficiently evaluated. Such problems are potentially very difficult, for example, non-separable, multimodal, and multiobjective. The Gene-pool Optimal Mixing Evolutionary Algorithm (GOMEA) can effectively exploit partial evaluations, leading to a substantial improvement in performance and scalability. GOMEA was recently shown to be extendable to real-valued optimization through a combination with the real-valued estimation of distribution algorithm AMaLGaM. In this article, we definitively introduce the Real-Valued GOMEA (RV-GOMEA), and introduce a new variant, constructed by combining GOMEA with what is arguably the best-known real-valued EA, the Covariance Matrix Adaptation Evolution Strategies (CMA-ES). Both variants of GOMEA are compared to L-BFGS and the Limited Memory CMA-ES (LM-CMA-ES). We show that both variants of RV-GOMEA achieve excellent performance and scalability in a GBO setting, which can be orders of magnitude better than that of EAs unable to efficiently exploit the GBO setting.

Fitness-Based Linkage Learning in the Real-Valued Gene-Pool Optimal Mixing Evolutionary Algorithm

The recently introduced real-valued gene-pool optimal mixing evolutionary algorithm (RV-GOMEA) has been shown to be among the state of the art for solving gray-box optimization problems where partial evaluations can be leveraged. A core strength is its ability to effectively exploit the linkage structure of a problem, which often is unknown a priori and has to be learned online. Previously published work on RV-GOMEA, however, demonstrated excellent scalability when the linkage structure is prespecified appropriately. A mutual information-based metric to learn linkage structure online, as commonly adopted in EDA's and the original discrete version of the gene-pool optimal mixing evolutionary algorithm, did not lead to similarly excellent results, especially in a black-box setting. In this article, the strengths of RV-GOMEA are combined with a new fitness-based linkage learning approach that is inspired by differential grouping that reduces its computational overhead by an order of magnitude for problems with fewer interactions. The resulting new version of RV-GOMEA achieves scalability similar to when a predefined linkage model is used, outperforming also, for the first time, the EDA AMaLGaM upon which it is partially based in a black-box setting where partial evaluations cannot be leveraged.

Fast and insightful bi-objective optimization for prostate cancer treatment planning with high-dose-rate brachytherapy

Purpose:Prostate high-dose-rate brachytherapy (HDR-BT) planning involves determining the movement that a high-strength radiation stepping source travels through the patient’s body, such that the resulting radiation dose distribution sufficiently covers tumor volumes and safely spares nearby healthy organs from radiation risks. The Multi-Objective Real-Valued Gene-pool Optimal Mixing Evolutionary Algorithm (MO-RV-GOMEA) has been shown to be able to effectively handle this inherent bi-objective nature of HDR-BT planning. However, in clinical practice there is a very restricted planning time budget (often less than 1 h) for HDR-BT planning, and a considerable amount of running time needs to be spent before MO-RV-GOMEA finds a good trade-off front of treatment plans (about20–30 min on a single CPU core) with sufficiently accurate dose calculations, limiting the applicability of the approach in the clinic. To address this limitation, we propose an efficiency enhancement technique for MO-RV-GOMEA solving the bi-objective prostate HDR-BT planning problem. Methods:Dose-Volume (DV) indices are often used to assess the quality of HDR-BT plans. The accuracy of these indices depends on the number of dose calculation points at which radiation doses are computed. These are randomly uniformly sampled inside target volumes and organs at risk. In available HDR-BT planning optimization algorithms, the number of dose calculation points is fixed. The more points are used, the better the accuracy of the obtained results will be, but also the longer the algorithms need to be run. In this work, we introduce a so-called multi-resolution scheme that gradually increases the number of dose calculation points during the optimization run such that the running time can be substantially reduced without compromising on the accuracy of the obtained results. Results and conclusion:Experiments on a data set of 18 patient cases show that with the multi-resolution scheme, MO-RV-GOMEA can achieve a sufficiently good trade-off front of treatment plans after five minutes of running time on a single CPU core (4–6 times faster than the old approach with a fixed number of dose calculation points). When the optimization with the multi-resolution scheme is run on a quad-core machine, five minutes are enough to obtain trade-off fronts that are nearly as good as those obtained by running optimization with the old approach in one hour (i.e., 12 times faster). This leaves ample time to perform the selection of the preferred treatment plan from the trade-off front for the specific patient at hand. Furthermore, comparisons with real clinical treatment plans, which were manually made by experienced BT planners within 30–60 min, confirm that the plans obtained by our approach are superior in terms of DV indices. These results indicate that our proposed approach has the potential to be employed in clinical practice.

Multi-objective Gene-pool Optimal Mixing Evolutionary Algorithm with the Interleaved Multi-start Scheme

The Multi-objective Gene-pool Optimal Mixing Evolutionary Algorithm (MO-GOMEA) has been shown to be a promising solver for multi-objective combinatorial optimization problems, obtaining an excellent scalability on both standard benchmarks and real-world applications. To attain optimal performance, MO-GOMEA requires its two parameters, namely the population size and the number of clusters, to be set properly with respect to the problem instance at hand, which is a non-trivial task for any EA practitioner. In this article, we present a new version of MO-GOMEA in combination with the so-called Interleaved Multi-start Scheme (IMS) for the multi-objective domain that eliminates the manual setting of these two parameters. The new MO-GOMEA is then evaluated on multiple benchmark problems in comparison with two well-known multi-objective evolutionary algorithms (MOEAs): Non-dominated Sorting Genetic Algorithm II (NSGA-II) and Multi-objective Evolutionary Algorithm Based on Decomposition (MOEA/D). Experiments suggest that MO-GOMEA with the IMS is an easy-to-use MOEA that retains the excellent performance of the original MO-GOMEA.

Application and benchmarking of multi-objective evolutionary algorithms on high-dose-rate brachytherapy planning for prostate cancer treatment

Abstract High-Dose-Rate (HDR) brachytherapy (BT) treatment planning involves determining an appropriate schedule of a radiation source moving through a patient's body such that target volumes are irradiated with the planning-aim dose as much as possible while healthy tissues (i.e., organs at risk) should not be irradiated more than certain thresholds. Such movement of a radiation source can be defined by so-called dwell times at hundreds of potential dwell positions, which must be configured to satisfy a clinical protocol of multiple different treatment criteria within a strictly-limited time frame of not more than one hour. In this article, we propose a bi-objective optimization model that intuitively encapsulates in two objectives the complicated high-dimensional multi-criteria nature of the BT treatment planning problem. The resulting Pareto-optimal fronts exhibit possible trade-offs between the coverage of target volumes and the sparing of organs at risk, thereby intuitively facilitating the decision-making process of treatment planners when creating a clinically-acceptable plan. We employ real medical data for conducting experiments and benchmark four different Multi-Objective Evolutionary Algorithms (MOEAs) on solving our problem: the Non-dominated Sorting Genetic Algorithm II (NSGA-II), the Multi-Objective Evolutionary Algorithm based on Decomposition (MOEA/D), the Multi-objective Adapted Maximum-Likelihood Gaussian Model Iterated Density-Estimation Evolutionary Algorithm (MAMaLGaM), and the recently-introduced Multi-Objective Real-Valued Gene-pool Optimal Mixing Evolutionary Algorithm (MO-RV-GOMEA). The variation operator that is specific to MO-RV-GOMEA enables performing partial evaluations to efficiently calculate objective values of offspring solutions without incurring the cost of fully recomputing the radiation dose distributions for new treatment plans. Experimental results show that MO-RV-GOMEA is the best performing MOEA that effectively exploits dependencies between decision variables to efficiently solve the multi-objective BT treatment planning problem.

Exploiting Linkage Information and Problem-Specific Knowledge in Evolutionary Distribution Network Expansion Planning.

This article tackles the Distribution Network Expansion Planning (DNEP) problem that has to be solved by distribution network operators to decide which, where, and/or when enhancements to electricity networks should be introduced to satisfy the future power demands. Because of many real-world details involved, the structure of the problem is not exploited easily using mathematical programming techniques, for which reason we consider solving this problem with evolutionary algorithms (EAs). We compare three types of EAs for optimizing expansion plans: the classic genetic algorithm (GA), the estimation-of-distribution algorithm (EDA), and the Gene-pool Optimal Mixing Evolutionary Algorithm (GOMEA). Not fully knowing the structure of the problem, we study the effect of linkage learning through the use of three linkage models: univariate, marginal product, and linkage tree. We furthermore experiment with the impact of incorporating different levels of problem-specific knowledge in the variation operators. Experiments show that the use of problem-specific variation operators is far more important for the classic GA to find high-quality solutions. In all EAs, the marginal product model and its linkage learning procedure have difficulty in capturing and exploiting the DNEP problem structure. GOMEA, especially when combined with the linkage tree structure, is found to have the most robust performance by far, even when an out-of-the-box variant is used that does not exploit problem-specific knowledge. Based on experiments, we suggest that when selecting optimization algorithms for power system expansion planning problems, EAs that have the ability to effectively model and efficiently exploit problem structures, such as GOMEA, should be given priority, especially in the case of black-box or grey-box optimization.