Large-scale Multi-objective Optimization Problems Research Articles

Joint UAV Deployment and Task Offloading in Large-Cale UAV-Assisted MEC: A Multiobjective Evolutionary Algorithm

With the development of digital economy technologies, mobile edge computing (MEC) has emerged as a promising computing paradigm that provides mobile devices with closer edge computing resources. Because of high mobility, unmanned aerial vehicles (UAVs) have been extensively utilized to augment MEC to improve scalability and adaptability. However, with more UAVs or mobile devices, the search space grows exponentially, leading to the curse of dimensionality. This paper focus on the combined challenges of the deployment of UAVs and the task of offloading mobile devices in a large-scale UAV-assisted MEC. Specifically, the joint UAV deployment and task offloading problem is first modeled as a large-scale multiobjective optimization problem with the purpose of minimizing energy consumption while improving user satisfaction. Then, a large-scale UAV deployment and task offloading multiobjective optimization method based on the evolutionary algorithm, called LDOMO, is designed to address the above formulated problem. In LDOMO, a CSO-based evolutionary strategy and a MLP-based evolutionary strategy are proposed to explore solution spaces with different features for accelerating convergence and maintaining the diversity of the population, and two local search optimizers are designed to improve the quality of the solution. Finally, simulation results show that our proposed LDOMO outperforms several representative multiobjective evolutionary algorithms.

A space sampling based large-scale many-objective evolutionary algorithm

Large-scale multiobjective optimization problems have attracted increasing attention in both engineering applications and scientific research. Academically, large-scale multiobjective problems involve hundreds or thousands of decision variables. Due to the large decision space, the performance of traditional multiobjective evolutionary algorithms decreases dramatically when dealing with large-scale multiobjective problems, especially many-objective problems. With this in mind, a space sampling based large-scale many-objective evolutionary algorithm (LSMaOEA) is proposed in this article. Specifically, a space sampling method is developed that alternately performs upper/lower-linkage sampling and individual-linkage sampling to sample a set of individuals in the decision space. An environmental selection strategy based on nondominated sorting and reference vector association is proposed. Thus, the proposed LSMaOEA can alleviate excessively dense sampling at boundaries and improve the diversity of existing space sampling based algorithms for large-scale many-objective problems. In the experiments, the proposed algorithm is assessed by comparing it with eight state-of-the-art multi/many-objective evolutionary algorithms. The evaluation is conducted using two popular indicators across nine challenging multiobjective optimization benchmark problems with up to 2000 decision variables. The extensive experimental results consistently reveal that the proposed algorithm outperforms all the compared algorithms.

A multi-population multi-stage adaptive weighted large-scale multi-objective optimization algorithm framework

Weighted optimization framework (WOF) achieves variable dimensionality reduction by grouping variables and optimizing weights, playing an important role in large-scale multi-objective optimization problems. However, because of possible problems such as duplicate weight vectors in the selection process and loss of population diversity, the algorithm is susceptible to local optimization. Therefore, this paper develops an algorithm framework called multi-population multi-stage adaptive weighted optimization (MPSOF) to improve the performance of WOF in two aspects. First, the method of using multi-population is employed to address the issue of insufficient algorithmic diversity, while simultaneously reducing the likelihood of converging towards local optima. Secondly, a processing stage is incorporated into MPSOF, where a certain number of individuals are adaptively selected for updating based on the weight information and evolutionary status of different subpopulations, targeting different types of weights. This approach alleviates the impact of repetitive weights on the diversity of newly generated individuals, avoids the drawback of easily converging to local optima when using a single type of weight for updating, and effectively balances the diversity and convergence of subpopulations. Experiments of three types designed on several typical function sets demonstrate that MPSOF exceeds the comparison algorithms in the three metrics for Inverse Generation Distance, Hypervolume and Spacing.

An improved problem transformation algorithm for large-scale multi-objective optimization

Solving Large-Scale Multi-Objective Optimization Problems (LSMOPs) is the major challenge in evolution computation. Due to the large number of decision variables involved, it is not easy for existing multi-objective evolutionary algorithms to search the entire decision variable space with limited computation resources. To address the above problem, a large-scale multi-objective evolutionary algorithm based on problem transformation, called LSMOEA/PT, is presented in this paper. LSMOEA/PT uses an improved problem transformation strategy to transform LSMOPs into small-scale multi-objective problems to accelerate convergence speed and reduce computational resources. Specifically, The transformation strategy selects reference solutions to initialize a weight population by applying the opposite individual method. After optimizing the weight population, a dual line strategy is implemented to combine the weight vectors with the decision variables from the original population, thereby generating a new population. The new population is combined with the original population for environment selection. In LSMOEA/PT, a double learning swarm optimizer is introduced to speed up the convergence of the population. A uniform distribution strategy is conducted to update transformed solutions after the problem transformation process, increasing the diversity of the population. Experimental results show that LSMOEA/PT is competitive with eleven state-of-the-art algorithms on large-scale multi-objective optimization test problems with up to 2000 decision variables.

Improving two-layer encoding of evolutionary algorithms for sparse large-scale multiobjective optimization problems

Sparse large-scale multiobjective problems (LSMOPs) are characterized as an NP-hard issue that undergoes a significant presence of zero-valued variables in Pareto optimal solutions. In solving sparse LSMOPs, recent studies typically employ a specialized two-layer encoding, where the low-level layer undertakes the optimization of zero variables and the high-level layer is in charge of non-zero variables. However, such an encoding usually puts the low-level layer in the first place and thus cannot achieve a balance between optimizing zero and non-zero variables. To this end, this paper proposes to build a two-way association between the two layers using a mutual preference calculation method and a two-way matching strategy. Essentially, the two-way association balances the influence of two layers on the encoded individual by relaxing the control of the low-level layer and enhancing the control of the high-level layer, thus reaching the balance between the optimizations of zero and non-zero variables. Moreover, we propose a new evolutionary algorithm equipped with the modules and compare it with several state-of-the-art algorithms on 32 benchmark problems. Extensive experiments verify its effectiveness, as the proposed modules can improve the two-layer encoding and help the algorithm achieve superior performance on sparse LSMOPs.

Neural Net-Enhanced Competitive Swarm Optimizer for Large-Scale Multiobjective Optimization.

The competitive swarm optimizer (CSO) classifies swarm particles into loser and winner particles and then uses the winner particles to efficiently guide the search of the loser particles. This approach has very promising performance in solving large-scale multiobjective optimization problems (LMOPs). However, most studies of CSOs ignore the evolution of the winner particles, although their quality is very important for the final optimization performance. Aiming to fill this research gap, this article proposes a new neural net-enhanced CSO for solving LMOPs, called NN-CSO, which not only guides the loser particles via the original CSO strategy, but also applies our trained neural network (NN) model to evolve winner particles. First, the swarm particles are classified into winner and loser particles by the pairwise competition. Then, the loser particles and winner particles are, respectively, treated as the input and desired output to train the NN model, which tries to learn promising evolutionary dynamics by driving the loser particles toward the winners. Finally, when model training is complete, the winner particles are evolved by the well-trained NN model, while the loser particles are still guided by the winner particles to maintain the search pattern of CSOs. To evaluate the performance of our designed NN-CSO, several LMOPs with up to ten objectives and 1000 decision variables are adopted, and the experimental results show that our designed NN model can significantly improve the performance of CSOs and shows some advantages over several state-of-the-art large-scale multiobjective evolutionary algorithms as well as over model-based evolutionary algorithms.

Objective contribution decomposition method and multi-population optimization strategy for large-scale multi-objective optimization problems

As problem complexity and data dimensionality increase, practical problems tend to have a large number of variables. Large-scale multi-objective optimization problems (LSMOPs) are a complex and difficult class of problems with numerous decision variables to be optimized. In addressing these problems using traditional evolutionary algorithms, achieving convergence is often difficult. The decomposition of decision variables and optimization is a more intuitive way to deal with this problem, which reduces the size of the problem to some extent. Thus, in this study, an objective contribution decomposition method and multi-population optimization strategy are proposed for handling LSMOPs. First, the decision variables are decomposed according to their contribution to the objectives. Further decomposition is performed based on the interactions among the decision variables. Then, multiple populations are generated to optimize the variable group and determine the information interaction among the subpopulations. In experimental results, the performance of the proposed algorithm was competitive in comparisons with six state-of-the-art algorithms.

Autoencoder evolutionary algorithm for large-scale multi-objective optimization problem

Autoencoder evolutionary algorithm for large-scale multi-objective optimization problem

A two-stage direction-guided evolutionary algorithm for large-scale multiobjective optimization

Large-scale multiobjective optimization problems (LSMOPs) have exponential growth in the search space as the decision variables increase, and the vast search space poses a challenge to the performance of multiobjective evolutionary algorithms (MOEAs). Many current large-scale MOEAs need to consume a large amount of computational resources to get good performance. This paper proposes a two-stage direction-guided evolutionary algorithm for large-scale multiobjective optimization (LMOEA-S2D) to balance the performance and computational resource overhead. The algorithm exploits the Pareto-optimality property of domination and the diversity-preserving property of decomposition to optimize the performance in the two stages, respectively, and designs a corresponding direction-guided mechanism to improve search efficiency. LMOEA-S2D designs global direction search and local direction search in the domination-based stage for efficient exploitation to accelerate population convergence. To promote greater population diversity, a hybrid direction search was devised to aid diversity exploration in the decomposition-based stage, and this facilitates even distribution of candidate solutions across the Pareto optimal frontier. LMOEA-S2D is compared with five state-of-the-art large-scale MOEAs on some large-scale multiobjective test suites with 100 to 5,000 decision variables. The experimental results show that LMOEA-S2D significantly outperformed all compared algorithms under limited computational resources.

Boosting scalability for large-scale multiobjective optimization via transfer weights

Large-scale multiobjective optimization problems (LSMOPs), which optimize multiple conflicting objectives with hundreds or even thousands of decision variables, demand increasing computational resources to assure satisfactory performance as the decision variables increase. Multiobjective evolutionary algorithms are naturally scalable, but as the dimension increases, the conflict between analyzing enough solutions and the limited number of function evaluations has hindered further improvements in scalability. In this paper, we first define the scalability of multiobjective evolutionary algorithms and design an indicator to quantitatively measure the scalability. Second, to boost scalability when solving LSMOPs, we propose a scalable multiobjective optimization algorithm by transferring weights between solutions to reduce dependency on ever-increasing computational resources as the problem dimension increases. The proposed framework entails constructing a latent decision space to determine evolutionary weights for chosen representative solutions. These computed weights are then transferred to the remaining solutions, enabling evolutionary optimization to proceed without requiring additional evaluations, even as the dimensionality increases. By utilizing the knowledge gained from the source solutions, each solution is customized with an evolutionary weight scheme that not only preserves computational resources but also enhances optimization performance, thereby boosting scalability. We have conducted experiments on LSMOPs to verify the effectiveness and scalability of the proposed algorithm. The proposed method outperforms selected state-of-the-art algorithms and gains scalability boosts in situations where the dimensions increase while the function evaluation remains constant.

Improved Evolutionary Operators for Sparse Large-Scale Multiobjective Optimization Problems

Many critical science, societal, and engineering fields contain large-scale multiobjective optimization problems (LSMOPs), comprised of many decision variables. However, as the number of decision variables increases, optimization algorithms face exponentially large search spaces, thereby exhibiting a degraded performance. Nonetheless, LSMOPs whose optimal solutions correspond to sparse variable vectors can be solved more efficiently by evolutionary multiobjective optimization (EMO) algorithms. Despite the great recent strides in developing generic EMO algorithms for sparse LSMOPs, there is still room for improvement. Specifically, algorithms still struggle to find convergent and diverse Pareto fronts in an acceptable amount of time when solving sparse LSMOPs with thousands of decision variables. To better solve sparse LSMOPs, we propose a novel set of evolutionary operators to adapt small-scale EMO algorithms for sparse LSMOPs. These simple, novel, and effective operators include varied striped sparse population sampling (VSSPS), sparse simulated binary crossover (S-SBX), and sparse polynomial mutation (S-PM). These operators, combined with NSGA-II, make the proposed S-NSGA-II algorithm. S-NSGA-II runs near-universally faster than existing methods for problems containing up to 6,400 decision variables, while performing as well as or better than contemporary sparse LSMOP algorithms with respect to hypervolume, especially with problems with larger than 5,000 decision variables.

A co-evolutionary algorithm based on sparsity clustering for sparse large-scale multi-objective optimization

Sparse large-scale multi-objective optimization problems (LSMOPs), which are characterized by high dimensional search space and sparse Pareto optimal solutions, have a widespread existence in academic research and practical applications. While the high dimensional decision space poses challenges to multi-objective evolutionary algorithms (MOEAs), the difficulty of solving sparse LSMOPs can be alleviated by utilizing the prior knowledge that the optimal solutions are sparse. In this paper, a co-evolutionary algorithm based on sparsity clustering, namely SCEA, is proposed, where the prior knowledge of sparse optimal solutions is utilized explicitly. At each generation, SCEA first calculates the current optimal sparsity by sparsity clustering. Then, SCEA divides the population into a winner subpopulation and two loser subpopulations. While the winner subpopulation reproduces offspring solutions by conventional genetic operators, the loser subpopulations generate offspring solutions along two competitive directions under the guidance of current optimal sparsity and variable importance. In the experiments, four state-of-the-art MOEAs are selected as the comparative algorithms. Experimental results show that the proposed algorithm is superior to the four competitors on both benchmark problems and practical applications, which include the sparse signal reconstruction problem, the community detection problem, and the instance selection problem.

Improving Performance Insensitivity of Large-Scale Multiobjective Optimization via Monte Carlo Tree Search.

The large-scale multiobjective optimization problem (LSMOP) is characterized by simultaneously optimizing multiple conflicting objectives and involving hundreds of decision variables. Many real-world applications in engineering can be modeled as LSMOPs; simultaneously, engineering applications require insensitivity in performance. This requirement typically means that the algorithm should not only produce good results in terms of performance for every run but also the performance of multiple runs should not fluctuate too much. However, existing large-scale multiobjective optimization algorithms often focus on improving algorithm performance, but pay little attention to improving the insensitivity characteristic of algorithms. This directly leads to substantial limitations when solving practical problems. In this work, we propose an evolutionary algorithm called large-scale multiobjective optimization algorithm via Monte Carlo tree search, which is based on the Monte Carlo tree search and aims to improve the performance and insensitivity of solving LSMOPs. The proposed method samples decision variables to construct new nodes on the Monte Carlo tree for optimization and evaluation, and it selects nodes with good evaluations for further searches in order to reduce the performance sensitivity caused by large-scale decision variables. We propose two metrics to measure the sensitivity of the algorithm and compare the proposed algorithm with several state-of-the-art designs on different benchmark functions and metrics. The experimental results confirm the effectiveness and performance insensitivity of the proposed design for solving LSMOPs.

A Large-Scale Multiobjective Particle Swarm Optimizer With Enhanced Balance of Convergence and Diversity.

Large-scale multiobjective optimization problems (LSMOPs) continue to be challenging for existing multiobjective evolutionary algorithms (MOEAs). The main difficulties are that: 1) the diversity preservation in both the objective space and the decision space needs to be taken into account when solving LSMOPs and 2) the existing learning structures in current MOEAs usually make the learning operators only coincidentally serve convergence and diversity, leading to difficulties in balancing these two factors. Therefore, balancing convergence and diversity in current MOEAs is difficult. To address these issues, this article proposes a multiobjective particle swarm optimizer with enhanced balance of convergence and diversity (MPSO-EBCD). In MPSO-EBCD, a novel velocity update structure for multiobjective particle swarm optimization is put forward, dividing the convergence, and diversity preservation operations into independent components. Following the proposed update structure, a weighted convergence factor is introduced to serve the convergence strategy, whilst a diversity preservation strategy is built to uniformly distribute the particles in the searched space based on a proposed multidimensional local sparseness degree indicator. By this means, MPSO-EBCD is able to balance convergence and diversity with specific parameters in independent operators. Experimental results on LSMOP benchmarks and a voltage transformer optimization problem demonstrate the competitiveness of the proposed algorithm compared to several state-of-the-art MOEAs.

Large-Scale Multiobjective Optimization via Reformulated Decision Variable Analysis

With the rising number of large-scale multiobjective optimization problems (LSMOPs) from academia and industries, some multiobjective evolutionary algorithms (MOEAs) with different decision variable handling strategies have been proposed. Decision variable analysis (DVA) is widely used in large-scale optimization, aiming at identifying the connection between each decision variable and the objectives, and grouping those interacting decision variables to reduce the complexity of LSMOPs. Despite their effectiveness, existing DVA techniques require the unbearable cost of function evaluations for solving LSMOPs. We propose a reformulation based approach for efficient DVA to address this deficiency. Then a large-scale MOEA is proposed based on reformulated DVA, namely LERD. Specifically, the DVA process is reformulated into an optimization problem with binary decision variables, aiming to approximate different grouping results. Afterwards, each group of decision variables is used for convergence-related or diversity-related optimization. The effectiveness and efficiency of the reformulation based DVA are validated by replacing the corresponding DVA techniques in two large-scale MOEAs. Experiments in comparison with six state-of-the-art large-scale MOEAs on LSMOPs with up to 2000 decision variables have shown the promising performance of LERD.

A fast interpolation-based multi-objective evolutionary algorithm for large-scale multi-objective optimization problems

A fast interpolation-based multi-objective evolutionary algorithm for large-scale multi-objective optimization problems

A problem transformation-based and decomposition-based evolutionary algorithm for large-scale multiobjective optimization

For large-scale multi-objective optimization problems, the search space becomes exceptionally vast, resulting in increased complexity in the search process. The search space usually contains several local optimal individuals, and the difficulty of finding the global optimal individuals increases greatly. A problem transformation-based and decomposition-based large-scale multi-objective evolutionary algorithm is proposed to solve the problem of reducing the dimensionality of the search space and the optimization of populations. Reducing the number of optimization problems in the decision space through problem transformation has lowered the complexity of multi-objective optimization problems and enhanced computational efficiency. In the decision space, employing two direction vectors adaptively guides the generation of promising individuals, thereby preventing the population from falling into local optima. Due to the dimensionality reduction of the decision space and the optimization of the individuals in the objective space, a set of optimal solutions are effectively obtained and uniformly distributed on the approximate Pareto optimal front. Experimental results show that the algorithm is highly competitive with five large-scale multi-objective evolutionary algorithms for large-scale multi-objective optimization test problems with up to 2000 decision variables.

Directed quick search guided evolutionary framework for large-scale multi-objective optimization problems

For large-scale multi-objective evolutionary algorithms (LSMOEAs), obtaining efficient evolutionary directions in an ultrahigh-dimensional decision space to produce high-quality offspring is a major challenge. This study proposes a novel framework called the directed quick search-guided large-scale evolutionary framework (QSLMOF) to address multi-objective optimization problems on a large scale. The framework contains two innovative strategies: the bidirectional vector-based sampling strategy (BDVS) and the quick search-guided directed reproduction strategy (QS-DRS). BDVS is introduced as an approach to swiftly discern promising solutions that can steer the exploration in the large-scale decision space. This is achieved by formulating two distinct types of sampling directions to rapidly reduce the search space and strike a delicate balance between convergence and diversity. In QS-DRS, we introduced the concept of the potential convergence gradient (PCG), incorporating directional information from historical searches and convergence directions indicated byelite solutions in the current population. With this property, inferior solutions can obtain excellent search directions to explore the decision space, which can improve the convergence rate and prevent the search from falling into a local optimum. The proposed large-scale evolutionary framework incorporates an existing environmental selection mechanism. Comprehensive experiments show that the two novel strategies improve the search efficiency and evolutionary quality of LSMOEAs in ultrahigh-dimensional decision spaces. Moreover, the proposed framework outperformed seven state-of-the-art LSMOEAs for nine large-scale multi-objective benchmark problems LSMOP1-LSMOP9 with up to three objectives and 10000 decision variables.

Competitive Decomposition-Based Multiobjective Architecture Search for the Dendritic Neural Model.

The dendritic neural model (DNM) is computationally faster than other machine-learning techniques, because its architecture can be implemented by using logic circuits and its calculations can be performed entirely in binary form. To further improve the computational speed, a straightforward approach is to generate a more concise architecture for the DNM. Actually, the architecture search is a large-scale multiobjective optimization problem (LSMOP), where a large number of parameters need to be set with the aim of optimizing accuracy and structural complexity simultaneously. However, the issues of irregular Pareto front, objective discontinuity, and population degeneration strongly limit the performances of conventional multiobjective evolutionary algorithms (MOEAs) on the specific problem. Therefore, a novel competitive decomposition-based MOEA is proposed in this study, which decomposes the original problem into several constrained subproblems, with neighboring subproblems sharing overlapping regions in the objective space. The solutions in the overlapping regions participate in environmental selection for the neighboring subproblems and then propagate the selection pressure throughout the entire population. Experimental results demonstrate that the proposed algorithm can possess a more powerful optimization ability than the state-of-the-art MOEAs. Furthermore, both the DNM itself and its hardware implementation can achieve very competitive classification performances when trained by the proposed algorithm, compared with numerous widely used machine-learning approaches.

MOCPSO: A multi-objective cooperative particle swarm optimization algorithm with dual search strategies

Particle swarm optimization (PSO) is a widely embraced meta-heuristic approach to tackling the complexities of multi-objective optimization problems (MOPs), renowned for its simplicity and swift convergence. However, when faced with large-scale multi-objective optimization problems (LSMOPs), most PSOs suffer from limited local search capabilities and insufficient randomness. This can result in suboptimal results, particularly in high-dimensional spaces. To address these issues, this paper introduces MOCPSO, a Multi-Objective Cooperative Particle Swarm Optimization Algorithm with Dual Search Strategies. MOCPSO incorporates a diversity search strategy (DSS) to augment perturbation and enhance the local search scope of particles, alongside a more convergent search strategy (CSS) to expedite particle convergence. Moreover, MOCPSO utilizes a three-category framework to effectively leverage the benefits of both DSS and CSS. Experimental results on benchmark LSMOPs with 500, 1000, and 2000 decision variables demonstrate that MOCPSO outperforms existing state-of-the-art large-scale multi-objective evolutionary algorithms on most test instances.