Abstract

Computational intelligence (CI), including artificial neural network, fuzzy logic, and evolutionary computation (EC), has rapidly developed nowadays. Especially, EC is a kind of algorithm for knowledge creation and problem solving, playing a significant role in CI and artificial intelligence (AI). However, traditional EC algorithms have faced great challenge of heavy computational burden and long running time in large-scale (e.g., with many variables) problems. How to efficiently extend EC algorithms to solve complex problems has become one of the most significant research topics in CI and AI communities. To this aim, this paper proposes a matrix-based EC (MEC) framework to extend traditional EC algorithms for efficiently solving large-scale or super large-scale optimization problems. The proposed framework is an entirely new perspective on EC algorithm, from the solution representation to the evolutionary operators. In this framework, the whole population (containing a set of individuals) is defined as a matrix, where a row stands for an individual and a column stands for a dimension (decision variable). This way, the parallel computing functionalities of matrix can be directly and easily carried out on the high performance computing resources to accelerate the computational speed of evolutionary operators. This paper gives two typical examples of MEC algorithms, named matrix-based genetic algorithm and matrix-based particle swarm optimization. Their matrix-based solution representations are presented and the evolutionary operators based on the matrix are described. Moreover, the time complexity is analyzed and the experiments are conducted to show that these MEC algorithms are efficient in reducing the computational time on large scale of decision variables. The MEC is a promising way to extend EC to complex optimization problems in big data environment, leading to a new research direction in CI and AI.

Highlights

  • C OMPUTATIONAL intelligence (CI) is a kind of biologically and linguistically motivated computational paradigm that mainly contains three branches as artificial neural network (ANN), logic inference, and evolutionary computation (EC), which has lots of overlaps with artificial intelligence (AI) [1]

  • The matrix-based EC (MEC) uses a matrix to represent the whole population of the algorithm, where a row stands for an individual and a column stands for a dimension

  • The time complexity analyses on both matrix-based GA (MGA) and matrix-based PSO (MPSO) show that MEC has greatly reduced the computational time of traditional EC algorithms, especially on very large-scale optimization problems

Read more

Summary

INTRODUCTION

C OMPUTATIONAL intelligence (CI) is a kind of biologically and linguistically motivated computational paradigm that mainly contains three branches as artificial neural network (ANN), logic inference, and evolutionary computation (EC), which has lots of overlaps with artificial intelligence (AI) [1]. Researchers have developed many ripe parallel routines for matrix operations on HPC resources like GPU, cloud computing platform, and supercomputing platform [44] This allows us to deploy the MEC to these HPC platforms naturally. The MEC is more suitable for population-based algorithm to solve large-scale or super large-scale optimization problems in shorter computational time This “EC-to-MEC” would be even more significant than that of “ANN-to-DNN” because EC algorithms are more suitable for optimization, knowledge creation, and problem solving, so that the MEC is a promising way to solve complex optimization problems in big data environment.

Representations and Notations
Common Operations
Representation and Initialization
Selection
Crossover
1: Generate a NC 2
Mutation
MATRIX-BASED PARTICLE SWARM OPTIMIZATION
Velocity and Position Update
Update of Personal and Global Best Positions
Time Complexity of Common Operators
26: End for 27: Output
Time Complexity of Matrix-Based Genetic Algorithm
Experimental Configurations
Comparisons on Problem-Solving Ability
Comparisons on Computational Speed
Discussion
CONCLUSION

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.