Pigeon Inspired Optimization of Bayesian Network Structure Learning and a Comparative Evaluation
Bayesian networks are useful analytical models for designing the structure of knowledge in machine learning. Probabilistic dependency relationships among the variables can be represented by Bayesian networks. One strategy of a structure learning Bayesian Networks is the score and search technique. In this paper, we present a new method for structure learning of the Bayesian network which is based on Pigeon Inspired Optimization (PIO) Algorithm. The proposed algorithm is a simple one with fast convergence rate. In nature, the navigational ability of pigeons is unbelievable and highly impressive. In accordance with the PIO search algorithm, a set of directed acyclic graphs is defined. Every graph owns a score which shows its fitness. The algorithm is iterated until it gets the best solution or a satisfactory network structure using map and compass, and landmark operator. In this work, the proposed method compared with Simulated Annealing, Bee optimization and Simulated Annealing as a hybrid algorithm, Bee optimization and Greedy search as a hybrid algorithm, and Greedy Search using BDeu score function. We also investigated the confusion matrix performances of the methods. The paper presents the results of extensive evaluations of these algorithms based on common benchmark data sets. The results indicate that the proposed algorithm has better performance than the other algorithms and produces higher scores and accuracy values.
- Research Article
5
- 10.7494/csci.2021.22.4.3773
- Nov 23, 2021
- Computer Science
In machine-learning, one of the useful scientific models for producing the structure of knowledge is Bayesian network, which can draw probabilistic dependency relationships between variables. The score and search is a method used for learning the structure of a Bayesian network. The authors apply the Falcon Optimization Algorithm (FOA) as a new approach to learning the structure of Bayesian networks. This paper uses the Reversing, Deleting, Moving and Inserting operations to adopt the FOA for approaching the optimal solution of Bayesian network structure. Essentially, the falcon prey search strategy is used in the FOA algorithm. The result of the proposed technique is compared with Pigeon Inspired optimization, Greedy Search, and Simulated Annealing using the BDeu score function. The authors have also examined the performances of the confusion matrix of these techniques utilizing several benchmark data sets. As shown by the evaluations, the proposed method has more reliable performance than the other algorithms including producing better scores and accuracy values.
- Research Article
18
- 10.4018/ijsir.2020040102
- Apr 1, 2020
- International Journal of Swarm Intelligence Research
Bayesian networks are useful analytical models for designing the structure of knowledge in machine learning. Bayesian networks can represent probabilistic dependency relationships among the variables. One strategy of Bayesian Networks structure learning is the score and search technique. The authors present the Elephant Swarm Water Search Algorithm (ESWSA) as a novel approach to Bayesian network structure learning. In the algorithm; Deleting, Reversing, Inserting, and Moving are used to make the ESWSA for reaching the optimal structure solution. Mainly, water search strategy of elephants during drought periods is used in the ESWSA algorithm. The proposed method is compared with simulated annealing and greedy search using BDe score function. The authors have also investigated the confusion matrix performances of these techniques utilizing various benchmark data sets. As presented by the results of the evaluations, the proposed algorithm has better performance than the other algorithms and produces better scores and accuracy values.
- Book Chapter
19
- 10.4018/978-1-7998-3222-5.ch008
- Jan 1, 2020
Bayesian networks are useful analytical models for designing the structure of knowledge in machine learning which can represent probabilistic dependency relationships among the variables. The authors present the Elephant Swarm Water Search Algorithm (ESWSA) for Bayesian network structure learning. In the algorithm; Deleting, Reversing, Inserting, and Moving are used to make the ESWSA for reaching the optimal structure solution. Mainly, water search strategy of elephants during drought periods is used in the ESWSA algorithm. The proposed method is compared with Pigeon Inspired Optimization, Simulated Annealing, Greedy Search, Hybrid Bee with Simulated Annealing, and Hybrid Bee with Greedy Search using BDeu score function as a metric for all algorithms. They investigated the confusion matrix performances of these techniques utilizing various benchmark data sets. As presented by the results of evaluations, the proposed algorithm achieves better performance than the other algorithms and produces better scores as well as the better values.
- Research Article
30
- 10.1108/aeat-05-2014-0073
- Jan 4, 2016
- Aircraft Engineering and Aerospace Technology
Purpose – The purpose of this paper is to propose a novel concept of model prediction control (MPC) parameter optimization method, which is based on pigeon-inspired optimization (PIO) algorithm, with the objective of optimizing the unmanned air vehicles (UAVs) controller design progress. Design/methodology/approach – The PIO algorithm is proposed for parameter optimization in MPC, which provides a new method to get the optimal parameter. Findings – The PIO algorithm is a new swarm optimization method, which consists of two operators, so it can be better adapted for the optimal problems. The comparative consequences results with the particle swarm optimization (PSO) demonstrate the effectiveness of the PIO algorithm, and the superiority for global search is also verified in various cases. Practical implications – PIO algorithm can be easily applied to practice and help the parameter optimization of the MPC. Originality/value – In this paper, we first present the concept of using the PIO algorithm for param...
- Research Article
64
- 10.1016/j.swevo.2019.04.002
- Apr 9, 2019
- Swarm and Evolutionary Computation
Discrete pigeon-inspired optimization algorithm with Metropolis acceptance criterion for large-scale traveling salesman problem
- Conference Article
1
- 10.1109/icc47138.2019.9123217
- Dec 1, 2019
The pigeon inspired optimization (PIO) is a metaheuristic algorithm which finds an optimal solution in the complex search spaces using homing behavior of pigeons. PIO algorithm has been applied to solve various optimization problems in different domains and is empirically shown to perform well. However, the convergence of this algorithm has not been established analytically in the literature. In this paper, the update equations of PIO algorithm are regarded as a discrete time-varying system and its convergence is analysed. This paper attempts to establish the convergence of PIO algorithm using two methods. The first method uses the state transition matrix approach and the second method is based on showing the convergence using the solution of linear discrete time-varying systems. Further, the appropriate choice of the parameter in PIO algorithm and its influence on the convergence of the algorithm is also discussed.
- Research Article
3
- 10.1360/sst-2021-0371
- Aug 3, 2022
- SCIENTIA SINICA Technologica
<p indent="0mm">A generalized pigeon-inspired optimization (GPIO) algorithm for balancing the exploration and exploitation abilities is proposed herein. The traditional pigeon-inspired optimization algorithm includes two operators, namely the map and compass operator and the landmark operator. These two operators are implemented only for one round at a single run. In the GPIO algorithm, the search process is divided into multiple stages, and two operators are implemented in each stage. These two operators are implemented for multiple rounds at one single run. The map and compass operator focuses on the exploration ability, while the landmark operator focuses on the exploitation ability. The GPIO algorithm changes the execution order of the two operators without additional objective function evaluation. Moreover, the structure of the solutions and the parameter settings are extended in the GPIO algorithm, which is beneficial to search quality improvement. The simulation results show that the GPIO algorithm improves the search efficiency and the search results of the algorithm.
- Research Article
12
- 10.1108/aeat-01-2015-0020
- Oct 2, 2017
- Aircraft Engineering and Aerospace Technology
PurposeThe purpose of this paper is to propose an improved optimization method for image matching problem, which is based on multi-scale Gaussian mutation pigeon-inspired optimization (MGMPIO) algorithm, with the objective of accomplishing the complicated image matching quickly.Design/methodology/approachThe hybrid model of multi-scale Gaussian mutation (MGM) mechanism and pigeon-inspired optimization (PIO) algorithm is established for image matching problem. The MGM mechanism is a nonlinear model, which can adjust the position of pigeons by mutation operation. In addition, the variable parameter (VP) mechanism is exploited to adjust the map and compass factor of the original PIO. Low-cost quadrotor, a type of electric multiple rotorcraft, is used as a carrier of binocular camera to obtain the images.FindingsThis work improved the PIO algorithm by modifying the search strategy and adding some limits, so that it can have better performance when applied to the image matching problem. Experimental results show that the proposed method demonstrates satisfying performance in convergence speed, robustness and stability.Practical implicationsThe proposed MGMPIO algorithm can be easily applied to solve practical problems and accelerate convergence speed of the original PIO, and thus enhancing the speed of matching process, which will considerably increase the effectiveness of algorithm.Originality/valueA hybrid model of the MGM mechanism and PIO algorithm is proposed for image matching problem. The VP mechanism and low-cost quadrotor is also utilized in image matching problem.
- Research Article
15
- 10.1108/aeat-01-2015-0007
- May 2, 2017
- Aircraft Engineering and Aerospace Technology
PurposeThe purpose of this paper is to propose a new approach for aerodynamic parameter identification of hypersonic vehicles, which is based on Pigeon-inspired optimization (PIO) algorithm, with the objective of overcoming the disadvantages of traditional methods based on gradient such as New Raphson method, especially in noisy environment.Design/methodology/approachThe model of hypersonic vehicles and PIO algorithm is established for aerodynamic parameter identification. Using the idea, identification problem will be converted into the optimization problem.FindingsA new swarm optimization method, PIO algorithm is applied in this identification process. Experimental results demonstrated the robustness and effectiveness of the proposed method: it can guarantee accurate identification results in noisy environment without fussy calculation of sensitivity.Practical implicationsThe new method developed in this paper can be easily applied to solve complex optimization problems when some traditional method is failed, and can afford the accurate hypersonic parameter for control rate design of hypersonic vehicles.Originality/valueIn this paper, the authors converted this identification problem into the optimization problem using the new swarm optimization method – PIO. This new approach is proved to be reasonable through simulation.
- Book Chapter
3
- 10.1007/978-981-19-9198-1_31
- Jan 1, 2022
By learning behavioral characteristics and biological phenomena in nature, such as birds, ants, and fireflies, intelligent optimization algorithms (IOA) is proposed. IOA shows feasibility in solving complex optimization problems in reality. Pigeon-inspired optimization (PIO) algorithm, which belongs to intelligent optimization algorithms, is proposed by the pigeons homing navigation behavior inspired. PIO is superior to other algorithms in dealing with many optimization problems. However, the performance of PIO processing large-scale complex optimization problems is poor and the execution time is long. Population-based optimization algorithms (such as PIO) can be optimized by parallel processing, which enables PIO to be implemented in hardware for improving execution times. This paper proposes a hardware modeling method of PIO based on FPGA. The method focuses on the parallelism of multi-individuals and multi-dimensions in pigeon population. For further acceleration, this work uses parallel bubble sort algorithm and multiply-and-accumulator (MAC) pipeline design. The simulation result shows that the implementation of PIO based on FPGA can effectively improve the computing capability of PIO and deal with complex practical problems.KeywordsIntelligent optimization algorithmPigeon-inspired optimizationFPGA
- Research Article
10
- 10.1007/s11431-016-6048-8
- May 3, 2016
- Science China Technological Sciences
In this paper, a novel approach is proposed for solving the parameter design problem of brushless direct current (BLDC) motor, which is based on the membrane computing (MC) and pigeon-inspired optimization (PIO) algorithm. The motor parameter design problem is converted to an optimization problem with five design parameters and six constraints. The PIO algorithm is introduced into the framework of MC for improving the global convergence performance. The hybrid algorithm can improve the population diversity with better searching efficiency. Comparative simulations are conducted, and comparative results are given to show the feasibility and effectiveness of our proposed hybrid algorithm for high nonlinear optimization problems.
- Book Chapter
1
- 10.5772/intechopen.99881
- Jan 26, 2022
Pigeon Inspired Optimization (PIO) algorithm is gaining popularity since its development due to faster convergence ability with great efficiencies when compared with other bio-inspired algorithms. The navigation capability of homing pigeons has been precisely used in Pigeon Inspired Optimization algorithm and continuous advancement in existing algorithms is making it more suitable for complex optimization problems in various fields. The main theme of this survey paper is to introduce the basics of PIO along with technical advancements of PIO for the motion planning techniques of dynamic agents. The survey also comprises of findings and limitations of proposed work since its development to help the research scholar around the world for particular algorithm selection especially for motion planning. This survey might be extended up to application based in order to understand the importance of algorithm in future studies.
- Research Article
5
- 10.3390/electronics13050886
- Feb 26, 2024
- Electronics
In this paper, a fault recovery strategy for a distribution network based on a pigeon-inspired optimization (PIO) algorithm is proposed to improve the recoverability of the network considering the increased proportion of distributed energy resources. First, an improved Kruskal algorithm-based island partitioning scheme is proposed considering the electrical distance and important load level during the island partitioning process. Secondly, a mathematical model of fault recovery is established with the objectives of reducing active power losses and minimizing the number of switching actions. The conventional PIO algorithm is improved using chaos, reverse strategy, and Cauchy perturbation strategy, and the improved pigeon-inspired optimization (IPIO) algorithm is applied to solve the problem of fault recovery of the distribution network. Finally, simulation analysis is carried out to verify the effectiveness of the proposed PIO algorithm considering a network restauration problem after fault. The results show that compared with traditional algorithms, the proposed PIO algorithm has stronger global search capability, effectively improving the node voltage after restauration and reducing circuit loss.
- Book Chapter
2
- 10.1007/978-981-15-3425-6_15
- Jan 1, 2020
In recent years, many population-based swarm intelligence (SI) algorithms have been developed for solving optimization problems. The pigeon-inspired optimization (PIO) algorithm is one new method that is considered to be a balanced combination of global and local search by the map and compass operator and the landmark operator. In this paper, we propose a novel method of adaptive nonlinear inertia weight along with the velocity in order to improve the convergence speed. Additionally, the one-dimension modification mechanism is introduced during the iterative process, which aims to avoid the loss of good partial solutions because of interference phenomena among the dimensions. For separable functions, the one-dimension modification mechanism is more effective for the search performance. Our approach effectively combines the method of adaptive inertia weight with the strategy of one-dimension modification, enhancing the ability to explore the search space. Comprehensive experimental results indicates that the proposed PIO outperforms the basic PIO, the other improved PIO and other improved SI methods in terms of the quality of the solution.
- Research Article
45
- 10.1016/j.jbi.2014.08.010
- Aug 30, 2014
- Journal of Biomedical Informatics
SAGA: A hybrid search algorithm for Bayesian Network structure learning of transcriptional regulatory networks