Fuzzy-Rough Bireducts Algorithm Based on Particle Swarm Optimization
Fuzzy-Rough Bireducts Algorithm Based on Particle Swarm Optimization
- Research Article
1
- 10.4028/www.scientific.net/kem.413-414.661
- Jun 1, 2009
- Key Engineering Materials
In the context of real-world damage detection problems, the lack of a clear objective function advises to perform simultaneous optimizations of several objectives with the purpose of improving the performance of the procedure. Evolutionary algorithms have been considered to be particularly appropriate to these kinds of problems. However, evolutionary techniques require a relatively long time to obtain a Pareto front of high quality. Particle swarm optimization (PSO) is one of the newest techniques within the family of optimization algorithms. The PSO algorithm relies only on two simple PSO self-updating equations whose purpose is to try to emulate the best global individual found, as well as the best solutions found by each individual particle. Since an individual obtains useful information only from the local and global optimal individuals, it converges to the best solution quickly. PSO has become very popular because of its simplicity and convergence speed. However, there are many associated problems that require further study for extending PSO in solving multi-objective problems. The goal of this paper is to present the first application of PSO to multiobjective damage identification problems and investigate the applicability of several variations of the basic PSO technique. The potential of combining evolutionary computation and PSO concepts for damage identification problems is explored in this work by using a multiobjective evolutionary particle swarm optimization algorithm.
- Research Article
3
- 10.1051/e3sconf/201912525007
- Jan 1, 2019
- E3S Web of Conferences
The scope of this research is the use of artificial neural network models and meta-heuristic optimization of Particle Swarm Optimization (PSO) for the prediction of ambient air pollution parameter data at air quality monitoring stations in the city of Semarang, Central Java. The observed parameter is an indicator of ambient air quality, Suspended Particulate Matter (SPM). Based on air quality parameter data in previous times which is a time series data, modeling is done using Neural Networks (NN). Estimation of weights from NN is done using a hybrid method between meta-heuristic and gradient optimization. The meta-heuristic optimization method used is Particle Swarm Optimization (PSO) while the gradient based method is the Conjugate Gradient. Optimization with PSO is done first, then proceed with optimization using the Conjugate Gradient. Four scenarios of iteration selection at the PSO stage are 10, 25, 50 and 100. At the Conjugate Gradient, stage iteration is carried out up to 1000 epohs. The predicted results were compared with the PSOs and Conjugate Gradient respectively. The results show that the hybrid method provides better predictions. The number of iterations needed at the PSO stage is not too much so it is efficient in combining the two methods.
- Research Article
69
- 10.1016/j.eswa.2013.09.012
- Sep 17, 2013
- Expert Systems with Applications
A hybrid algorithm based on particle swarm and chemical reaction optimization
- Research Article
9
- 10.1108/ijicc-01-2014-0003
- Mar 9, 2015
- International Journal of Intelligent Computing and Cybernetics
Purpose – The purpose of this paper is to propose an algorithm that combines the particle swarm optimization (PSO) with the biogeography-based optimization (BBO) algorithm. Design/methodology/approach – The BBO and the PSO algorithms are jointly used in to order to combine the advantages of both algorithms. The efficiency of the proposed algorithm is tested using some selected standard benchmark functions. The performance of the proposed algorithm is compared with that of the differential evolutionary (DE), genetic algorithm (GA), PSO, BBO, blended BBO and hybrid BBO-DE algorithms. Findings – Experimental results indicate that the proposed algorithm outperforms the BBO, PSO, DE, GA, and the blended BBO algorithms and has comparable performance to that of the hybrid BBO-DE algorithm. However, the proposed algorithm is simpler than the BBO-DE algorithm since the PSO does not have complex operations such as mutation and crossover used in the DE algorithm. Originality/value – The proposed algorithm is a generic algorithm that can be used to efficiently solve optimization problems similar to that solved using other popular evolutionary algorithms but with better performance.
- Research Article
11
- 10.3390/math10193663
- Oct 6, 2022
- Mathematics
This paper focuses on the dynamic workforce scheduling and routing problem for the maintenance work of harvesters in a sugarcane harvesting operation. Technician teams categorized as mechanical, hydraulic, and electrical teams are assumed to have different skills at different levels to perform services. The jobs are skill-constrained and have time windows. During a working day, a repair request from a sugarcane harvester may arrive, and as time passes, the harvester’s position may shift to other sugarcane fields. We formulated this problem as a multi-visit and multi-period dynamic workforce scheduling and routing problem (MMDWSRP) and our study is the first to address the workforce scheduling and routing problem (WSRP). A mixed-integer programming formulation and a hybrid particle swarm and whale optimization algorithm (HPSWOA) were firstly developed to solve the problem, with the objective of minimizing the total cost, including technician labor cost, penalty for late service, overtime, travel, and subcontracting costs. The HPSWOA was developed for route planning and maintenance work for each mechanical harvester to be provided by technician teams. The proposed algorithm (HPSWOA) was validated against Lingo computational software using numerical experiments in respect of static problems. It was also tested against the current practice, the traditional whale optimization algorithm (WOA), and traditional particle swarm optimization (PSO) in respect of dynamic problems. The computational results show that the HPSWOA yielded a solution with significantly better quality. The HPSWO was also tested against the traditional genetic algorithm (GA), bat algorithm (BA), WOA, and PSO to solve the well-known CEC 2017 benchmark functions. The computational results show that the HPSWOA achieved more superior performance in most cases compared to the GA, BA, WOA, and PSO algorithms.
- Conference Article
7
- 10.2118/186024-ms
- May 5, 2017
In this paper we present an enhanced and new optimization algorithm based on Particle Swarm Optimization (PSO) that can be used in reservoir characterization applications to determine multiple solutions that reproduce measurements within satisfactory accuracy. The method is illustrated on a history-matching problem where significant speed-up is obtained with respect to a standard PSO implementation. PSO is a global-search iterative technique where the solution space is explored using a swarm of particles. In every PSO iteration each particle is individually attracted to: the best point (in terms of objective function) in the swarm during last iteration, the best point visited by that particle in all iterations, and the best point found by any particle in all iterations. In the PSO variant proposed here, rather than single points, collections of points carefully selected are used as attractors. The algorithm ensures by a series of mechanisms that the number of attractors is adequate and that the solutions progressively determined are sufficiently different from one another. A series of experiments were performed with a synthetic model based on a real oil field for which nine years of historical data were generated. Both standard PSO and the PSO variant were tested to obtain several models that reproduced well rates within acceptable accuracy. In order to determine multiple solutions via standard PSO (which usually returns only one solution), a number of independent runs with different initial conditions were considered (i.e., standard PSO was run in multi-start fashion). In our experiments, which had a budget of 3,072 simulations in the two cases, the number of solutions found on average by standard PSO and by our PSO variant was 8 and 837, respectively. That is, multi-start standard PSO may require, on average, around 100 times more simulations than our PSO variant to compute a comparable number of models (possibly) distributed in similar manner in the solution space. These results may be explained by noticing that the search for multiple solutions may be more efficient when all information is considered simultaneously than separately by means of a number of independent runs. Standard PSO, when applied to many uncertainty quantification problems, may provide only one solution because the particles in the swarm generally tend to converge to essentially a single point. The Ensemble Kalman Filter (EnKF), which has lately become a very popular history-matching algorithm, presents a similar problem because the ensemble sometimes collapses into one solution. The PSO variant introduced in this work can be an efficient alternative to these algorithms in reservoir characterization since it has been designed to provide multiple and different solutions in a single run.
- Book Chapter
17
- 10.5772/6752
- Jan 1, 2009
Particle swarm optimisation (PSO) was developed by Kennedy and Eberhart in 1995 (Kennedy & Eberhart, 1995) inspired by the collective behaviour of natural birds or fish. PSO is a stochastic optimisation technique that uses a behaviour of population composed by many search points called particle. In spite of easy implementation in computer algorithms, it is well known as a powerful numerical optimizer. In the typical PSO algorithms, a set of particles searches the optimal solution in the problem space efficiently, by sharing the common attractor called global best. There are many modified versions of PSO by improving convergence property to a certain problem. While, a standard PSO is defined by Bratton and Kennedy (Bratton & Kennedy, 2007) to give a real standard for PSO studies. PSO seems as one of the evolutionary computations (ECs), and it has been shown that PSO is comparable to a genetic algorithm (Angeline, 1998). Thus, a lot of studies have demonstrated the effectiveness of PSO family in optimizing various continuous and discrete optimization problems. And a plenty of applications of PSO, such as the neural network training, PID controller tuning, electric system optimisation have been studied and achieved well results (Kennedy, 1997). However, PSO is often failed in searching the global optimal solution in the case of the objective function has a large number of dimensions. The reason of this phenomenon is not only existence of the local optimal solutions, the velocities of the particles sometimes lapsed into the degeneracy, so that the successive range is restricted in the sub-plain of the whole search hyper-plain. The sub-plane that is defined by finite number of particle velocities is a partial space in the whole search space. The issue of local optima in PSO has been studied and proposed several modifications on the basic particle driven equation (Parsopoulos et al., 2001; Hendtlass, 2005; Liang et al., 2006). There used a kind of adaptation technique or randomized method (e.g. mutation in evolutionary computations) to keep particles velocities or to accelerate them. Although such improvements work well and have ability to avoid fall in the local optima, the problem of early convergence by the degeneracy of some dimensions is still remaining, even if there are no local optima. Hence the PSO algorithm does not always work well for the high-dimensional function.
- Book Chapter
16
- 10.1007/978-0-387-72258-0_18
- Jan 1, 2007
In this paper we investigate the application of the Particle Swarm Optimization (PSO) technique for solving the Hardware/Software partitioning problem. The PSO is attractive for the Hardware/Software partitioning problem as it offers reasonable coverage of the design space together with O(n) main loop's execution time, where n is the number of proposed solutions that will evolve to provide the final solution. We carried out several tests on a hypothetical, relatively-large Hardware/Software partitioning problem using the PSO algorithm as well as the Genetic Algorithm (GA), which is another evolutionary technique. We found that PSO outperforms GA in the cost function and the execution time. For the case of unconstrained design problem, we tested several hybrid combinations of PSO and GA algorithms; including PSO then GA, GA then PSO, GA followed by GA, and finally PSO followed by PSO. The PSO algorithm followed by another PSO round gave the best result as it allows another round of domain exploration. The second PSO round assign new randomized velocities to the particles, while keeping best particle positions obtained in the first round. We propose to name this successive PSO algorithm as the Re-excited PSO algorithm. The constrained formulations of the problem are investigated for different tuning or limiting design parameters constraints.
- Conference Article
4
- 10.1109/cec.2012.6256124
- Jun 1, 2012
Since the proposal of Particle Swarm Optimization (PSO), there have been many improvements of PSO which have not change the basic paradigm of PSO involving pattern of movement of particles, update mode of particles and algorithm framework. Instead of another improvement of PSO, a novel paradigm of PSO with more natural and simpler forms, called naive PSO, is proposed, based on a slightly different social metaphor from that of the original PSO: each particle learns from better one in the swarm and takes warning from worse one in the swarm. In the naive PSO, pattern of movement and mode of update of particles differing from that in the original PSO is introduced. After an algorithm framework is presented, stochastic parameter analysis is also carried out. Preliminary computational experiences show that the naive PSO has a competitive performance over the standard PSO. And then two modifications of the naive PSO are devised. Combining the two modifications, the improved naive PSO shows significantly superior performance over the standard PSO and competitive performance over differential evolution.
- Research Article
3
- 10.17485/ijst/2016/v9i45/101915
- Dec 20, 2016
- Indian Journal of Science and Technology
Background/Objectives: PV array being shaded partially by buildings, trees or passing clouds is common. This makes the P-V curve of the PV system complex with more than one peak. MPPT algorithm capable of consistently detecting the global peak within a short duration of time is essential. Methods/Statistical Analysis: Lately Particle Swarm Optimization (PSO) algorithm has been used for Maximum Power Point (MPP) tracking due to its ability to locate the MPP irrespective of its location in the P-V curve. This paper evaluates and compares the performance of the basic PSO algorithm and the modified PSO algorithms for ten different shading patterns. Findings: The basic PSO algorithm is compared with three modified PSO algorithms - PSO algorithm with random numbers eliminated, PSO algorithm with linearly varying constants and PSO algorithm with fixed maximum iterations. The basic PSO algorithm gives good results but random numbers in the algorithm tends to make the convergence time random for the same shading pattern and makes hardware implementation difficult. The PSO algorithm with random numbers eliminated overcomes this disadvantage and is found to give good results. But the convergence time is a little higher and varies with shading pattern. The PSO algorithm with fixed maximum iterations gives good performance with shorter and fixed convergence time. Application/Improvements: PSO algorithm with fixed maximum iterations thus improves the responsiveness of the algorithm to rapidly changing patterns of shading. Keywords: Maximum Power Point Tracking, Partial Shading, Particle Swarm Optimization, PV Array
- Research Article
38
- 10.1177/1729881417710312
- May 1, 2017
- International Journal of Advanced Robotic Systems
Due to its complexity and non-deterministic polynomial-time hard characteristic, multirobot task allocation problem remains a challenging issue in the field of cooperative robotics. Thanks to its easy implementation and promising convergence speed, the particle swarm optimization method has recently aroused increasing research interest in the area of multirobot task allocation problem. However, the efficiency of the standard particle swarm optimization is hindered by several deficiencies such as the inefficient capabilities in balancing exploration and exploitation, as well as the high likelihood of plunging into stagnation. Aiming at enhancing the performance of particle swarm optimization via remedying these two drawbacks, this paper proposes an improved particle swarm optimization method, which integrates standard particle swarm optimization 2011 with evolutionary game theory. To prevent particles being locked into stagnation, particles in the proposed particle swarm optimization first adopt the updating rules of standard particle swarm optimization 2011 to undertake their movements. Subsequently, attempting to well trade off the exploration and exploitation capabilities of particles, a novel self-adaptive strategy, which is determined by the evolutionary stable strategies of evolutionary game theory and the iteration number of particle swarm optimization, is presented to adaptively adjust the main control parameters of particles in the proposed particle swarm optimization. Since the convergence of particle swarm optimization remains paramount and dramatically affects the performance of particle swarm optimization, this paper also analytically investigates the convergence of the proposed particle swarm optimization and provides a convergence-guaranteed parameter selection principle for the proposed method. Finally, leveraging the development of the proposed particle swarm optimization, this paper completes the design of a new particle swarm optimization–based multirobot task allocation method. The performance of the new particle swarm optimization–based multirobot task allocation method is tested through three different allocation cases against four well-known evolutionary methods. Experimental results confirm that the proposed method generally outperforms its contenders in terms of the solution quality. Moreover, the proposed method performs slightly better than the majority of its peers as far as the computation time is concerned.
- Research Article
4
- 10.1108/dta-07-2019-0120
- Apr 17, 2020
- Data Technologies and Applications
PurposeNowadays, the speech emotion recognition (SER) model has enhanced as the main research topic in various fields including human–computer interaction as well as speech processing. Generally, it focuses on utilizing the models of machine learning for predicting the exact emotional status from speech. The advanced SER applications go successful in affective computing and human–computer interaction, which is making as the main component of computer system's next generation. This is because the natural human machine interface could grant the automatic service provisions, which need a better appreciation of user's emotional states.Design/methodology/approachThis paper implements a new SER model that incorporates both gender and emotion recognition. Certain features are extracted and subjected for classification of emotions. For this, this paper uses deep belief network DBN model.FindingsThrough the performance analysis, it is observed that the developed method attains high accuracy rate (for best case) when compared to other methods, and it is 1.02% superior to whale optimization algorithm (WOA), 0.32% better from firefly (FF), 23.45% superior to particle swarm optimization (PSO) and 23.41% superior to genetic algorithm (GA). In case of worst scenario, the mean update of particle swarm and whale optimization (MUPW) in terms of accuracy is 15.63, 15.98, 16.06% and 16.03% superior to WOA, FF, PSO and GA, respectively. Under the mean case, the performance of MUPW is high, and it is 16.67, 10.38, 22.30 and 22.47% better from existing methods like WOA, FF, PSO, as well as GA, respectively.Originality/valueThis paper presents a new model for SER that aids both gender and emotion recognition. For the classification purpose, DBN is used and the weight of DBN is used and this is the first work uses MUPW algorithm for finding the optimal weight of DBN model.
- Research Article
28
- 10.1016/j.asoc.2015.06.036
- Jul 9, 2015
- Applied Soft Computing
A hybrid algorithm based on particle swarm and chemical reaction optimization for multi-object problems
- Research Article
22
- 10.1016/j.swevo.2016.11.005
- Nov 21, 2016
- Swarm and Evolutionary Computation
Rocchio algorithm-based particle initialization mechanism for effective PSO classification of high dimensional data
- Book Chapter
4
- 10.5772/6743
- Jan 1, 2009
Optimization problems are frequently encountered in many engineering, economic or scientific fields that engineers or researchers are seeking to minimize cost or time, or to maximize profit, quality or efficiency, of a specific problem. For example, economic dispatch of power generation, optimal allocation of resources for manufacture, design optimal plant to maximize production, and so many which are unable to enumerate completely. In addition, many optimization problems are very complex and hard to solve by conventional gradient-based techniques, particularly the objective function and constraint are not in closed forms. Thus, the development of a good optimization strategy or algorithm is of great value. In the past decade, particle swarm optimization (PSO) algorithm [Eberhart & Kennedy 1995, Kennedy and Eberhart 1995] attracts many sights around the world due to its powerful searching ability and simplicity. PSO simulates the swarm behavior of birds flocking and fish schooling that swarms work in a collaborative manner to search for foods as efficient and quick as possible. There are three different types of PSO which are frequently encountered in literature. They are constriction type PSO, constant inertia weight PSO and linearly decreasing inertia weight PSO. Each of them has been successfully applied to many optimization problems. While empirical studies have proven PSO’s usefulness as an optimization algorithm, it does not always fit all problems. Sometimes, it may also get stuck on local optimal. In order to improve the performance, many variants of PSO have been proposed. Some of the proposed algorithms adopted new operations and some of the modifications hybridized with other algorithm. Although they are claimed better than original PSO algorithm, most of them will introduce extra mathematical or logical operations, which, in turn, making algorithm more complicate and spending more computing time. Especially, they, in general, did not present any theoretical models to describe its behavior and support such modifications. Many researchers have devoted to study how PSO works. They intended to discover the implicit properties of PSO and its weakness and strength via theoretical analysis. The first attempt to analysis PSO is made by Kenndey [Kennedy, 1998]. Meanwhile, Ozcan and Mohan showed that a particle in a simple one-dimensional PSO system follows a path defined by a sinusoidal wave with random amplitude and frequency. However, the effects of inertia weight are not addressed in that paper [Ozcan & Mohan, 1999]. In order to analyze