The use of tail inequalities on the probable computational time of randomized search heuristics

Abstract

For the purpose of analyzing the time cost of evolutionary algorithms (EAs) or other types of randomized search heuristics (RSHs) with certain requirements on the probability of obtaining a target solution, this paper proposes a new index, called the probable computational time (PCT), which complements expected running time analysis. Using simple tail inequalities, such as Markov’s inequality and Chebyshev’s inequality, we also provide basic properties of PCT, explicitly exhibiting the general relationships between the expected running time and the PCT. To present deeper estimations of the PCT for specific RSHs and problems, we demonstrate a new inequality that is based on the general form of the Chernoff inequality and previous methods such as “fitness-based partitions” and “potential functions”, which have been used to analyze the expected running time of RSHs. The precondition of the new inequality is that the total running time can be described as the sum of a linear combination of some independent geometrically distributed variables and a constant term. The new inequality always provides meaningful upper bounds for the PCT under such circumstances. Some applications of the new inequality for simple EAs, ant colony optimization (ACO) and particle swarm optimization (PSO) algorithms on simple pseudo-Boolean functions are illustrated in this paper.