Symmetry Breaking in Population-Based Optimization

Download

Postscript Download (624Kb)

Description/Abstract

This paper argues that the performance of evolutionary algorithms working on hard optimisation problems depends strongly on how the population breaks the `symmetry' of the search space. The splitting of the search space into widely separate regions containing local optima is a generic property of a large class of hard optimisation problem. This phenomenon is discussed by reference to two well studied examples, the Ising perceptron and K-SAT. A finite population will quickly concentrate on one region of the search space. The cost of crossover between solutions in different regions of search space can accelerate this symmetry breaking. This, in turn, can dramatically reduce the amount of exploration, leading to sub-optimal solutions being found. An analysis of symmetry breaking using diffusion model techniques borrowed from classical population genetics is presented. This shows how symmetry breaking depends on parameters such as the population size and selection rate.