The University of Southampton
University of Southampton Institutional Repository

Topology design of feedforward neural networks by genetic algorithms

Topology design of feedforward neural networks by genetic algorithms
Topology design of feedforward neural networks by genetic algorithms
For many applications feedforward neural networks have proved to be a valuable tool. Although the basic principles of employing such networks are quite straightforward, the problem of tuning their architectures to achieve near optimal performance still remains a very challenging task. Genetic algorithms may be used to solve this problem, since they have a number of distinct features that are useful in this context. First, the approach is quite universal and can be applied to many different types of neural networks or training criteria. It also allows network topologies to be optimized at various level of detail and can be used with many types of energy function, even those that are discontinuous or non-differentiable. Finally, a genetic algorithm need not be limited to simply adjusting patterns of connections, but, for example, can be utilized to select node transfer functions, weight values or to find architectures that perform best under certain simulated working conditions. In this paper we have investigated an application of genetic algorithms to feedforward neural network architecture design. These neural networks are used to model a nonlinear, discrete SISO system when only noisy training data are available. Additionally, some incidental but nonetheless important aspects of neural network optimization, such as complexity penalties or automatic topology simplification are discussed.
354061723X
1141
771-780
Springer
Stepniewski, S.W.
066d4edf-faff-4e99-8c90-39e633591577
Keane, A.J.
26d7fa33-5415-4910-89d8-fb3620413def
Stepniewski, S.W.
066d4edf-faff-4e99-8c90-39e633591577
Keane, A.J.
26d7fa33-5415-4910-89d8-fb3620413def

Stepniewski, S.W. and Keane, A.J. (1996) Topology design of feedforward neural networks by genetic algorithms. In Parallel Problem Solving from Nature - PPSN IV: Proceedings of the 4th International Conference on Parallel Problem Solving from Nature. Springer. pp. 771-780 . (doi:10.1007/3-540-61723-X_1040).

Record type: Conference or Workshop Item (Paper)

Abstract

For many applications feedforward neural networks have proved to be a valuable tool. Although the basic principles of employing such networks are quite straightforward, the problem of tuning their architectures to achieve near optimal performance still remains a very challenging task. Genetic algorithms may be used to solve this problem, since they have a number of distinct features that are useful in this context. First, the approach is quite universal and can be applied to many different types of neural networks or training criteria. It also allows network topologies to be optimized at various level of detail and can be used with many types of energy function, even those that are discontinuous or non-differentiable. Finally, a genetic algorithm need not be limited to simply adjusting patterns of connections, but, for example, can be utilized to select node transfer functions, weight values or to find architectures that perform best under certain simulated working conditions. In this paper we have investigated an application of genetic algorithms to feedforward neural network architecture design. These neural networks are used to model a nonlinear, discrete SISO system when only noisy training data are available. Additionally, some incidental but nonetheless important aspects of neural network optimization, such as complexity penalties or automatic topology simplification are discussed.

This record has no associated files available for download.

More information

Published date: 1996
Additional Information: Series ISSN 0302-9743
Venue - Dates: 4th International Conference on Parallel Problem Solving from Nature, Berlin, Germany, 1996-09-22 - 1996-09-26

Identifiers

Local EPrints ID: 23650
URI: http://eprints.soton.ac.uk/id/eprint/23650
ISBN: 354061723X
PURE UUID: 8a58a8ff-5bae-4b66-a5b4-146bb978bf3a
ORCID for A.J. Keane: ORCID iD orcid.org/0000-0001-7993-1569

Catalogue record

Date deposited: 14 Feb 2007
Last modified: 16 Mar 2024 02:53

Export record

Altmetrics

Contributors

Author: S.W. Stepniewski
Author: A.J. Keane ORCID iD

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×