The University of Southampton
University of Southampton Institutional Repository

Building Symmetries into Feedforward Networks

Record type: Conference or Workshop Item (Paper)

One of the central tools developed by M. Minsky and S. Papert (1988) was the group invariance theorem. This theorem is concerned with choosing perceptron weights to recognise a predicate that is invariant under a group of permutations of the input. The theorem states that the weights can be chosen to be constant for equivalence classes of predicates under the action of the group. This paper presents this result in a graph theoretic light and then extends consideration to multilayer perceptrons. It is shown that, by choosing a multilayer network in such a way that the action of the group on the input nodes can be extended to the whole network, the invariance of the output under the action of the group can be guaranteed. This greatly reduces the number of degrees of freedom in the training of such a network. An example of using this technique to train a network to recognise isomorphism classes of graphs is given. This compares favourably with previous experiments using standard back-propagation. The connections between the group of symmetries and the network structure are explored and the relation to the problem of graph isomorphism is discussed

Full text not available from this repository.

Citation

Shawe-Taylor, John (1989) Building Symmetries into Feedforward Networks In Proceedings of First IEE Conference on Artificial Neural Networks, London. Inspec/Iee., pp. 158-162.

More information

Published date: 1989
Organisations: Electronics & Computer Science

Identifiers

Local EPrints ID: 259738
URI: http://eprints.soton.ac.uk/id/eprint/259738
ISBN: 0 85296 388 2
PURE UUID: 60ef35ff-489b-4d2c-9f5f-c4ed603a0de6

Catalogue record

Date deposited: 12 Aug 2004
Last modified: 18 Jul 2017 09:20

Export record

Contributors

Author: John Shawe-Taylor

University divisions


Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×