The University of Southampton
University of Southampton Institutional Repository

Automatic Derivation of Statistical Algorithms: The EM Family and Beyond

Gray, Alexander G., Fischer, Bernd, Schumann, Johann and Buntine, Wray, (2003) Automatic Derivation of Statistical Algorithms: The EM Family and Beyond Becker, Suzanna, Thrun, Sebastian and Obermayer, Klaus (eds.) At Neural Information Processing Systems 15. 09 - 14 Dec 2002. , pp. 689-696.

Record type: Conference or Workshop Item (Paper)


Machine learning has reached a point where many probabilistic methods can be understood as variations, extensions and combinations of a much smaller set of abstract themes, e.g., as different instances of the EM algorithm. This enables the systematic derivation of algorithms customized for different models. Here, we describe the AUTOBAYES system which takes a high-level statistical model specification, uses powerful symbolic techniques based on schema-based program synthesis and computer algebra to derive an efficient specialized algorithm for learning that model, and generates executable code implementing that algorithm. This capability is far beyond that of code collections such as Matlab toolboxes or even tools for model-independent optimization such as BUGS for Gibbs sampling: complex new algorithms can be generated without new programming, algorithms can be highly specialized and tightly crafted for the exact structure of the model and data, and efficient and commented code can be generated for different languages or systems. We present automatically-derived algorithms ranging from closed-form solutions of Bayesian textbook problems to recently-proposed EM algorithms for clustering, regression, and a multinomial form of PCA.

PDF ab.pdf - Other
Download (111kB)

More information

Published date: 2003
Additional Information: Event Dates: 09/12/2002 - 14/12/2002
Venue - Dates: Neural Information Processing Systems 15, 2002-12-09 - 2002-12-14
Organisations: Electronic & Software Systems


Local EPrints ID: 262683
ISBN: 0-262-02550-7
PURE UUID: 4181826c-2d85-4288-8bfd-d2fa0950b1e1

Catalogue record

Date deposited: 08 Jun 2006
Last modified: 18 Jul 2017 08:48

Export record


Author: Alexander G. Gray
Author: Bernd Fischer
Author: Johann Schumann
Author: Wray Buntine
Editor: Suzanna Becker
Editor: Sebastian Thrun
Editor: Klaus Obermayer

University divisions

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton:

ePrints Soton supports OAI 2.0 with a base URL of

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.