Automatic Derivation of Statistical Algorithms: The EM Family and Beyond

Gray, Alexander G., Fischer, Bernd, Schumann, Johann and Buntine, Wray, (2003) Automatic Derivation of Statistical Algorithms: The EM Family and Beyond Becker, Suzanna, Thrun, Sebastian and Obermayer, Klaus (eds.) At Neural Information Processing Systems 15. 09 - 14 Dec 2002. , pp. 689-696.


[img] PDF ab.pdf - Other
Download (111kB)


Machine learning has reached a point where many probabilistic methods can be understood as variations, extensions and combinations of a much smaller set of abstract themes, e.g., as different instances of the EM algorithm. This enables the systematic derivation of algorithms customized for different models. Here, we describe the AUTOBAYES system which takes a high-level statistical model specification, uses powerful symbolic techniques based on schema-based program synthesis and computer algebra to derive an efficient specialized algorithm for learning that model, and generates executable code implementing that algorithm. This capability is far beyond that of code collections such as Matlab toolboxes or even tools for model-independent optimization such as BUGS for Gibbs sampling: complex new algorithms can be generated without new programming, algorithms can be highly specialized and tightly crafted for the exact structure of the model and data, and efficient and commented code can be generated for different languages or systems. We present automatically-derived algorithms ranging from closed-form solutions of Bayesian textbook problems to recently-proposed EM algorithms for clustering, regression, and a multinomial form of PCA.

Item Type: Conference or Workshop Item (Paper)
Additional Information: Event Dates: 09/12/2002 - 14/12/2002
Venue - Dates: Neural Information Processing Systems 15, 2002-12-09 - 2002-12-14
Organisations: Electronic & Software Systems
ePrint ID: 262683
Date :
Date Event
Date Deposited: 08 Jun 2006
Last Modified: 17 Apr 2017 21:38
Further Information:Google Scholar

Actions (login required)

View Item View Item