The University of Southampton
University of Southampton Institutional Repository

Comparing the Bayes and Typicalness Frameworks

Melluish, T., Saunders, C., Nouretdinov, I. and Vovk, V. (2001) Comparing the Bayes and Typicalness Frameworks At 12th European Conference on Machine Learning (ECML-2001).

Record type: Conference or Workshop Item (Other)


When correct priors are known, Bayesian algorithms give optimal decisions, and accurate confidence values for predictions can be obtained. If the prior is incorrect however, these confidence values have no theoretical base -- even though the algorithms' predictive performance may be good. There also exist many successful learning algorithms which only depend on the iid assumption. Often however they produce no confidence values for their predictions. Bayesian frameworks are often applied to these algorithms in order to obtain such values, however they can rely on unjustified priors. In this paper we outline the typicalness framework which can be used in conjunction with many other machine learning algorithms. The framework provides confidence information based only on the standard iid assumption and so is much more robust to different underlying data distributions. We show how the framework can be applied to existing algorithms. We also present experimental results which show that the typicalness approach performs close to Bayes when the prior is known to be correct. Unlike Bayes however, the method still gives accurate confidence values even when different data distributions are considered.

PDF TypBayes_ECML01.pdf - Other
Download (259kB)

More information

Published date: 2001
Venue - Dates: 12th European Conference on Machine Learning (ECML-2001), 2001-01-01
Organisations: Electronics & Computer Science


Local EPrints ID: 258966
PURE UUID: 6ceeefcd-e46b-4ff6-829c-252478d3a79e

Catalogue record

Date deposited: 03 Mar 2004
Last modified: 18 Jul 2017 09:27

Export record


Author: T. Melluish
Author: C. Saunders
Author: I. Nouretdinov
Author: V. Vovk

University divisions

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton:

ePrints Soton supports OAI 2.0 with a base URL of

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.