Enhanced objective Bayesian testing for the equality of two proportions

Consonni, Guido, Forster, Jonathan J. and La Rocca, Luca (2010) Enhanced objective Bayesian testing for the equality of two proportions , Southampton, GB Southampton Statistical Sciences Research Institute 29pp. (S3RI Methodology Working Papers, M10/13).


[img] PDF s3ri-workingpaper-M10-13.pdf - Other
Download (423kB)


We develop a new class of prior distributions for Bayesian comparison of nested models, which we call intrinsic moment priors, by combining the well-established notion of intrinsic prior with the recently introduced idea of non-local priors, and in particular of moment priors. Specifically, we aim at testing the equality of two proportions, based on independent samples, and thus focus on discrete data models. Given two nested models, each equipped with a default prior, we first construct a moment prior under the larger model. In this way, the asymptotic learning behavior of the Bayes factor is strengthened, relative to currently used local priors, when the smaller model holds; remarkably, this effect is already apparent for moderate sample sizes. On the other hand, the symptotic learning behavior of the Bayes factor when the larger model holds is unchanged. However, without appropriate tuning, a moment prior does not provide enough evidence for the larger model when the sample size is small and the data only moderately support the smaller one. For this reason, we apply to the moment prior an intrinsic prior procedure, which amounts to pulling the moment prior towards the subspace specified by the smaller model; we provide general guidelines for determining the training sample size necessary to implement this step. Thus, by joining the virtues of moment and intrinsic priors, we obtain an enhanced objective Bayesian testing procedure: i) our evidence for small samples is broadly comparable to that given by current objective methods; ii) we achieve a superior learning performance as the sample size increases (when the smaller model holds). We first illustrate our methodology in a running Bernoulli example, where we test a sharp null hypothesis, then we implement our procedure to test the equality of two proportions. A detailed analysis of the properties of our method, including a comparison with standard intrinsic priors, is presented together with an application to a collection of real-world 2 by 2 tables involving a sensitivity analysis and a crossvalidation study.

Item Type: Monograph (Working Paper)
Keywords: bayes factor, intrinsic prior, model choice, moment prior, non-local prior, training sample size
ePrint ID: 165755
Date :
Date Event
18 October 2010Published
Date Deposited: 20 Oct 2010 07:57
Last Modified: 18 Apr 2017 03:39
Further Information:Google Scholar
URI: http://eprints.soton.ac.uk/id/eprint/165755

Actions (login required)

View Item View Item