Bayesian inference for Poisson and multinomial log-linear models


Forster, Jonathan J. (2009) Bayesian inference for Poisson and multinomial log-linear models. Southampton, UK, Southampton Statistical Sciences Research Institute, 23pp. (S3RI Methodology Working Papers, (M09/11) ).

Download

[img] PDF
Download (270Kb)

Description/Abstract

Categorical data frequently arise in applications in the social sciences. In such applications,the class of log-linear models, based on either a Poisson or (product) multinomial response distribution, is a flexible model class for inference and prediction. In this paper we consider the Bayesian analysis of both Poisson and multinomial log-linear models. It is often convenient to model multinomial or product multinomial data as observations of independent Poisson variables. For multinomial data, Lindley (1964) showed that this approach leads to valid Bayesian posterior inferences when the prior density for the Poisson cell means factorises in a particular way. We develop this result to provide a general framework for the analysis of multinomial or product multinomial data using a Poisson log-linear model. Valid finite population inferences are also available, which can be particularly important in modelling social data.We then focus particular attention on multivariate normal prior distributions for the log-linear model parameters.Here, an improper prior distribution for certain Poisson model parameters is required for valid multinomial analysis, and we derive conditions under which the resulting posterior distribution is proper.We also consider the construction of prior distributions across models, and for model parameters, when uncertainty exists about the appropriate form of the model. We present classes of Poisson and multinomial models, invariant under certain natural groups of permutations of the cells. We demonstrate that, if prior belief concerning the model parameters is also invariant, as is the case in a `reference' analysis, then choice of prior distribution is considerably restricted. The analysis of multivariate categorical data in the form of a contingency table is considered in detail. We illustrate the methods with two examples.

Item Type: Monograph (Working Paper)
Subjects: H Social Sciences > HA Statistics
Divisions: University Structure - Pre August 2011 > Southampton Statistical Sciences Research Institute
ePrint ID: 66220
Date Deposited: 13 May 2009
Last Modified: 27 Mar 2014 18:47
URI: http://eprints.soton.ac.uk/id/eprint/66220

Actions (login required)

View Item View Item

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics