The University of Southampton
University of Southampton Institutional Repository

Design considerations for small experiments and simple logistic regression

Design considerations for small experiments and simple logistic regression
Design considerations for small experiments and simple logistic regression
Inference for a generalized linear model is generally performed using asymptotic approximations for the bias and the covariance matrix of the parameter estimators. For small experiments, these approximations can be poor and result in estimators with considerable bias. We investigate the properties of designs for small experiments when the response is described by a simple logistic regression model and parameter estimators are to be obtained by the maximum penalized likelihood method of Firth [Firth, D., 1993, Bias reduction of maximum likelihood estimates. Biometrika, 80, 27-38]. Although this method achieves a reduction in bias, we illustrate that the remaining bias may be substantial for small experiments, and propose minimization of the integrated mean square error, based on Firth's estimates, as a suitable criterion for design selection. This approach is used to find locally optimal designs for two support points.
bias, generalized linear models, integrated mean square error, maximum penalized likelihood, optimality
0094-9655
81-91
Russell, Ken G.
71a66788-203b-4381-8b60-2f96f50ae775
Eccleston, J.A.
8d0ae072-0870-4302-a54d-af9ec88e42b8
Lewis, Susan M.
a69a3245-8c19-41c6-bf46-0b3b02d83cb8
Woods, David C.
ae21f7e2-29d9-4f55-98a2-639c5e44c79c
Russell, Ken G.
71a66788-203b-4381-8b60-2f96f50ae775
Eccleston, J.A.
8d0ae072-0870-4302-a54d-af9ec88e42b8
Lewis, Susan M.
a69a3245-8c19-41c6-bf46-0b3b02d83cb8
Woods, David C.
ae21f7e2-29d9-4f55-98a2-639c5e44c79c

Russell, Ken G., Eccleston, J.A., Lewis, Susan M. and Woods, David C. (2009) Design considerations for small experiments and simple logistic regression. Journal of Statistical Computation and Simulation, 79 (1), 81-91. (doi:10.1080/00949650701609006).

Record type: Article

Abstract

Inference for a generalized linear model is generally performed using asymptotic approximations for the bias and the covariance matrix of the parameter estimators. For small experiments, these approximations can be poor and result in estimators with considerable bias. We investigate the properties of designs for small experiments when the response is described by a simple logistic regression model and parameter estimators are to be obtained by the maximum penalized likelihood method of Firth [Firth, D., 1993, Bias reduction of maximum likelihood estimates. Biometrika, 80, 27-38]. Although this method achieves a reduction in bias, we illustrate that the remaining bias may be substantial for small experiments, and propose minimization of the integrated mean square error, based on Firth's estimates, as a suitable criterion for design selection. This approach is used to find locally optimal designs for two support points.

This record has no associated files available for download.

More information

Published date: 2009
Keywords: bias, generalized linear models, integrated mean square error, maximum penalized likelihood, optimality

Identifiers

Local EPrints ID: 151263
URI: http://eprints.soton.ac.uk/id/eprint/151263
ISSN: 0094-9655
PURE UUID: 82b3147b-0e06-4b8e-bc7a-d4c0c05b2810
ORCID for David C. Woods: ORCID iD orcid.org/0000-0001-7648-429X

Catalogue record

Date deposited: 10 May 2010 09:30
Last modified: 14 Mar 2024 02:44

Export record

Altmetrics

Contributors

Author: Ken G. Russell
Author: J.A. Eccleston
Author: Susan M. Lewis
Author: David C. Woods ORCID iD

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×