The University of Southampton
University of Southampton Institutional Repository

Properties of Fisher information gain for Bayesian design of experiments

Properties of Fisher information gain for Bayesian design of experiments
Properties of Fisher information gain for Bayesian design of experiments
The Bayesian decision-theoretic approach to design of experiments involves specifying a design (values of all controllable variables) to maximise the expected utility function (expectation with respect to the distribution of responses and parameters). For most common utility functions, the expected utility is rarely available in closed form and requires a computationally expensive approximation which then needs to be maximised over the space of all possible designs. This hinders practical use of the Bayesian approach to find experimental designs. However, recently, a new utility called Fisher information gain has been proposed. The resulting expected Fisher information gain reduces to the prior expectation of the trace of the Fisher information matrix. Since the Fisher information is often available in closed form, this significantly simplifies approximation and subsequent identification of optimal designs. In this paper, it is shown that for exponential family models, maximising the expected Fisher information gain is equivalent to maximising an alternative objective function over a reduced-dimension space, simplifying even further the identification of optimal designs. However, if this function does not have enough global maxima, then designs that maximise the expected Fisher information gain lead to non-identifiablility.
0378-3758
138-146
Overstall, Antony
c1d6c8bd-1c5f-49ee-a845-ec9ec7b20910
Overstall, Antony
c1d6c8bd-1c5f-49ee-a845-ec9ec7b20910

Overstall, Antony (2022) Properties of Fisher information gain for Bayesian design of experiments. Journal of Statistical Planning and Inference, 218, 138-146. (doi:10.1016/j.jspi.2021.10.006).

Record type: Article

Abstract

The Bayesian decision-theoretic approach to design of experiments involves specifying a design (values of all controllable variables) to maximise the expected utility function (expectation with respect to the distribution of responses and parameters). For most common utility functions, the expected utility is rarely available in closed form and requires a computationally expensive approximation which then needs to be maximised over the space of all possible designs. This hinders practical use of the Bayesian approach to find experimental designs. However, recently, a new utility called Fisher information gain has been proposed. The resulting expected Fisher information gain reduces to the prior expectation of the trace of the Fisher information matrix. Since the Fisher information is often available in closed form, this significantly simplifies approximation and subsequent identification of optimal designs. In this paper, it is shown that for exponential family models, maximising the expected Fisher information gain is equivalent to maximising an alternative objective function over a reduced-dimension space, simplifying even further the identification of optimal designs. However, if this function does not have enough global maxima, then designs that maximise the expected Fisher information gain lead to non-identifiablility.

Text
fisher_info_gain_arXiv - Accepted Manuscript
Download (310kB)

More information

Accepted/In Press date: 23 October 2021
e-pub ahead of print date: 4 November 2021
Published date: 1 May 2022

Identifiers

Local EPrints ID: 452554
URI: http://eprints.soton.ac.uk/id/eprint/452554
ISSN: 0378-3758
PURE UUID: 34ae579f-a4fc-4924-accf-4846bebadb52
ORCID for Antony Overstall: ORCID iD orcid.org/0000-0003-0638-8635

Catalogue record

Date deposited: 11 Dec 2021 11:26
Last modified: 17 Mar 2024 06:54

Export record

Altmetrics

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×