Properties of Fisher information gain for Bayesian design of experiments
Properties of Fisher information gain for Bayesian design of experiments
The Bayesian decision-theoretic approach to design of experiments involves specifying a design (values of all controllable variables) to maximise the expected utility function (expectation with respect to the distribution of responses and parameters). For most common utility functions, the expected utility is rarely available in closed form and requires a computationally expensive approximation which then needs to be maximised over the space of all possible designs. This hinders practical use of the Bayesian approach to find experimental designs. However, recently, a new utility called Fisher information gain has been proposed. The resulting expected Fisher information gain reduces to the prior expectation of the trace of the Fisher information matrix. Since the Fisher information is often available in closed form, this significantly simplifies approximation and subsequent identification of optimal designs. In this paper, it is shown that for exponential family models, maximising the expected Fisher information gain is equivalent to maximising an alternative objective function over a reduced-dimension space, simplifying even further the identification of optimal designs. However, if this function does not have enough global maxima, then designs that maximise the expected Fisher information gain lead to non-identifiablility.
138-146
Overstall, Antony
c1d6c8bd-1c5f-49ee-a845-ec9ec7b20910
1 May 2022
Overstall, Antony
c1d6c8bd-1c5f-49ee-a845-ec9ec7b20910
Overstall, Antony
(2022)
Properties of Fisher information gain for Bayesian design of experiments.
Journal of Statistical Planning and Inference, 218, .
(doi:10.1016/j.jspi.2021.10.006).
Abstract
The Bayesian decision-theoretic approach to design of experiments involves specifying a design (values of all controllable variables) to maximise the expected utility function (expectation with respect to the distribution of responses and parameters). For most common utility functions, the expected utility is rarely available in closed form and requires a computationally expensive approximation which then needs to be maximised over the space of all possible designs. This hinders practical use of the Bayesian approach to find experimental designs. However, recently, a new utility called Fisher information gain has been proposed. The resulting expected Fisher information gain reduces to the prior expectation of the trace of the Fisher information matrix. Since the Fisher information is often available in closed form, this significantly simplifies approximation and subsequent identification of optimal designs. In this paper, it is shown that for exponential family models, maximising the expected Fisher information gain is equivalent to maximising an alternative objective function over a reduced-dimension space, simplifying even further the identification of optimal designs. However, if this function does not have enough global maxima, then designs that maximise the expected Fisher information gain lead to non-identifiablility.
Text
fisher_info_gain_arXiv
- Accepted Manuscript
More information
Accepted/In Press date: 23 October 2021
e-pub ahead of print date: 4 November 2021
Published date: 1 May 2022
Identifiers
Local EPrints ID: 452554
URI: http://eprints.soton.ac.uk/id/eprint/452554
ISSN: 0378-3758
PURE UUID: 34ae579f-a4fc-4924-accf-4846bebadb52
Catalogue record
Date deposited: 11 Dec 2021 11:26
Last modified: 17 Mar 2024 06:54
Export record
Altmetrics
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.
View more statistics