Investigating heterogeneity in meta-analysis of studies with rare events: estimating the amount of heterogeneity
Investigating heterogeneity in meta-analysis of studies with rare events: estimating the amount of heterogeneity
In many meta-analyses, the variable of interest is frequently a count outcome reported in an intervention and a control group. Single- or double-zero studies are often observed in this type of data. Given this setting, the well-known Cochran’s Q statistic for testing homogeneity becomes undefined. In this paper, we propose two statistics for testing homogeneity of the risk ratio, particularly for application in the case of rare events in meta-analysis. The first one is a chi-square type statistic. It is constructed based on information of the conditional probability of the number of events in the treatment group given the total number of events. The second one is a likelihood ratio statistic, derived from the logistic regression models allowing fixed and random effects for the risk ratio. Both proposed statistics are well defined even in the situation of single-zero studies. In a simulation study, the proposed tests show a performance better than the traditional test in terms of type I error and power of the test under common and rare event situations. However, as the performance of the two newly proposed tests is still unsatisfactory in the very rare events setting, we suggest a bootstrap approach that does not rely on asymptotic distributional theory and it is shown that the bootstrap approach performs well in terms of type I error. Furthermore, a number of empirical meta-analyses are used to illustrate the methods.
Bootstrap, Conditional Poisson distribution, Meta-analysis, rare events
259-272
Böhning, Dankmar
1df635d4-e3dc-44d0-b61d-5fd11f6434e1
Holling, Heinz
88d46f56-77ca-4d0e-b035-a51aff735435
Böhning, Walailuck
c0e89cb8-3d21-433c-8ca1-c1ee7c5bdfa6
Sangnawakij, Patarawan
e821a2a7-a89f-4172-9006-8a6c2db9add6
December 2021
Böhning, Dankmar
1df635d4-e3dc-44d0-b61d-5fd11f6434e1
Holling, Heinz
88d46f56-77ca-4d0e-b035-a51aff735435
Böhning, Walailuck
c0e89cb8-3d21-433c-8ca1-c1ee7c5bdfa6
Sangnawakij, Patarawan
e821a2a7-a89f-4172-9006-8a6c2db9add6
Böhning, Dankmar, Holling, Heinz, Böhning, Walailuck and Sangnawakij, Patarawan
(2021)
Investigating heterogeneity in meta-analysis of studies with rare events: estimating the amount of heterogeneity.
Metron, 79 (3), .
(doi:10.1007/s40300-021-00211-y).
Abstract
In many meta-analyses, the variable of interest is frequently a count outcome reported in an intervention and a control group. Single- or double-zero studies are often observed in this type of data. Given this setting, the well-known Cochran’s Q statistic for testing homogeneity becomes undefined. In this paper, we propose two statistics for testing homogeneity of the risk ratio, particularly for application in the case of rare events in meta-analysis. The first one is a chi-square type statistic. It is constructed based on information of the conditional probability of the number of events in the treatment group given the total number of events. The second one is a likelihood ratio statistic, derived from the logistic regression models allowing fixed and random effects for the risk ratio. Both proposed statistics are well defined even in the situation of single-zero studies. In a simulation study, the proposed tests show a performance better than the traditional test in terms of type I error and power of the test under common and rare event situations. However, as the performance of the two newly proposed tests is still unsatisfactory in the very rare events setting, we suggest a bootstrap approach that does not rely on asymptotic distributional theory and it is shown that the bootstrap approach performs well in terms of type I error. Furthermore, a number of empirical meta-analyses are used to illustrate the methods.
Text
Böhning2021_Article_InvestigatingHeterogeneityInMe
- Version of Record
More information
Accepted/In Press date: 5 May 2021
e-pub ahead of print date: 28 May 2021
Published date: December 2021
Additional Information:
Funding Information:
All authors would like to thank two anonymous referees for their helpful comments. This work has been partially funded under Grant HO1286/16-1 by the German Research Foundation (DFG).
Publisher Copyright:
© 2021, The Author(s).
Copyright:
Copyright 2021 Elsevier B.V., All rights reserved.
Keywords:
Bootstrap, Conditional Poisson distribution, Meta-analysis, rare events
Identifiers
Local EPrints ID: 449736
URI: http://eprints.soton.ac.uk/id/eprint/449736
ISSN: 0026-1424
PURE UUID: ccc451f9-8ec2-4458-b192-0f1ad75e64f3
Catalogue record
Date deposited: 15 Jun 2021 16:31
Last modified: 18 Mar 2024 03:19
Export record
Altmetrics
Contributors
Author:
Heinz Holling
Author:
Walailuck Böhning
Author:
Patarawan Sangnawakij
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.
View more statistics