The University of Southampton
University of Southampton Institutional Repository

Investigating heterogeneity in meta-analysis of studies with rare events: estimating the amount of heterogeneity

Investigating heterogeneity in meta-analysis of studies with rare events: estimating the amount of heterogeneity
Investigating heterogeneity in meta-analysis of studies with rare events: estimating the amount of heterogeneity

In many meta-analyses, the variable of interest is frequently a count outcome reported in an intervention and a control group. Single- or double-zero studies are often observed in this type of data. Given this setting, the well-known Cochran’s Q statistic for testing homogeneity becomes undefined. In this paper, we propose two statistics for testing homogeneity of the risk ratio, particularly for application in the case of rare events in meta-analysis. The first one is a chi-square type statistic. It is constructed based on information of the conditional probability of the number of events in the treatment group given the total number of events. The second one is a likelihood ratio statistic, derived from the logistic regression models allowing fixed and random effects for the risk ratio. Both proposed statistics are well defined even in the situation of single-zero studies. In a simulation study, the proposed tests show a performance better than the traditional test in terms of type I error and power of the test under common and rare event situations. However, as the performance of the two newly proposed tests is still unsatisfactory in the very rare events setting, we suggest a bootstrap approach that does not rely on asymptotic distributional theory and it is shown that the bootstrap approach performs well in terms of type I error. Furthermore, a number of empirical meta-analyses are used to illustrate the methods.

Bootstrap, Conditional Poisson distribution, Meta-analysis, rare events
0026-1424
259-272
Böhning, Dankmar
1df635d4-e3dc-44d0-b61d-5fd11f6434e1
Holling, Heinz
88d46f56-77ca-4d0e-b035-a51aff735435
Böhning, Walailuck
c0e89cb8-3d21-433c-8ca1-c1ee7c5bdfa6
Sangnawakij, Patarawan
e821a2a7-a89f-4172-9006-8a6c2db9add6
Böhning, Dankmar
1df635d4-e3dc-44d0-b61d-5fd11f6434e1
Holling, Heinz
88d46f56-77ca-4d0e-b035-a51aff735435
Böhning, Walailuck
c0e89cb8-3d21-433c-8ca1-c1ee7c5bdfa6
Sangnawakij, Patarawan
e821a2a7-a89f-4172-9006-8a6c2db9add6

Böhning, Dankmar, Holling, Heinz, Böhning, Walailuck and Sangnawakij, Patarawan (2021) Investigating heterogeneity in meta-analysis of studies with rare events: estimating the amount of heterogeneity. Metron, 79 (3), 259-272. (doi:10.1007/s40300-021-00211-y).

Record type: Article

Abstract

In many meta-analyses, the variable of interest is frequently a count outcome reported in an intervention and a control group. Single- or double-zero studies are often observed in this type of data. Given this setting, the well-known Cochran’s Q statistic for testing homogeneity becomes undefined. In this paper, we propose two statistics for testing homogeneity of the risk ratio, particularly for application in the case of rare events in meta-analysis. The first one is a chi-square type statistic. It is constructed based on information of the conditional probability of the number of events in the treatment group given the total number of events. The second one is a likelihood ratio statistic, derived from the logistic regression models allowing fixed and random effects for the risk ratio. Both proposed statistics are well defined even in the situation of single-zero studies. In a simulation study, the proposed tests show a performance better than the traditional test in terms of type I error and power of the test under common and rare event situations. However, as the performance of the two newly proposed tests is still unsatisfactory in the very rare events setting, we suggest a bootstrap approach that does not rely on asymptotic distributional theory and it is shown that the bootstrap approach performs well in terms of type I error. Furthermore, a number of empirical meta-analyses are used to illustrate the methods.

Text
Böhning2021_Article_InvestigatingHeterogeneityInMe - Version of Record
Available under License Creative Commons Attribution.
Download (739kB)

More information

Accepted/In Press date: 5 May 2021
e-pub ahead of print date: 28 May 2021
Published date: December 2021
Additional Information: Funding Information: All authors would like to thank two anonymous referees for their helpful comments. This work has been partially funded under Grant HO1286/16-1 by the German Research Foundation (DFG). Publisher Copyright: © 2021, The Author(s). Copyright: Copyright 2021 Elsevier B.V., All rights reserved.
Keywords: Bootstrap, Conditional Poisson distribution, Meta-analysis, rare events

Identifiers

Local EPrints ID: 449736
URI: http://eprints.soton.ac.uk/id/eprint/449736
ISSN: 0026-1424
PURE UUID: ccc451f9-8ec2-4458-b192-0f1ad75e64f3
ORCID for Dankmar Böhning: ORCID iD orcid.org/0000-0003-0638-7106

Catalogue record

Date deposited: 15 Jun 2021 16:31
Last modified: 18 Mar 2024 03:19

Export record

Altmetrics

Contributors

Author: Heinz Holling
Author: Walailuck Böhning
Author: Patarawan Sangnawakij

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×