The University of Southampton
University of Southampton Institutional Repository

A simple test for the difference of means in meta-analysis when study-specific variances are unreported

A simple test for the difference of means in meta-analysis when study-specific variances are unreported
A simple test for the difference of means in meta-analysis when study-specific variances are unreported
Standard meta-analysis requires the quantity of interest and its estimated varianceto be reported for each study. Datasets that lack such variance information pose im-portant challenges to meta-analytic inference. In a study with continuous outcomes,only sample means and sample sizes may be reported in the treatment arm. Classicalmeta-analytical technique is unable to apply statistical inference to such datasets. Inthis paper, we propose a statistical tool for testing equal means between two groupsin meta-analysis when the variances of the constituent studies are unreported, usingpivot inference based on the exact t-distribution and the generalized likelihood ratio.These are considered under a fixed effect model. In simulations, the type I errorsand power probabilities of the proposed tests are investigated as metrics of theirperformance. The t-test statistic provides type I errors very close to the nominalsignificance level in all cases, and has large power. The generalized likelihood ratiotest statistic performs well when the number of studies is moderate-to-large. Theperformance of our tests surpasses that of the conventional test, which is based onthe normal distribution. The difference is especially pronounced when the numberof studies is small. The distribution given by our tests is also shown to closely followthe theoretical distribution.
0094-9655
2524-2536
Sangnawakij, Patarawan
3baba4ef-a7c4-42d4-b9c2-a363ad9981a1
Bohning, Dankmar
1df635d4-e3dc-44d0-b61d-5fd11f6434e1
Sangnawakij, Patarawan
3baba4ef-a7c4-42d4-b9c2-a363ad9981a1
Bohning, Dankmar
1df635d4-e3dc-44d0-b61d-5fd11f6434e1

Sangnawakij, Patarawan and Bohning, Dankmar (2020) A simple test for the difference of means in meta-analysis when study-specific variances are unreported. Journal of Statistical Computation and Simulation, 90 (14), 2524-2536. (doi:10.1080/00949655.2020.1780235).

Record type: Article

Abstract

Standard meta-analysis requires the quantity of interest and its estimated varianceto be reported for each study. Datasets that lack such variance information pose im-portant challenges to meta-analytic inference. In a study with continuous outcomes,only sample means and sample sizes may be reported in the treatment arm. Classicalmeta-analytical technique is unable to apply statistical inference to such datasets. Inthis paper, we propose a statistical tool for testing equal means between two groupsin meta-analysis when the variances of the constituent studies are unreported, usingpivot inference based on the exact t-distribution and the generalized likelihood ratio.These are considered under a fixed effect model. In simulations, the type I errorsand power probabilities of the proposed tests are investigated as metrics of theirperformance. The t-test statistic provides type I errors very close to the nominalsignificance level in all cases, and has large power. The generalized likelihood ratiotest statistic performs well when the number of studies is moderate-to-large. Theperformance of our tests surpasses that of the conventional test, which is based onthe normal distribution. The difference is especially pronounced when the numberof studies is small. The distribution given by our tests is also shown to closely followthe theoretical distribution.

Text
A simple test for the difference of means in meta-analysis when study-specific variances are unreported - Accepted Manuscript
Download (1MB)

More information

Accepted/In Press date: 10 June 2020
e-pub ahead of print date: 19 June 2020

Identifiers

Local EPrints ID: 441477
URI: http://eprints.soton.ac.uk/id/eprint/441477
ISSN: 0094-9655
PURE UUID: b62662c1-96c4-4f2f-b04c-49829df41bba
ORCID for Dankmar Bohning: ORCID iD orcid.org/0000-0003-0638-7106

Catalogue record

Date deposited: 15 Jun 2020 16:30
Last modified: 17 Mar 2024 05:38

Export record

Altmetrics

Contributors

Author: Patarawan Sangnawakij
Author: Dankmar Bohning ORCID iD

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×