The University of Southampton
University of Southampton Institutional Repository

Likelihood-based clustering of meta-analytic SROC curves

Likelihood-based clustering of meta-analytic SROC curves
Likelihood-based clustering of meta-analytic SROC curves
Meta-analysis of diagnostic studies experience the common problem that different studies might
not be comparable since they have been using a different cut-off value for the continuous or ordered
categorical diagnostic test value defining different regions for which the diagnostic test is defined to be
positive. Hence specificities and sensitivities arising from different studies might vary just because the
underlying cut-off value had been different. To cope with the cut-off value problem interest is usually
directed towards the receiver operating characteristic (ROC) curve which consists of pairs of sensitivities
and false-positive rates (1-specificity). In the context of meta-analysis one pair represents one study and
the associated diagram is called an SROC curve where the S stands for “summary”. In meta-analysis of
diagnostic studies emphasis has traditionally been placed on modelling this SROC curve with the intention
of providing a summary measure of the diagnostic accuracy by means of an estimate of the summary ROC
curve. Here, we focus instead on finding sub-groups or components in the data representing different
diagnostic accuracies. The paper will consider modelling SROC curves with the Lehmann family which
is characterised by one parameter only. Each single study can be represented by a specific value of that
parameter. Hence we focus on the distribution of these parameter estimates and suggest modelling a
potential heterogeneous or cluster structure by a mixture of specifically parameterised normal densities.
We point out that this mixture is completely nonparametric and the associated mixture likelihood is welldefined
and globally bounded. We use the theory and algorithms of nonparametric mixture likelihood
estimation to identify a potential cluster structure in the diagnostic accuracies of the collection of studies
to be analysed. Several meta-analytic applications on diagnostic studies, including AUDIT and AUDIT-C
for detection of unhealthy alcohol use, the mini-mental state examination for cognitive disorders, as well
as diagnostic accuracy inspection data on metal fatigue of aircraft spare parts, are discussed to illustrate
the methodology.
C.A.MAN, diagnostic testing, meta-analysis, sensitivity, specificity, summary receiver operating characteristic (SROC), summary statistics approach
0033-3123
106-126
Holling, Heinz
88d46f56-77ca-4d0e-b035-a51aff735435
Böhning, Walailuck
e41681ae-1c18-42f9-96d2-e725d47dbeec
Böhning, Dankmar
1df635d4-e3dc-44d0-b61d-5fd11f6434e1
Holling, Heinz
88d46f56-77ca-4d0e-b035-a51aff735435
Böhning, Walailuck
e41681ae-1c18-42f9-96d2-e725d47dbeec
Böhning, Dankmar
1df635d4-e3dc-44d0-b61d-5fd11f6434e1

Holling, Heinz, Böhning, Walailuck and Böhning, Dankmar (2012) Likelihood-based clustering of meta-analytic SROC curves. Psychometrika, 77 (1), 106-126. (doi:10.1007/S11336-011-9236-2).

Record type: Article

Abstract

Meta-analysis of diagnostic studies experience the common problem that different studies might
not be comparable since they have been using a different cut-off value for the continuous or ordered
categorical diagnostic test value defining different regions for which the diagnostic test is defined to be
positive. Hence specificities and sensitivities arising from different studies might vary just because the
underlying cut-off value had been different. To cope with the cut-off value problem interest is usually
directed towards the receiver operating characteristic (ROC) curve which consists of pairs of sensitivities
and false-positive rates (1-specificity). In the context of meta-analysis one pair represents one study and
the associated diagram is called an SROC curve where the S stands for “summary”. In meta-analysis of
diagnostic studies emphasis has traditionally been placed on modelling this SROC curve with the intention
of providing a summary measure of the diagnostic accuracy by means of an estimate of the summary ROC
curve. Here, we focus instead on finding sub-groups or components in the data representing different
diagnostic accuracies. The paper will consider modelling SROC curves with the Lehmann family which
is characterised by one parameter only. Each single study can be represented by a specific value of that
parameter. Hence we focus on the distribution of these parameter estimates and suggest modelling a
potential heterogeneous or cluster structure by a mixture of specifically parameterised normal densities.
We point out that this mixture is completely nonparametric and the associated mixture likelihood is welldefined
and globally bounded. We use the theory and algorithms of nonparametric mixture likelihood
estimation to identify a potential cluster structure in the diagnostic accuracies of the collection of studies
to be analysed. Several meta-analytic applications on diagnostic studies, including AUDIT and AUDIT-C
for detection of unhealthy alcohol use, the mini-mental state examination for cognitive disorders, as well
as diagnostic accuracy inspection data on metal fatigue of aircraft spare parts, are discussed to illustrate
the methodology.

This record has no associated files available for download.

More information

Published date: January 2012
Keywords: C.A.MAN, diagnostic testing, meta-analysis, sensitivity, specificity, summary receiver operating characteristic (SROC), summary statistics approach
Organisations: Statistics, Statistical Sciences Research Institute, Primary Care & Population Sciences

Identifiers

Local EPrints ID: 210575
URI: http://eprints.soton.ac.uk/id/eprint/210575
ISSN: 0033-3123
PURE UUID: e96ca402-eda9-4367-b171-114e73144f4e
ORCID for Dankmar Böhning: ORCID iD orcid.org/0000-0003-0638-7106

Catalogue record

Date deposited: 09 Feb 2012 16:00
Last modified: 15 Mar 2024 03:39

Export record

Altmetrics

Contributors

Author: Heinz Holling
Author: Walailuck Böhning

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×