Likelihood-based clustering of meta-analytic SROC curves
Likelihood-based clustering of meta-analytic SROC curves
Meta-analysis of diagnostic studies experience the common problem that different studies might
not be comparable since they have been using a different cut-off value for the continuous or ordered
categorical diagnostic test value defining different regions for which the diagnostic test is defined to be
positive. Hence specificities and sensitivities arising from different studies might vary just because the
underlying cut-off value had been different. To cope with the cut-off value problem interest is usually
directed towards the receiver operating characteristic (ROC) curve which consists of pairs of sensitivities
and false-positive rates (1-specificity). In the context of meta-analysis one pair represents one study and
the associated diagram is called an SROC curve where the S stands for “summary”. In meta-analysis of
diagnostic studies emphasis has traditionally been placed on modelling this SROC curve with the intention
of providing a summary measure of the diagnostic accuracy by means of an estimate of the summary ROC
curve. Here, we focus instead on finding sub-groups or components in the data representing different
diagnostic accuracies. The paper will consider modelling SROC curves with the Lehmann family which
is characterised by one parameter only. Each single study can be represented by a specific value of that
parameter. Hence we focus on the distribution of these parameter estimates and suggest modelling a
potential heterogeneous or cluster structure by a mixture of specifically parameterised normal densities.
We point out that this mixture is completely nonparametric and the associated mixture likelihood is welldefined
and globally bounded. We use the theory and algorithms of nonparametric mixture likelihood
estimation to identify a potential cluster structure in the diagnostic accuracies of the collection of studies
to be analysed. Several meta-analytic applications on diagnostic studies, including AUDIT and AUDIT-C
for detection of unhealthy alcohol use, the mini-mental state examination for cognitive disorders, as well
as diagnostic accuracy inspection data on metal fatigue of aircraft spare parts, are discussed to illustrate
the methodology.
C.A.MAN, diagnostic testing, meta-analysis, sensitivity, specificity, summary receiver operating
characteristic (SROC), summary statistics approach
106-126
Holling, Heinz
88d46f56-77ca-4d0e-b035-a51aff735435
Böhning, Walailuck
e41681ae-1c18-42f9-96d2-e725d47dbeec
Böhning, Dankmar
1df635d4-e3dc-44d0-b61d-5fd11f6434e1
January 2012
Holling, Heinz
88d46f56-77ca-4d0e-b035-a51aff735435
Böhning, Walailuck
e41681ae-1c18-42f9-96d2-e725d47dbeec
Böhning, Dankmar
1df635d4-e3dc-44d0-b61d-5fd11f6434e1
Holling, Heinz, Böhning, Walailuck and Böhning, Dankmar
(2012)
Likelihood-based clustering of meta-analytic SROC curves.
Psychometrika, 77 (1), .
(doi:10.1007/S11336-011-9236-2).
Abstract
Meta-analysis of diagnostic studies experience the common problem that different studies might
not be comparable since they have been using a different cut-off value for the continuous or ordered
categorical diagnostic test value defining different regions for which the diagnostic test is defined to be
positive. Hence specificities and sensitivities arising from different studies might vary just because the
underlying cut-off value had been different. To cope with the cut-off value problem interest is usually
directed towards the receiver operating characteristic (ROC) curve which consists of pairs of sensitivities
and false-positive rates (1-specificity). In the context of meta-analysis one pair represents one study and
the associated diagram is called an SROC curve where the S stands for “summary”. In meta-analysis of
diagnostic studies emphasis has traditionally been placed on modelling this SROC curve with the intention
of providing a summary measure of the diagnostic accuracy by means of an estimate of the summary ROC
curve. Here, we focus instead on finding sub-groups or components in the data representing different
diagnostic accuracies. The paper will consider modelling SROC curves with the Lehmann family which
is characterised by one parameter only. Each single study can be represented by a specific value of that
parameter. Hence we focus on the distribution of these parameter estimates and suggest modelling a
potential heterogeneous or cluster structure by a mixture of specifically parameterised normal densities.
We point out that this mixture is completely nonparametric and the associated mixture likelihood is welldefined
and globally bounded. We use the theory and algorithms of nonparametric mixture likelihood
estimation to identify a potential cluster structure in the diagnostic accuracies of the collection of studies
to be analysed. Several meta-analytic applications on diagnostic studies, including AUDIT and AUDIT-C
for detection of unhealthy alcohol use, the mini-mental state examination for cognitive disorders, as well
as diagnostic accuracy inspection data on metal fatigue of aircraft spare parts, are discussed to illustrate
the methodology.
This record has no associated files available for download.
More information
Published date: January 2012
Keywords:
C.A.MAN, diagnostic testing, meta-analysis, sensitivity, specificity, summary receiver operating
characteristic (SROC), summary statistics approach
Organisations:
Statistics, Statistical Sciences Research Institute, Primary Care & Population Sciences
Identifiers
Local EPrints ID: 210575
URI: http://eprints.soton.ac.uk/id/eprint/210575
ISSN: 0033-3123
PURE UUID: e96ca402-eda9-4367-b171-114e73144f4e
Catalogue record
Date deposited: 09 Feb 2012 16:00
Last modified: 15 Mar 2024 03:39
Export record
Altmetrics
Contributors
Author:
Heinz Holling
Author:
Walailuck Böhning
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.
View more statistics