The University of Southampton
University of Southampton Institutional Repository

The use of statistical methodology to determine the accuracy of grading within a diabetic retinopathy screening programme

The use of statistical methodology to determine the accuracy of grading within a diabetic retinopathy screening programme
The use of statistical methodology to determine the accuracy of grading within a diabetic retinopathy screening programme

Aims: we aimed to use longitudinal data from an established screening programme with good quality assurance and quality control procedures and a stable well-trained workforce to determine the accuracy of grading in diabetic retinopathy screening.


Methods: we used a continuous time-hidden Markov model with five states to estimate the probability of true progression or regression of retinopathy and the conditional probability of an observed grade given the true grade (misclassification). The true stage of retinopathy was modelled as a function of the duration of diabetes and HbA1c.


Results: the modelling dataset consisted of 65 839 grades from 14 187 people. The median number [interquartile range (IQR)] of examinations was 5 (3, 6) and the median (IQR) interval between examinations was 1.04 (0.99, 1.17) years. In total, 14 227 grades (21.6%) were estimated as being misclassified, 10 592 (16.1%) represented over-grading and 3635 (5.5%) represented under-grading. There were 1935 (2.9%) misclassified referrals, 1305 were false-positive results (2.2%) and 630 were false-negative results (11.0%). Misclassification of background diabetic retinopathy as no detectable retinopathy was common (3.4% of all grades) but rarely preceded referable maculopathy or retinopathy.


Conclusion: misclassification between lower grades of retinopathy is not uncommon but is unlikely to lead to significant delays in referring people for sight-threatening retinopathy.

0742-3071
896-903
Oke, J.L.
e24a0f8c-f88f-47f8-af5e-6e0c9c8f40a8
Stratton, I.M.
772f25b9-23c0-4240-a3f6-1e76b03b172f
Aldington, S.J.
0d0ac922-21f1-4198-91eb-893231cc53c4
Stevens, R.J.
6084d88b-f434-47ef-810a-0510080a3d6f
Scanlon, P.H.
4e3d2310-c79e-42db-ae29-7a7d6b278aa3
Oke, J.L.
e24a0f8c-f88f-47f8-af5e-6e0c9c8f40a8
Stratton, I.M.
772f25b9-23c0-4240-a3f6-1e76b03b172f
Aldington, S.J.
0d0ac922-21f1-4198-91eb-893231cc53c4
Stevens, R.J.
6084d88b-f434-47ef-810a-0510080a3d6f
Scanlon, P.H.
4e3d2310-c79e-42db-ae29-7a7d6b278aa3

Oke, J.L., Stratton, I.M., Aldington, S.J., Stevens, R.J. and Scanlon, P.H. (2016) The use of statistical methodology to determine the accuracy of grading within a diabetic retinopathy screening programme. Diabetic Medicine, 33 (7), 896-903. (doi:10.1111/dme.13053).

Record type: Article

Abstract

Aims: we aimed to use longitudinal data from an established screening programme with good quality assurance and quality control procedures and a stable well-trained workforce to determine the accuracy of grading in diabetic retinopathy screening.


Methods: we used a continuous time-hidden Markov model with five states to estimate the probability of true progression or regression of retinopathy and the conditional probability of an observed grade given the true grade (misclassification). The true stage of retinopathy was modelled as a function of the duration of diabetes and HbA1c.


Results: the modelling dataset consisted of 65 839 grades from 14 187 people. The median number [interquartile range (IQR)] of examinations was 5 (3, 6) and the median (IQR) interval between examinations was 1.04 (0.99, 1.17) years. In total, 14 227 grades (21.6%) were estimated as being misclassified, 10 592 (16.1%) represented over-grading and 3635 (5.5%) represented under-grading. There were 1935 (2.9%) misclassified referrals, 1305 were false-positive results (2.2%) and 630 were false-negative results (11.0%). Misclassification of background diabetic retinopathy as no detectable retinopathy was common (3.4% of all grades) but rarely preceded referable maculopathy or retinopathy.


Conclusion: misclassification between lower grades of retinopathy is not uncommon but is unlikely to lead to significant delays in referring people for sight-threatening retinopathy.

Text
3044197 - Version of Record
Download (2MB)

More information

Accepted/In Press date: 7 December 2015
e-pub ahead of print date: 15 December 2015
Published date: 10 January 2016
Additional Information: A correction has been attached to this output located at https://doi.org/10.1111/dme.14104 and https://onlinelibrary.wiley.com/doi/10.1111/dme.14104

Identifiers

Local EPrints ID: 487143
URI: http://eprints.soton.ac.uk/id/eprint/487143
ISSN: 0742-3071
PURE UUID: 564cbbbd-30c7-4489-b581-0750d8531bf6
ORCID for I.M. Stratton: ORCID iD orcid.org/0000-0003-1172-7865

Catalogue record

Date deposited: 14 Feb 2024 17:42
Last modified: 18 Mar 2024 04:01

Export record

Altmetrics

Contributors

Author: J.L. Oke
Author: I.M. Stratton ORCID iD
Author: S.J. Aldington
Author: R.J. Stevens
Author: P.H. Scanlon

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×