Individualised variable-interval risk-based screening in diabetic retinopathy: the ISDR research programme including RCT
Individualised variable-interval risk-based screening in diabetic retinopathy: the ISDR research programme including RCT
Background: systematic annual screening for sight-threatening diabetic retinopathy is established in several countries but is resource intensive. Personalised (individualised) medicine offers the opportunity to extend screening intervals for people at low risk of progression and to target high-risk groups. However, significant concern exists among all stakeholders around the safety of changing programmes. Evidence to guide decisions is limited, with, to the best of our knowledge, no randomised controlled trials to date.
Objectives: to develop an individualised approach to screening for sight-threatening diabetic retinopathy and test its acceptability, safety, efficacy and cost-effectiveness. To estimate the changing incidence of patient-centred outcomes.
Design: a risk calculation engine; a randomised controlled trial, including a within-trial cost-effectiveness study; a qualitative acceptability study; and an observational epidemiological cohort study were developed. A patient and public group was involved in design and interpretation.
Setting: a screening programme in an English health district of around 450,000 people.
Participants: people with diabetes aged ≥ 12 years registered with primary care practices in Liverpool.
Interventions: the risk calculation engine estimated each participant’s risk at each visit of progression to screen-positive diabetic retinopathy (individualised intervention group) and allocated their next appointment at 6, 12 or 24 months (high, medium or low risk, respectively).
Main outcome measures: the randomised controlled trial primary outcome was attendance at first follow-up assessing the safety of individualised compared with usual screening. Secondary outcomes were overall attendance, rates of screen-positive and sight-threatening diabetic retinopathy, and measures of visual impairment. Cost-effectiveness outcomes were cost/quality-adjusted life year and incremental cost savings. Cohort study outcomes were rates of screen-positive diabetic retinopathy and sight-threatening diabetic retinopathy.
Data sources: local screening programme (retinopathy), primary care (demographic, clinical) and hospital outcomes.
Methods: a seven-person patient and public involvement group was recruited. Data were linked into a purpose-built dynamic data warehouse. In the risk assessment, the risk calculation engine used patient-embedded covariate data, a continuous Markov model, 5-year historical local population data, and most recent individual demographic, retina and clinical data to predict risk of future progression to screen-positive. The randomised controlled trial was a masked, two-arm, parallel assignment, equivalence randomised controlled trial, with an independent trials unit and 1 : 1 allocation to individualised screening (6, 12 or 24 months, determined by risk calculation engine at each visit) or annual screening (control). Cost-effectiveness was assessed using a within-trial analysis over a 2-year time horizon, including NHS and societal perspectives and costs directly observed within the randomised controlled trial. Acceptability was assessed by purposive sampling of 60 people with diabetes and 21 healthcare professionals with semistructured interviews analysed thematically; this was a constant comparative method until saturation. The cohort was an 11-year retrospective/prospective screening population data set.
Results: in the randomised controlled trial, 4534 participants were randomised: 2097 out of 2265 in the individualised arm (92.6%) and 2224 out of 2269 in the control arm (98.0%) remained after withdrawals. Attendance rates at first follow-up were equivalent (individualised 83.6%, control 84.7%) (difference –1.0%, 95% confidence interval –3.2% to 1.2%). Sight-threatening diabetic retinopathy detection rates were non-inferior: individualised 1.4%, control 1.7% (difference –0.3%, 95% confidence interval –1.1% to 0.5%). In the cost-effectiveness analysis, the mean differences in complete-case quality-adjusted life years (EuroQol-5 Dimensions, five-level version, and Health Utilities Index Mark 3) did not significantly differ from zero. Incremental cost savings per person not including treatment costs were from the NHS perspective £17.34 (confidence interval £17.02 to £17.67) and the societal perspective £23.11 (confidence interval £22.73 to £23.53). In the individualised arm, 43.2% fewer screening appointments were required. In terms of acceptability, changing to variable intervals was acceptable for the majority of people with diabetes and health-care professionals. Annual screening was perceived as unsustainable and an inefficient use of resources. Many people with diabetes and healthcare professionals expressed concerns that 2-year screening intervals may detect referable eye disease too late and might have a negative effect on perceptions about the importance of attendance and diabetes care. The 6-month interval was perceived positively. Among people with dementia, there was considerable misunderstanding about eye-related appointments and care. In the cohort study, the numbers of participants (total 28,384) rose over the 11 years (2006/7, n = 6637; 2016/17, n = 14,864). Annual incidences ranged as follows: screen-positive 4.4–10.6%, due to diabetic retinopathy 2.3–4.6% and sight-threatening diabetic retinopathy 1.3–2.2%. The proportions of screen-positive fell steadily but sight-threatening diabetic retinopathy rates remained stable.
Limitations: our findings apply to a single city-wide established English screening programme of mostly white people with diabetes. The cost-effectiveness analysis was over a short timeline for a long-standing disease; the study, however, was designed to test the safety and effectiveness of the screening regimen, not the cost-effectiveness of screening compared with no screening. Cohort data collection was partly retrospective: data were unavailable on people who had developed sight-threatening diabetic retinopathy or died prior to 2013.
Conclusions: our randomised controlled trial can reassure stakeholders involved in diabetes care that extended intervals and personalised screening is feasible, where data linkage is possible, and can be safely introduced in established screening programmes with potential cost savings compared with annual screening. Rates of screen-positive diabetic retinopathy and sight-threatening diabetic retinopathy are low and show consistent falls over time. Involvement of patients in research is crucial to success.
Future work: future work could include external validation with other programmes followed by scale-up of individualised screening outside a research setting and economic modelling beyond the 2-year time horizon.
Trial registration: this trial is registered as ISRCTN87561257.
Funding: this project was funded by the National Institute for Health and Care Research (NIHR) Programme Grants for Applied Research programme and will be published in full in Programme Grants for Applied Research; Vol. 11, No. 6. See the NIHR Journals Library website for further project information.
Harding, Simon
740d199f-f8fa-42d6-bb97-355f9a4e013f
Alshukri, Ayesh
882eff3f-3f75-4c29-8d9e-354984a6486a
Appelbe, Duncan
7c26f144-d515-4719-824f-81869c4fc8bd
Broadbent, Deborah
b8be8c08-fcc5-430b-a15b-892dca6755b3
Burgess, Philip
a050e85b-e6c0-41db-815e-19e29a6ead2b
Byrne, Paula
27477d27-1169-4c39-a749-76ac188fa58a
Cheyne, Christopher
ec078d25-27f4-4e9f-a8ed-0066d33a492c
Eleuteri, Antonio
751fdb42-d0c0-49a8-80c3-d55e2b3cae60
Fisher, Anthony
549d479f-c5c5-4f96-add1-afccc07ee098
García-Fiñana, Marta
3ed2efab-455f-42bf-ae3e-4171a6af98ed
Gabbay, Mark
8a2b4866-65d4-4690-aeba-6545d2895e6f
James, Marilyn
99de860b-029b-4379-9816-0a002d247888
Lathe, James
5c6b70bd-7e75-4942-b5ec-b118c4d78a27
Moitt, Tracy
d9bfa471-f346-4a7f-883e-1644ee1dd4f6
Rahni, Mehrdad Mobayen
f276d866-546a-4d7c-b840-32ca9c001a60
Roberts, John
3ca04dd9-fa31-441d-a367-1fcc0ab2dd60
Sampson, Christopher
ed8dab94-5383-4d4f-99df-a6549398d38d
Seddon, Daniel
704b646b-e992-4434-abab-49505d551e33
Stratton, Irene
772f25b9-23c0-4240-a3f6-1e76b03b172f
Thetford, Clare
04ce0b7d-d7b9-4c56-8996-236b2148a22f
Vazquez-Arango, Pilar
76a9e79a-6d49-4d0f-b7ac-0b9b1873b7e1
Vora, Jiten
f2ed9ea3-866c-4a82-88c0-3acef3e55cc2
Wang, Amu
aedb6067-d86c-4f26-bba1-d8a8911a995a
Williamson, Paula
c16e50ad-6a7d-4d5a-b458-bfdd6a1df118
October 2023
Harding, Simon
740d199f-f8fa-42d6-bb97-355f9a4e013f
Alshukri, Ayesh
882eff3f-3f75-4c29-8d9e-354984a6486a
Appelbe, Duncan
7c26f144-d515-4719-824f-81869c4fc8bd
Broadbent, Deborah
b8be8c08-fcc5-430b-a15b-892dca6755b3
Burgess, Philip
a050e85b-e6c0-41db-815e-19e29a6ead2b
Byrne, Paula
27477d27-1169-4c39-a749-76ac188fa58a
Cheyne, Christopher
ec078d25-27f4-4e9f-a8ed-0066d33a492c
Eleuteri, Antonio
751fdb42-d0c0-49a8-80c3-d55e2b3cae60
Fisher, Anthony
549d479f-c5c5-4f96-add1-afccc07ee098
García-Fiñana, Marta
3ed2efab-455f-42bf-ae3e-4171a6af98ed
Gabbay, Mark
8a2b4866-65d4-4690-aeba-6545d2895e6f
James, Marilyn
99de860b-029b-4379-9816-0a002d247888
Lathe, James
5c6b70bd-7e75-4942-b5ec-b118c4d78a27
Moitt, Tracy
d9bfa471-f346-4a7f-883e-1644ee1dd4f6
Rahni, Mehrdad Mobayen
f276d866-546a-4d7c-b840-32ca9c001a60
Roberts, John
3ca04dd9-fa31-441d-a367-1fcc0ab2dd60
Sampson, Christopher
ed8dab94-5383-4d4f-99df-a6549398d38d
Seddon, Daniel
704b646b-e992-4434-abab-49505d551e33
Stratton, Irene
772f25b9-23c0-4240-a3f6-1e76b03b172f
Thetford, Clare
04ce0b7d-d7b9-4c56-8996-236b2148a22f
Vazquez-Arango, Pilar
76a9e79a-6d49-4d0f-b7ac-0b9b1873b7e1
Vora, Jiten
f2ed9ea3-866c-4a82-88c0-3acef3e55cc2
Wang, Amu
aedb6067-d86c-4f26-bba1-d8a8911a995a
Williamson, Paula
c16e50ad-6a7d-4d5a-b458-bfdd6a1df118
Harding, Simon, Alshukri, Ayesh, Appelbe, Duncan, Broadbent, Deborah, Burgess, Philip, Byrne, Paula, Cheyne, Christopher, Eleuteri, Antonio, Fisher, Anthony, García-Fiñana, Marta, Gabbay, Mark, James, Marilyn, Lathe, James, Moitt, Tracy, Rahni, Mehrdad Mobayen, Roberts, John, Sampson, Christopher, Seddon, Daniel, Stratton, Irene, Thetford, Clare, Vazquez-Arango, Pilar, Vora, Jiten, Wang, Amu and Williamson, Paula
(2023)
Individualised variable-interval risk-based screening in diabetic retinopathy: the ISDR research programme including RCT.
Programme Grants for Applied Research, 11 (6).
(doi:10.3310/HRFA3155).
Abstract
Background: systematic annual screening for sight-threatening diabetic retinopathy is established in several countries but is resource intensive. Personalised (individualised) medicine offers the opportunity to extend screening intervals for people at low risk of progression and to target high-risk groups. However, significant concern exists among all stakeholders around the safety of changing programmes. Evidence to guide decisions is limited, with, to the best of our knowledge, no randomised controlled trials to date.
Objectives: to develop an individualised approach to screening for sight-threatening diabetic retinopathy and test its acceptability, safety, efficacy and cost-effectiveness. To estimate the changing incidence of patient-centred outcomes.
Design: a risk calculation engine; a randomised controlled trial, including a within-trial cost-effectiveness study; a qualitative acceptability study; and an observational epidemiological cohort study were developed. A patient and public group was involved in design and interpretation.
Setting: a screening programme in an English health district of around 450,000 people.
Participants: people with diabetes aged ≥ 12 years registered with primary care practices in Liverpool.
Interventions: the risk calculation engine estimated each participant’s risk at each visit of progression to screen-positive diabetic retinopathy (individualised intervention group) and allocated their next appointment at 6, 12 or 24 months (high, medium or low risk, respectively).
Main outcome measures: the randomised controlled trial primary outcome was attendance at first follow-up assessing the safety of individualised compared with usual screening. Secondary outcomes were overall attendance, rates of screen-positive and sight-threatening diabetic retinopathy, and measures of visual impairment. Cost-effectiveness outcomes were cost/quality-adjusted life year and incremental cost savings. Cohort study outcomes were rates of screen-positive diabetic retinopathy and sight-threatening diabetic retinopathy.
Data sources: local screening programme (retinopathy), primary care (demographic, clinical) and hospital outcomes.
Methods: a seven-person patient and public involvement group was recruited. Data were linked into a purpose-built dynamic data warehouse. In the risk assessment, the risk calculation engine used patient-embedded covariate data, a continuous Markov model, 5-year historical local population data, and most recent individual demographic, retina and clinical data to predict risk of future progression to screen-positive. The randomised controlled trial was a masked, two-arm, parallel assignment, equivalence randomised controlled trial, with an independent trials unit and 1 : 1 allocation to individualised screening (6, 12 or 24 months, determined by risk calculation engine at each visit) or annual screening (control). Cost-effectiveness was assessed using a within-trial analysis over a 2-year time horizon, including NHS and societal perspectives and costs directly observed within the randomised controlled trial. Acceptability was assessed by purposive sampling of 60 people with diabetes and 21 healthcare professionals with semistructured interviews analysed thematically; this was a constant comparative method until saturation. The cohort was an 11-year retrospective/prospective screening population data set.
Results: in the randomised controlled trial, 4534 participants were randomised: 2097 out of 2265 in the individualised arm (92.6%) and 2224 out of 2269 in the control arm (98.0%) remained after withdrawals. Attendance rates at first follow-up were equivalent (individualised 83.6%, control 84.7%) (difference –1.0%, 95% confidence interval –3.2% to 1.2%). Sight-threatening diabetic retinopathy detection rates were non-inferior: individualised 1.4%, control 1.7% (difference –0.3%, 95% confidence interval –1.1% to 0.5%). In the cost-effectiveness analysis, the mean differences in complete-case quality-adjusted life years (EuroQol-5 Dimensions, five-level version, and Health Utilities Index Mark 3) did not significantly differ from zero. Incremental cost savings per person not including treatment costs were from the NHS perspective £17.34 (confidence interval £17.02 to £17.67) and the societal perspective £23.11 (confidence interval £22.73 to £23.53). In the individualised arm, 43.2% fewer screening appointments were required. In terms of acceptability, changing to variable intervals was acceptable for the majority of people with diabetes and health-care professionals. Annual screening was perceived as unsustainable and an inefficient use of resources. Many people with diabetes and healthcare professionals expressed concerns that 2-year screening intervals may detect referable eye disease too late and might have a negative effect on perceptions about the importance of attendance and diabetes care. The 6-month interval was perceived positively. Among people with dementia, there was considerable misunderstanding about eye-related appointments and care. In the cohort study, the numbers of participants (total 28,384) rose over the 11 years (2006/7, n = 6637; 2016/17, n = 14,864). Annual incidences ranged as follows: screen-positive 4.4–10.6%, due to diabetic retinopathy 2.3–4.6% and sight-threatening diabetic retinopathy 1.3–2.2%. The proportions of screen-positive fell steadily but sight-threatening diabetic retinopathy rates remained stable.
Limitations: our findings apply to a single city-wide established English screening programme of mostly white people with diabetes. The cost-effectiveness analysis was over a short timeline for a long-standing disease; the study, however, was designed to test the safety and effectiveness of the screening regimen, not the cost-effectiveness of screening compared with no screening. Cohort data collection was partly retrospective: data were unavailable on people who had developed sight-threatening diabetic retinopathy or died prior to 2013.
Conclusions: our randomised controlled trial can reassure stakeholders involved in diabetes care that extended intervals and personalised screening is feasible, where data linkage is possible, and can be safely introduced in established screening programmes with potential cost savings compared with annual screening. Rates of screen-positive diabetic retinopathy and sight-threatening diabetic retinopathy are low and show consistent falls over time. Involvement of patients in research is crucial to success.
Future work: future work could include external validation with other programmes followed by scale-up of individualised screening outside a research setting and economic modelling beyond the 2-year time horizon.
Trial registration: this trial is registered as ISRCTN87561257.
Funding: this project was funded by the National Institute for Health and Care Research (NIHR) Programme Grants for Applied Research programme and will be published in full in Programme Grants for Applied Research; Vol. 11, No. 6. See the NIHR Journals Library website for further project information.
Text
3044197
- Version of Record
More information
Published date: October 2023
Additional Information:
Funding Information:
T he authors are grateful to the IS?R PPI Group for essential input into design and review, to the Liverpool Clinical Commissioning Group (LCCG) for data extraction and transfer, and to the Liverpool Local Medical Committee and local GPs for support with establishing patient lists and consent. We would like to acknowledge the outstanding attention to detail from the IS?R administrative team, the Clinical Trials Research Centre, the North West Coast Clinical Research Network and our other trained researchers for their immeasurable help in recruiting to target, and the Liverpool ?iabetic Eye agrorecS te srorm n s aCoen ohort c study. We received considerable support from our sponsors, The Royal Liverpool and Broadgreen University Hospitals NHS Trust, now Liverpool University Hospital NHS Foundation Trust, throughout the programme, including additional funding to support recruitment and the ?W.
Funding Information:
This work package was supported by work from the PPI group around patient-centred outcomes as well as data collected in the IS?R ?W (WP B1).
Publisher Copyright:
© 2023, NIHR Journals Library. All rights reserved.
Identifiers
Local EPrints ID: 487089
URI: http://eprints.soton.ac.uk/id/eprint/487089
ISSN: 2050-4322
PURE UUID: 409ce5bf-f54f-453c-98f2-8f736bbe4af1
Catalogue record
Date deposited: 13 Feb 2024 17:31
Last modified: 18 Mar 2024 04:01
Export record
Altmetrics
Contributors
Author:
Simon Harding
Author:
Ayesh Alshukri
Author:
Duncan Appelbe
Author:
Deborah Broadbent
Author:
Philip Burgess
Author:
Paula Byrne
Author:
Christopher Cheyne
Author:
Antonio Eleuteri
Author:
Anthony Fisher
Author:
Marta García-Fiñana
Author:
Mark Gabbay
Author:
Marilyn James
Author:
James Lathe
Author:
Tracy Moitt
Author:
Mehrdad Mobayen Rahni
Author:
John Roberts
Author:
Christopher Sampson
Author:
Daniel Seddon
Author:
Irene Stratton
Author:
Clare Thetford
Author:
Pilar Vazquez-Arango
Author:
Jiten Vora
Author:
Amu Wang
Author:
Paula Williamson
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.
View more statistics