Deep-learning-based clustering of OCT images for biomarker discovery in age-related macular degeneration (PINNACLE study report 4)
Deep-learning-based clustering of OCT images for biomarker discovery in age-related macular degeneration (PINNACLE study report 4)
Purpose: we introduce a deep learning–based biomarker proposal system for the purpose of accelerating biomarker discovery in age-related macular degeneration (AMD).
Design: retrospective analysis of a large data set of retinal OCT images.
Participants: a total of 3456 adults aged between 51 and 102 years whose OCT images were collected under the PINNACLE project.
Methods: our system proposes candidates for novel AMD imaging biomarkers in OCT. It works by first training a neural network using self-supervised contrastive learning to discover, without any clinical annotations, features relating to both known and unknown AMD biomarkers present in 46 496 retinal OCT images. To interpret the learned biomarkers, we partition the images into 30 subsets, termed clusters, that contain similar features. We conduct 2 parallel 1.5-hour semistructured interviews with 2 independent teams of retinal specialists to assign descriptions in clinical language to each cluster. Descriptions of clusters achieving consensus can potentially inform new biomarker candidates.
Main outcome measures: we checked if each cluster showed clear features comprehensible to retinal specialists, if they related to AMD, and how many described established biomarkers used in grading systems as opposed to recently proposed or potentially new biomarkers. We also compared their prognostic value for late-stage wet and dry AMD against an established clinical grading system and a demographic baseline model.
Results: overall, both teams independently identified clearly distinct characteristics in 27 of 30 clusters, of which 23 were related to AMD. Seven were recognized as known biomarkers used in established grading systems, and 16 depicted biomarker combinations or subtypes that are either not yet used in grading systems, were only recently proposed, or were unknown. Clusters separated incomplete from complete retinal atrophy, intraretinal from subretinal fluid, and thick from thin choroids, and, in simulation, outperformed clinically used grading systems in prognostic value.
Conclusions: using self-supervised deep learning, we were able to automatically propose AMD biomarkers going beyond the set used in clinically established grading systems. Without any clinical annotations, contrastive learning discovered subtle differences between fine-grained biomarkers. Ultimately, we envision that equipping clinicians with discovery-oriented deep learning tools can accelerate the discovery of novel prognostic biomarkers. Financial Disclosure(s): Proprietary or commercial disclosure may be found in the Footnotes and Disclosures at the end of this article.
AMD, Biomarker discovery, Contrastive learning, Deep learning, OCT
Holland, Robbie
52f558d8-4456-4e67-928d-e3914fd5506b
Kaye, Rebecca
056bd707-a54d-40c5-9963-e24b99f60a4a
Hagag, Ahmed M.
25260e22-2a8b-423b-a8ec-8304e2a83fc7
Leingang, Oliver
523e1226-ff2d-48bb-b77a-fcc1f7cb3fc7
Taylor, Thomas R.P.
85b649d1-4f75-4fc7-9972-34b0d75fce8b
Bogunovic, Hrvoje
d94f0d97-5a27-44d7-912d-9e043c2d449b
Schmidt-Erfurth, Ursula
af993078-6680-4d2a-bc50-ebf6abc3857f
Scholl, Hendrik P.N.
2c38ca3c-90a8-455d-a22c-b52508a9890e
Rueckert, Daniel
3c5b51eb-7e44-4a00-ba79-cafb7ab3d970
Lotery, Andrew
5ecc2d2d-d0b4-468f-ad2c-df7156f8e514
Sivaprasad, Sobha
6ae3de79-66b3-4fc5-a91d-7de5f5887038
Menten, Martin J.
d6fda4c6-08d5-48b4-bff4-9ccae4a04cef
22 July 2024
Holland, Robbie
52f558d8-4456-4e67-928d-e3914fd5506b
Kaye, Rebecca
056bd707-a54d-40c5-9963-e24b99f60a4a
Hagag, Ahmed M.
25260e22-2a8b-423b-a8ec-8304e2a83fc7
Leingang, Oliver
523e1226-ff2d-48bb-b77a-fcc1f7cb3fc7
Taylor, Thomas R.P.
85b649d1-4f75-4fc7-9972-34b0d75fce8b
Bogunovic, Hrvoje
d94f0d97-5a27-44d7-912d-9e043c2d449b
Schmidt-Erfurth, Ursula
af993078-6680-4d2a-bc50-ebf6abc3857f
Scholl, Hendrik P.N.
2c38ca3c-90a8-455d-a22c-b52508a9890e
Rueckert, Daniel
3c5b51eb-7e44-4a00-ba79-cafb7ab3d970
Lotery, Andrew
5ecc2d2d-d0b4-468f-ad2c-df7156f8e514
Sivaprasad, Sobha
6ae3de79-66b3-4fc5-a91d-7de5f5887038
Menten, Martin J.
d6fda4c6-08d5-48b4-bff4-9ccae4a04cef
Holland, Robbie, Kaye, Rebecca, Hagag, Ahmed M., Leingang, Oliver, Taylor, Thomas R.P., Bogunovic, Hrvoje, Schmidt-Erfurth, Ursula, Scholl, Hendrik P.N., Rueckert, Daniel, Lotery, Andrew, Sivaprasad, Sobha and Menten, Martin J.
(2024)
Deep-learning-based clustering of OCT images for biomarker discovery in age-related macular degeneration (PINNACLE study report 4).
Ophthalmology Science, 4 (6), [100543].
(doi:10.1016/j.xops.2024.100543).
Abstract
Purpose: we introduce a deep learning–based biomarker proposal system for the purpose of accelerating biomarker discovery in age-related macular degeneration (AMD).
Design: retrospective analysis of a large data set of retinal OCT images.
Participants: a total of 3456 adults aged between 51 and 102 years whose OCT images were collected under the PINNACLE project.
Methods: our system proposes candidates for novel AMD imaging biomarkers in OCT. It works by first training a neural network using self-supervised contrastive learning to discover, without any clinical annotations, features relating to both known and unknown AMD biomarkers present in 46 496 retinal OCT images. To interpret the learned biomarkers, we partition the images into 30 subsets, termed clusters, that contain similar features. We conduct 2 parallel 1.5-hour semistructured interviews with 2 independent teams of retinal specialists to assign descriptions in clinical language to each cluster. Descriptions of clusters achieving consensus can potentially inform new biomarker candidates.
Main outcome measures: we checked if each cluster showed clear features comprehensible to retinal specialists, if they related to AMD, and how many described established biomarkers used in grading systems as opposed to recently proposed or potentially new biomarkers. We also compared their prognostic value for late-stage wet and dry AMD against an established clinical grading system and a demographic baseline model.
Results: overall, both teams independently identified clearly distinct characteristics in 27 of 30 clusters, of which 23 were related to AMD. Seven were recognized as known biomarkers used in established grading systems, and 16 depicted biomarker combinations or subtypes that are either not yet used in grading systems, were only recently proposed, or were unknown. Clusters separated incomplete from complete retinal atrophy, intraretinal from subretinal fluid, and thick from thin choroids, and, in simulation, outperformed clinically used grading systems in prognostic value.
Conclusions: using self-supervised deep learning, we were able to automatically propose AMD biomarkers going beyond the set used in clinically established grading systems. Without any clinical annotations, contrastive learning discovered subtle differences between fine-grained biomarkers. Ultimately, we envision that equipping clinicians with discovery-oriented deep learning tools can accelerate the discovery of novel prognostic biomarkers. Financial Disclosure(s): Proprietary or commercial disclosure may be found in the Footnotes and Disclosures at the end of this article.
Text
Deep clustering (Robbie Holland)
- Accepted Manuscript
Text
1-s2.0-S2666914524000794-main
- Version of Record
More information
Accepted/In Press date: 26 April 2024
e-pub ahead of print date: 31 May 2024
Published date: 22 July 2024
Keywords:
AMD, Biomarker discovery, Contrastive learning, Deep learning, OCT
Identifiers
Local EPrints ID: 493467
URI: http://eprints.soton.ac.uk/id/eprint/493467
ISSN: 2666-9145
PURE UUID: ac1076af-ba48-4c04-8b2e-30997dc93625
Catalogue record
Date deposited: 03 Sep 2024 16:46
Last modified: 04 Sep 2024 01:38
Export record
Altmetrics
Contributors
Author:
Robbie Holland
Author:
Rebecca Kaye
Author:
Ahmed M. Hagag
Author:
Oliver Leingang
Author:
Thomas R.P. Taylor
Author:
Hrvoje Bogunovic
Author:
Ursula Schmidt-Erfurth
Author:
Hendrik P.N. Scholl
Author:
Daniel Rueckert
Author:
Sobha Sivaprasad
Author:
Martin J. Menten
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.
View more statistics