The University of Southampton
University of Southampton Institutional Repository

Deep-learning-based clustering of OCT images for biomarker discovery in age-related macular degeneration (PINNACLE study report 4)

Deep-learning-based clustering of OCT images for biomarker discovery in age-related macular degeneration (PINNACLE study report 4)
Deep-learning-based clustering of OCT images for biomarker discovery in age-related macular degeneration (PINNACLE study report 4)

Purpose: we introduce a deep learning–based biomarker proposal system for the purpose of accelerating biomarker discovery in age-related macular degeneration (AMD). 

Design: retrospective analysis of a large data set of retinal OCT images.

Participants: a total of 3456 adults aged between 51 and 102 years whose OCT images were collected under the PINNACLE project. 

Methods: our system proposes candidates for novel AMD imaging biomarkers in OCT. It works by first training a neural network using self-supervised contrastive learning to discover, without any clinical annotations, features relating to both known and unknown AMD biomarkers present in 46 496 retinal OCT images. To interpret the learned biomarkers, we partition the images into 30 subsets, termed clusters, that contain similar features. We conduct 2 parallel 1.5-hour semistructured interviews with 2 independent teams of retinal specialists to assign descriptions in clinical language to each cluster. Descriptions of clusters achieving consensus can potentially inform new biomarker candidates. 

Main outcome measures: we checked if each cluster showed clear features comprehensible to retinal specialists, if they related to AMD, and how many described established biomarkers used in grading systems as opposed to recently proposed or potentially new biomarkers. We also compared their prognostic value for late-stage wet and dry AMD against an established clinical grading system and a demographic baseline model. 

Results: overall, both teams independently identified clearly distinct characteristics in 27 of 30 clusters, of which 23 were related to AMD. Seven were recognized as known biomarkers used in established grading systems, and 16 depicted biomarker combinations or subtypes that are either not yet used in grading systems, were only recently proposed, or were unknown. Clusters separated incomplete from complete retinal atrophy, intraretinal from subretinal fluid, and thick from thin choroids, and, in simulation, outperformed clinically used grading systems in prognostic value.

Conclusions: using self-supervised deep learning, we were able to automatically propose AMD biomarkers going beyond the set used in clinically established grading systems. Without any clinical annotations, contrastive learning discovered subtle differences between fine-grained biomarkers. Ultimately, we envision that equipping clinicians with discovery-oriented deep learning tools can accelerate the discovery of novel prognostic biomarkers. Financial Disclosure(s): Proprietary or commercial disclosure may be found in the Footnotes and Disclosures at the end of this article.

AMD, Biomarker discovery, Contrastive learning, Deep learning, OCT
2666-9145
Holland, Robbie
52f558d8-4456-4e67-928d-e3914fd5506b
Kaye, Rebecca
056bd707-a54d-40c5-9963-e24b99f60a4a
Hagag, Ahmed M.
25260e22-2a8b-423b-a8ec-8304e2a83fc7
Leingang, Oliver
523e1226-ff2d-48bb-b77a-fcc1f7cb3fc7
Taylor, Thomas R.P.
85b649d1-4f75-4fc7-9972-34b0d75fce8b
Bogunovic, Hrvoje
d94f0d97-5a27-44d7-912d-9e043c2d449b
Schmidt-Erfurth, Ursula
af993078-6680-4d2a-bc50-ebf6abc3857f
Scholl, Hendrik P.N.
2c38ca3c-90a8-455d-a22c-b52508a9890e
Rueckert, Daniel
3c5b51eb-7e44-4a00-ba79-cafb7ab3d970
Lotery, Andrew
5ecc2d2d-d0b4-468f-ad2c-df7156f8e514
Sivaprasad, Sobha
6ae3de79-66b3-4fc5-a91d-7de5f5887038
Menten, Martin J.
d6fda4c6-08d5-48b4-bff4-9ccae4a04cef
Holland, Robbie
52f558d8-4456-4e67-928d-e3914fd5506b
Kaye, Rebecca
056bd707-a54d-40c5-9963-e24b99f60a4a
Hagag, Ahmed M.
25260e22-2a8b-423b-a8ec-8304e2a83fc7
Leingang, Oliver
523e1226-ff2d-48bb-b77a-fcc1f7cb3fc7
Taylor, Thomas R.P.
85b649d1-4f75-4fc7-9972-34b0d75fce8b
Bogunovic, Hrvoje
d94f0d97-5a27-44d7-912d-9e043c2d449b
Schmidt-Erfurth, Ursula
af993078-6680-4d2a-bc50-ebf6abc3857f
Scholl, Hendrik P.N.
2c38ca3c-90a8-455d-a22c-b52508a9890e
Rueckert, Daniel
3c5b51eb-7e44-4a00-ba79-cafb7ab3d970
Lotery, Andrew
5ecc2d2d-d0b4-468f-ad2c-df7156f8e514
Sivaprasad, Sobha
6ae3de79-66b3-4fc5-a91d-7de5f5887038
Menten, Martin J.
d6fda4c6-08d5-48b4-bff4-9ccae4a04cef

Holland, Robbie, Kaye, Rebecca, Hagag, Ahmed M., Leingang, Oliver, Taylor, Thomas R.P., Bogunovic, Hrvoje, Schmidt-Erfurth, Ursula, Scholl, Hendrik P.N., Rueckert, Daniel, Lotery, Andrew, Sivaprasad, Sobha and Menten, Martin J. (2024) Deep-learning-based clustering of OCT images for biomarker discovery in age-related macular degeneration (PINNACLE study report 4). Ophthalmology Science, 4 (6), [100543]. (doi:10.1016/j.xops.2024.100543).

Record type: Article

Abstract

Purpose: we introduce a deep learning–based biomarker proposal system for the purpose of accelerating biomarker discovery in age-related macular degeneration (AMD). 

Design: retrospective analysis of a large data set of retinal OCT images.

Participants: a total of 3456 adults aged between 51 and 102 years whose OCT images were collected under the PINNACLE project. 

Methods: our system proposes candidates for novel AMD imaging biomarkers in OCT. It works by first training a neural network using self-supervised contrastive learning to discover, without any clinical annotations, features relating to both known and unknown AMD biomarkers present in 46 496 retinal OCT images. To interpret the learned biomarkers, we partition the images into 30 subsets, termed clusters, that contain similar features. We conduct 2 parallel 1.5-hour semistructured interviews with 2 independent teams of retinal specialists to assign descriptions in clinical language to each cluster. Descriptions of clusters achieving consensus can potentially inform new biomarker candidates. 

Main outcome measures: we checked if each cluster showed clear features comprehensible to retinal specialists, if they related to AMD, and how many described established biomarkers used in grading systems as opposed to recently proposed or potentially new biomarkers. We also compared their prognostic value for late-stage wet and dry AMD against an established clinical grading system and a demographic baseline model. 

Results: overall, both teams independently identified clearly distinct characteristics in 27 of 30 clusters, of which 23 were related to AMD. Seven were recognized as known biomarkers used in established grading systems, and 16 depicted biomarker combinations or subtypes that are either not yet used in grading systems, were only recently proposed, or were unknown. Clusters separated incomplete from complete retinal atrophy, intraretinal from subretinal fluid, and thick from thin choroids, and, in simulation, outperformed clinically used grading systems in prognostic value.

Conclusions: using self-supervised deep learning, we were able to automatically propose AMD biomarkers going beyond the set used in clinically established grading systems. Without any clinical annotations, contrastive learning discovered subtle differences between fine-grained biomarkers. Ultimately, we envision that equipping clinicians with discovery-oriented deep learning tools can accelerate the discovery of novel prognostic biomarkers. Financial Disclosure(s): Proprietary or commercial disclosure may be found in the Footnotes and Disclosures at the end of this article.

Text
Deep clustering (Robbie Holland) - Accepted Manuscript
Available under License Creative Commons Attribution.
Download (12MB)
Text
1-s2.0-S2666914524000794-main - Version of Record
Available under License Creative Commons Attribution.
Download (5MB)

More information

Accepted/In Press date: 26 April 2024
e-pub ahead of print date: 31 May 2024
Published date: 22 July 2024
Keywords: AMD, Biomarker discovery, Contrastive learning, Deep learning, OCT

Identifiers

Local EPrints ID: 493467
URI: http://eprints.soton.ac.uk/id/eprint/493467
ISSN: 2666-9145
PURE UUID: ac1076af-ba48-4c04-8b2e-30997dc93625
ORCID for Andrew Lotery: ORCID iD orcid.org/0000-0001-5541-4305

Catalogue record

Date deposited: 03 Sep 2024 16:46
Last modified: 04 Sep 2024 01:38

Export record

Altmetrics

Contributors

Author: Robbie Holland
Author: Rebecca Kaye
Author: Ahmed M. Hagag
Author: Oliver Leingang
Author: Thomas R.P. Taylor
Author: Hrvoje Bogunovic
Author: Ursula Schmidt-Erfurth
Author: Hendrik P.N. Scholl
Author: Daniel Rueckert
Author: Andrew Lotery ORCID iD
Author: Sobha Sivaprasad
Author: Martin J. Menten

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×