The University of Southampton
University of Southampton Institutional Repository

Machine learning derived retinal pigment score from ophthalmic imaging shows ethnicity is not biology

Machine learning derived retinal pigment score from ophthalmic imaging shows ethnicity is not biology
Machine learning derived retinal pigment score from ophthalmic imaging shows ethnicity is not biology
Few metrics exist to describe phenotypic diversity within ophthalmic imaging datasets, with researchers often using ethnicity as a surrogate marker for biological variability. We derived a continuous, measured metric, the retinal pigment score (RPS), that quantifies the degree of pigmentation from a colour fundus photograph of the eye. RPS was validated using two large epidemiological studies with demographic and genetic data (UK Biobank and EPIC-Norfolk Study) and reproduced in a Tanzanian, an Australian, and a Chinese dataset. A genome-wide association study (GWAS) of RPS from UK Biobank identified 20 loci with known associations with skin, iris and hair pigmentation, of which eight were replicated in the EPIC-Norfolk cohort. There was a strong association between RPS and ethnicity, however, there was substantial overlap between each ethnicity and the respective distributions of RPS scores. RPS decouples traditional demographic variables from clinical imaging characteristics. RPS may serve as a useful metric to quantify the diversity of the training, validation, and testing datasets used in the development of AI algorithms to ensure adequate inclusion and explainability of the model performance, critical in evaluating all currently deployed AI models. The code to derive RPS is publicly available at: https://github.com/uw-biomedical-ml/retinal-pigmentation-score.
2041-1723
Rajesh, Anand E.
7d666152-ba69-4286-8a2d-c25258534001
Olvera-Barrios, Abraham
60d930b7-35c5-4e83-aadc-59f49f56d470
Warwick, Alasdair N.
30b9af00-d6a6-4dca-b8f3-2c8c2d04b446
Wu, Yue
c9ad8603-c2ae-44b9-bde1-0c3bca797b9a
Stuart, Kelsey V.
38706ee9-a8e6-4b7b-ba94-bd2a7960bcdb
Biradar, Mahantesh I.
8fd0eef3-e3b7-4f58-9580-5453e2ef9ba8
Ung, Chuin Ying
d6acb9f2-661b-47a1-9c4c-6101e2be18a5
Khawaja, Anthony P.
ac15cbf1-b21c-4760-80d9-d8ff7ce51e03
Luben, Robert
45fbac1d-ed4b-4a64-8f44-9b1afc94df6d
Foster, Paul J.
2ce65475-8311-4833-98b2-2011b76b9147
Cleland, Charles R.
3c823b62-6512-475d-b503-2a655f9baa86
Makupa, William U.
94443fd6-5483-465d-8a3a-60f1b06b1963
Denniston, Alastair K.
6cafbd29-d1ff-4710-bc1f-fd742546b2e5
Burton, Matthew J.
314ff981-cded-4024-b39c-3dfaa51b79c7
Bastawrous, Andrew
f7171f9b-11f3-4034-bf8d-84f6b1148d39
Keane, Pearse A.
fc1d555b-277f-45e1-ac72-727766911e6f
Chia, Mark A.
90d497ba-4034-4bb2-9cc5-836fe361f1d1
Turner, Angus W.
a7306d21-829a-4c05-bac9-7207d110f839
Lee, Cecilia S.
3a761eea-1cc3-4897-9ca0-9c767aa79a1e
Tufail, Adnan
4370b3b4-906d-4fe5-92bd-e6207fa1d59b
Lee, Aaron Y.
edad50d2-d35e-4bdd-8ebf-496d8114aa56
Egan, Catherine
20273940-9b84-46d6-a48e-c3f78e35ad4a
Self, Jay
0f6efc58-ae24-4667-b8d6-6fafa849e389
Lotery, Andrew
5ecc2d2d-d0b4-468f-ad2c-df7156f8e514
Gibson, Jane
855033a6-38f3-4853-8f60-d7d4561226ae
Ennis, Sarah
7b57f188-9d91-4beb-b217-09856146f1e9
Carare, Roxana
0478c197-b0c1-4206-acae-54e88c8f21fa
UK Biobank Eye and Vision Consortium
Rajesh, Anand E.
7d666152-ba69-4286-8a2d-c25258534001
Olvera-Barrios, Abraham
60d930b7-35c5-4e83-aadc-59f49f56d470
Warwick, Alasdair N.
30b9af00-d6a6-4dca-b8f3-2c8c2d04b446
Wu, Yue
c9ad8603-c2ae-44b9-bde1-0c3bca797b9a
Stuart, Kelsey V.
38706ee9-a8e6-4b7b-ba94-bd2a7960bcdb
Biradar, Mahantesh I.
8fd0eef3-e3b7-4f58-9580-5453e2ef9ba8
Ung, Chuin Ying
d6acb9f2-661b-47a1-9c4c-6101e2be18a5
Khawaja, Anthony P.
ac15cbf1-b21c-4760-80d9-d8ff7ce51e03
Luben, Robert
45fbac1d-ed4b-4a64-8f44-9b1afc94df6d
Foster, Paul J.
2ce65475-8311-4833-98b2-2011b76b9147
Cleland, Charles R.
3c823b62-6512-475d-b503-2a655f9baa86
Makupa, William U.
94443fd6-5483-465d-8a3a-60f1b06b1963
Denniston, Alastair K.
6cafbd29-d1ff-4710-bc1f-fd742546b2e5
Burton, Matthew J.
314ff981-cded-4024-b39c-3dfaa51b79c7
Bastawrous, Andrew
f7171f9b-11f3-4034-bf8d-84f6b1148d39
Keane, Pearse A.
fc1d555b-277f-45e1-ac72-727766911e6f
Chia, Mark A.
90d497ba-4034-4bb2-9cc5-836fe361f1d1
Turner, Angus W.
a7306d21-829a-4c05-bac9-7207d110f839
Lee, Cecilia S.
3a761eea-1cc3-4897-9ca0-9c767aa79a1e
Tufail, Adnan
4370b3b4-906d-4fe5-92bd-e6207fa1d59b
Lee, Aaron Y.
edad50d2-d35e-4bdd-8ebf-496d8114aa56
Egan, Catherine
20273940-9b84-46d6-a48e-c3f78e35ad4a
Self, Jay
0f6efc58-ae24-4667-b8d6-6fafa849e389
Lotery, Andrew
5ecc2d2d-d0b4-468f-ad2c-df7156f8e514
Gibson, Jane
855033a6-38f3-4853-8f60-d7d4561226ae
Ennis, Sarah
7b57f188-9d91-4beb-b217-09856146f1e9
Carare, Roxana
0478c197-b0c1-4206-acae-54e88c8f21fa

Rajesh, Anand E., Olvera-Barrios, Abraham, Warwick, Alasdair N., Wu, Yue, Stuart, Kelsey V., Biradar, Mahantesh I., Ung, Chuin Ying, Khawaja, Anthony P., Luben, Robert, Foster, Paul J., Cleland, Charles R., Makupa, William U., Denniston, Alastair K., Burton, Matthew J., Bastawrous, Andrew, Keane, Pearse A., Chia, Mark A., Turner, Angus W., Lee, Cecilia S., Tufail, Adnan, Lee, Aaron Y. and Egan, Catherine , UK Biobank Eye and Vision Consortium (2025) Machine learning derived retinal pigment score from ophthalmic imaging shows ethnicity is not biology. Nature Communications, 16 (1), [60]. (doi:10.1038/s41467-024-55198-7).

Record type: Article

Abstract

Few metrics exist to describe phenotypic diversity within ophthalmic imaging datasets, with researchers often using ethnicity as a surrogate marker for biological variability. We derived a continuous, measured metric, the retinal pigment score (RPS), that quantifies the degree of pigmentation from a colour fundus photograph of the eye. RPS was validated using two large epidemiological studies with demographic and genetic data (UK Biobank and EPIC-Norfolk Study) and reproduced in a Tanzanian, an Australian, and a Chinese dataset. A genome-wide association study (GWAS) of RPS from UK Biobank identified 20 loci with known associations with skin, iris and hair pigmentation, of which eight were replicated in the EPIC-Norfolk cohort. There was a strong association between RPS and ethnicity, however, there was substantial overlap between each ethnicity and the respective distributions of RPS scores. RPS decouples traditional demographic variables from clinical imaging characteristics. RPS may serve as a useful metric to quantify the diversity of the training, validation, and testing datasets used in the development of AI algorithms to ensure adequate inclusion and explainability of the model performance, critical in evaluating all currently deployed AI models. The code to derive RPS is publicly available at: https://github.com/uw-biomedical-ml/retinal-pigmentation-score.

Text
s41467-024-55198-7 - Version of Record
Available under License Creative Commons Attribution.
Download (3MB)

More information

Accepted/In Press date: 5 December 2024
Published date: 2 January 2025

Identifiers

Local EPrints ID: 498997
URI: http://eprints.soton.ac.uk/id/eprint/498997
ISSN: 2041-1723
PURE UUID: a65a09d4-42ce-40ca-a826-9d168218c0a4
ORCID for Jay Self: ORCID iD orcid.org/0000-0002-1030-9963
ORCID for Andrew Lotery: ORCID iD orcid.org/0000-0001-5541-4305
ORCID for Jane Gibson: ORCID iD orcid.org/0000-0002-0973-8285
ORCID for Sarah Ennis: ORCID iD orcid.org/0000-0003-2648-0869
ORCID for Roxana Carare: ORCID iD orcid.org/0000-0001-6458-3776

Catalogue record

Date deposited: 06 Mar 2025 17:44
Last modified: 22 Aug 2025 01:55

Export record

Altmetrics

Contributors

Author: Anand E. Rajesh
Author: Abraham Olvera-Barrios
Author: Alasdair N. Warwick
Author: Yue Wu
Author: Kelsey V. Stuart
Author: Mahantesh I. Biradar
Author: Chuin Ying Ung
Author: Anthony P. Khawaja
Author: Robert Luben
Author: Paul J. Foster
Author: Charles R. Cleland
Author: William U. Makupa
Author: Alastair K. Denniston
Author: Matthew J. Burton
Author: Andrew Bastawrous
Author: Pearse A. Keane
Author: Mark A. Chia
Author: Angus W. Turner
Author: Cecilia S. Lee
Author: Adnan Tufail
Author: Aaron Y. Lee
Author: Catherine Egan
Author: Jay Self ORCID iD
Author: Andrew Lotery ORCID iD
Author: Jane Gibson ORCID iD
Author: Sarah Ennis ORCID iD
Author: Roxana Carare ORCID iD
Corporate Author: UK Biobank Eye and Vision Consortium

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×