The University of Southampton
University of Southampton Institutional Repository

Predicting the impact of rare variants on RNA splicing in CAGI6

Predicting the impact of rare variants on RNA splicing in CAGI6
Predicting the impact of rare variants on RNA splicing in CAGI6
Background: variants which disrupt splicing are a frequent cause of rare disease that have been under-ascertained clinically. Accurate and efficient methods to predict a variant’s impact on splicing are needed to interpret the growing number of variants of unknown significance (VUS) identified by exome and genome sequencing. Here we present the results of the CAGI6 Splicing VUS challenge, which invited predictions of the splicing impact of 56 variants ascertained clinically and functionally validated to determine splicing impact.

Results: the performance of 12 prediction methods, along with SpliceAI and CADD, was compared on the 56 functionally validated variants. The maximum accuracy achieved was 82% from two different approaches, one weighting SpliceAI scores by minor allele frequency, and one applying the recently published Splicing Prediction Pipeline (SPiP). SPiP performed optimally in terms of sensitivity, while an ensemble method combining multiple prediction tools and information from databases exceeded all others for specificity.

Conclusions: several challenge methods equalled or exceeded the performance of SpliceAI, with ultimate choice of prediction method likely to depend on experimental or clinical aims. One quarter of the variants were incorrectly predicted by at least 50% of the methods, highlighting the need for further improvements to splicing prediction methods for successful clinical application.
0340-6717
Lord, Jenny
e1909780-36cd-4705-b21e-4580038d4ec6
Jaramillo Oquendo, Carolina
7ac6cb48-5df8-4d22-9907-46dc8f4d4b18
Wai, Htoo A.
4428517b-33b3-42cb-9818-ca64763ab7bc
Douglas, Andrew G.L.
2c789ec4-a222-43bc-a040-522ca64fea42
Bunyan, David J.
dd9134b9-f889-44cc-83cc-a41fc5d74d69
Wang, Yaqiong
4a8584b7-f535-4add-b1e9-183225232a97
Hu, Zhiqiang
dd1145f0-e08d-462b-8ceb-61f731242b0c
Zeng, Zishuo
f8d865f7-eeec-4205-91c8-ae844f69700e
Danis, Daniel
37de81b1-a412-4981-8150-a67c2c7c0dda
Katsonis, Panagiotis
8c74a20a-cdad-4dd5-8dc6-9e20dd786ae4
Williams, Amanda
d0d7ca15-d10c-4a1b-b2f1-6953e8b69a95
Lichtarge, Oliver
859fe67c-f959-4f0f-b7f0-74acfa683546
Chang, Yuchen
f5b7483b-1f97-456f-88ac-6168646784ef
Bagnall, Richard D.
ff5dce1a-aa52-48d4-a3bf-cd6a910956a0
Mount, Stephen M.
97b94ff1-7183-4e91-b129-bf75caab674c
Matthiasardottir, Brynja
d0d07448-3ffc-4e5c-a37f-4458446740ac
Lin, Chiaofeng
6d185562-bd27-458d-ba46-f244122d0da1
van Overeem Hansen, Thomas
91b771a1-a69f-44ec-8217-4c9d70c697c0
Leman, Raphael
cc340afa-52b3-40a7-a03c-1a59c5a10dfa
Martins, Alexandra
9e4549a8-641c-49f1-8f12-6784c1a42428
Houdayer, Claude
a0870304-4af6-46c6-bcb3-40f3bee1338d
Krieger, Sophie
88a6d8a5-f4c5-4f45-8011-37166bb7c1db
Bakolitsa, Constantina
4edc94fd-8617-4dd1-a4ab-87ac6d9439c3
Peng, Yisu
1360492d-db96-4c69-83bd-54a5f6243ae7
Kamandula, Akash
82c3b9bb-29d9-4d43-a356-dd8ad266e250
Radivojac, Predrag
7ace2a05-e9eb-416b-8690-9a075e9a9533
Baralle, Diana
faac16e5-7928-4801-9811-8b3a9ea4bb91
Lord, Jenny
e1909780-36cd-4705-b21e-4580038d4ec6
Jaramillo Oquendo, Carolina
7ac6cb48-5df8-4d22-9907-46dc8f4d4b18
Wai, Htoo A.
4428517b-33b3-42cb-9818-ca64763ab7bc
Douglas, Andrew G.L.
2c789ec4-a222-43bc-a040-522ca64fea42
Bunyan, David J.
dd9134b9-f889-44cc-83cc-a41fc5d74d69
Wang, Yaqiong
4a8584b7-f535-4add-b1e9-183225232a97
Hu, Zhiqiang
dd1145f0-e08d-462b-8ceb-61f731242b0c
Zeng, Zishuo
f8d865f7-eeec-4205-91c8-ae844f69700e
Danis, Daniel
37de81b1-a412-4981-8150-a67c2c7c0dda
Katsonis, Panagiotis
8c74a20a-cdad-4dd5-8dc6-9e20dd786ae4
Williams, Amanda
d0d7ca15-d10c-4a1b-b2f1-6953e8b69a95
Lichtarge, Oliver
859fe67c-f959-4f0f-b7f0-74acfa683546
Chang, Yuchen
f5b7483b-1f97-456f-88ac-6168646784ef
Bagnall, Richard D.
ff5dce1a-aa52-48d4-a3bf-cd6a910956a0
Mount, Stephen M.
97b94ff1-7183-4e91-b129-bf75caab674c
Matthiasardottir, Brynja
d0d07448-3ffc-4e5c-a37f-4458446740ac
Lin, Chiaofeng
6d185562-bd27-458d-ba46-f244122d0da1
van Overeem Hansen, Thomas
91b771a1-a69f-44ec-8217-4c9d70c697c0
Leman, Raphael
cc340afa-52b3-40a7-a03c-1a59c5a10dfa
Martins, Alexandra
9e4549a8-641c-49f1-8f12-6784c1a42428
Houdayer, Claude
a0870304-4af6-46c6-bcb3-40f3bee1338d
Krieger, Sophie
88a6d8a5-f4c5-4f45-8011-37166bb7c1db
Bakolitsa, Constantina
4edc94fd-8617-4dd1-a4ab-87ac6d9439c3
Peng, Yisu
1360492d-db96-4c69-83bd-54a5f6243ae7
Kamandula, Akash
82c3b9bb-29d9-4d43-a356-dd8ad266e250
Radivojac, Predrag
7ace2a05-e9eb-416b-8690-9a075e9a9533
Baralle, Diana
faac16e5-7928-4801-9811-8b3a9ea4bb91

Lord, Jenny, Jaramillo Oquendo, Carolina, Wai, Htoo A., Douglas, Andrew G.L., Bunyan, David J., Wang, Yaqiong, Hu, Zhiqiang, Zeng, Zishuo, Danis, Daniel, Katsonis, Panagiotis, Williams, Amanda, Lichtarge, Oliver, Chang, Yuchen, Bagnall, Richard D., Mount, Stephen M., Matthiasardottir, Brynja, Lin, Chiaofeng, van Overeem Hansen, Thomas, Leman, Raphael, Martins, Alexandra, Houdayer, Claude, Krieger, Sophie, Bakolitsa, Constantina, Peng, Yisu, Kamandula, Akash, Radivojac, Predrag and Baralle, Diana (2024) Predicting the impact of rare variants on RNA splicing in CAGI6. Human Genetics. (doi:10.1007/s00439-023-02624-3).

Record type: Article

Abstract

Background: variants which disrupt splicing are a frequent cause of rare disease that have been under-ascertained clinically. Accurate and efficient methods to predict a variant’s impact on splicing are needed to interpret the growing number of variants of unknown significance (VUS) identified by exome and genome sequencing. Here we present the results of the CAGI6 Splicing VUS challenge, which invited predictions of the splicing impact of 56 variants ascertained clinically and functionally validated to determine splicing impact.

Results: the performance of 12 prediction methods, along with SpliceAI and CADD, was compared on the 56 functionally validated variants. The maximum accuracy achieved was 82% from two different approaches, one weighting SpliceAI scores by minor allele frequency, and one applying the recently published Splicing Prediction Pipeline (SPiP). SPiP performed optimally in terms of sensitivity, while an ensemble method combining multiple prediction tools and information from databases exceeded all others for specificity.

Conclusions: several challenge methods equalled or exceeded the performance of SpliceAI, with ultimate choice of prediction method likely to depend on experimental or clinical aims. One quarter of the variants were incorrectly predicted by at least 50% of the methods, highlighting the need for further improvements to splicing prediction methods for successful clinical application.

Text
CAGI6_SplicingVUS_Main_Sept23_clean_compiled - Accepted Manuscript
Available under License Creative Commons Attribution.
Download (546kB)
Text
CAGI6_SplicingVUS_SupplementaryInformation_Sept23 - Accepted Manuscript
Available under License Creative Commons Attribution.
Download (1MB)
Spreadsheet
CAGI6_SplicingVUS_SupplementaryTable1_Sept23 - Accepted Manuscript
Available under License Creative Commons Attribution.
Download (115kB)
Text
s00439-023-02624-3 - Version of Record
Available under License Creative Commons Attribution.
Download (1MB)

More information

Accepted/In Press date: 18 November 2023
e-pub ahead of print date: 3 January 2024
Published date: 3 January 2024
Additional Information: Publisher Copyright: © 2024, The Author(s).

Identifiers

Local EPrints ID: 484748
URI: http://eprints.soton.ac.uk/id/eprint/484748
ISSN: 0340-6717
PURE UUID: e2070b96-cdac-4fa5-86a4-1c331b7e7f64
ORCID for Jenny Lord: ORCID iD orcid.org/0000-0002-0539-9343
ORCID for Carolina Jaramillo Oquendo: ORCID iD orcid.org/0000-0002-9875-0998
ORCID for Htoo A. Wai: ORCID iD orcid.org/0000-0002-3560-6980
ORCID for Andrew G.L. Douglas: ORCID iD orcid.org/0000-0001-5154-6714
ORCID for Diana Baralle: ORCID iD orcid.org/0000-0003-3217-4833

Catalogue record

Date deposited: 21 Nov 2023 17:32
Last modified: 31 Jul 2024 02:03

Export record

Altmetrics

Contributors

Author: Jenny Lord ORCID iD
Author: Carolina Jaramillo Oquendo ORCID iD
Author: Htoo A. Wai ORCID iD
Author: David J. Bunyan
Author: Yaqiong Wang
Author: Zhiqiang Hu
Author: Zishuo Zeng
Author: Daniel Danis
Author: Panagiotis Katsonis
Author: Amanda Williams
Author: Oliver Lichtarge
Author: Yuchen Chang
Author: Richard D. Bagnall
Author: Stephen M. Mount
Author: Brynja Matthiasardottir
Author: Chiaofeng Lin
Author: Thomas van Overeem Hansen
Author: Raphael Leman
Author: Alexandra Martins
Author: Claude Houdayer
Author: Sophie Krieger
Author: Constantina Bakolitsa
Author: Yisu Peng
Author: Akash Kamandula
Author: Predrag Radivojac
Author: Diana Baralle ORCID iD

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×