The University of Southampton
University of Southampton Institutional Repository

Systematic review of slicing analysis and prediction tools (SAPT) using SWiM (synthesis without meta-analysing) guidance

Systematic review of slicing analysis and prediction tools (SAPT) using SWiM (synthesis without meta-analysing) guidance
Systematic review of slicing analysis and prediction tools (SAPT) using SWiM (synthesis without meta-analysing) guidance
Background: Genetic variants affecting splicing play a fundamental role in disease pathogenicity. Prediction of whether a genetic variant will affect splicing is difficult; many in silico tools exist which require adjustment for accurate splice prediction. Best practice guidelines often do not exist and different tools can provide confounding results. New high-throughput next-generation sequencing has increased biological target capture of potential splice sites. Experimental validation is required to characterise any variants in the splice region. The volume of this data, however, is vast; validation is slow, costly and non-viable at scale. Computational tools offer a method to filter results to an actionable quota suitable for experimental follow-up. Prediction of whether variation will affect splicing is challenging; successful tools accelerate diagnosis and aid prioritization of variants of unknown significance with high accuracy and reliability. Objectives: To determine the effectiveness of eligible splicing analysis and prediction tools (SAPT) and, where possible, rank them alongside providing best practice in their use whilst accounting for quality during the appraisal of eligible tools. Methods: This study systematically reviewed the literature ranging from 1 January 1980 to 21 October 2019 on SAPT. Statistical measures of specificity, sensitivity and/or accuracy were extracted to provide a hierarchical ranking of tools efficacy and recommendations for best use to aid researchers and clinicians to prioritise experimental follow-up. ‘synthesis without meta-analysis’ (SWiM) PRISMA-DTA guidance shaped the review framework. Manual Pearl Gathering and PRISMA methods were followed for database searching. The CHARMS checklist provided qualitative assessment rigour. Quantitative analysis of eligible papers weighted SAPT in order preference. Idea Webbing and Triangulation were applied to complete analysis. Results: Across the subgroups core SAPT: MES, HSF, NNS and SSF-like had high-performance > 85% accuracy. Combination tools emerged with superior performance with four exceeding > 95% accuracy: SPiCE, HSF+SSF-like, HSF+SSF-like+MES, SPIDEX. Established SAPT: dbscSNA, PSSM and CADD alongside SpliceAI reported high performance. Innovative study design within MMS and IntSplice reported adequate performance 70% to 85% accuracy standalone. Conclusions: Evidence was robust with minimal bias across the studies. Improvements are required in the literature when reporting the delineation of thresholds. Common themes extracted: Effective tools performed best on large curated datasets with separation of candidate predictors, determined in statistical manner without human selection, using both positive and negative datasets. Highly targeted, small window < 100 nucleotide or whole genome, excluding invariant positions, returned results with established veracity. This study successfully developed a hierarchical list of SAPT effectiveness with recommendations on optimal use.
Splicing, Genomics, Synthesis, SWiM, Analysis, Prediction, Bioinformatic tools, Accuracy
366
Jones, Benjamin
d2bb978f-b250-42c2-b77b-f7bba376d1d9
Jones, Benjamin
d2bb978f-b250-42c2-b77b-f7bba376d1d9

Jones, Benjamin (2020) Systematic review of slicing analysis and prediction tools (SAPT) using SWiM (synthesis without meta-analysing) guidance. p. 366 . (doi:10.1002/14651858.CD202001).

Record type: Conference or Workshop Item (Other)

Abstract

Background: Genetic variants affecting splicing play a fundamental role in disease pathogenicity. Prediction of whether a genetic variant will affect splicing is difficult; many in silico tools exist which require adjustment for accurate splice prediction. Best practice guidelines often do not exist and different tools can provide confounding results. New high-throughput next-generation sequencing has increased biological target capture of potential splice sites. Experimental validation is required to characterise any variants in the splice region. The volume of this data, however, is vast; validation is slow, costly and non-viable at scale. Computational tools offer a method to filter results to an actionable quota suitable for experimental follow-up. Prediction of whether variation will affect splicing is challenging; successful tools accelerate diagnosis and aid prioritization of variants of unknown significance with high accuracy and reliability. Objectives: To determine the effectiveness of eligible splicing analysis and prediction tools (SAPT) and, where possible, rank them alongside providing best practice in their use whilst accounting for quality during the appraisal of eligible tools. Methods: This study systematically reviewed the literature ranging from 1 January 1980 to 21 October 2019 on SAPT. Statistical measures of specificity, sensitivity and/or accuracy were extracted to provide a hierarchical ranking of tools efficacy and recommendations for best use to aid researchers and clinicians to prioritise experimental follow-up. ‘synthesis without meta-analysis’ (SWiM) PRISMA-DTA guidance shaped the review framework. Manual Pearl Gathering and PRISMA methods were followed for database searching. The CHARMS checklist provided qualitative assessment rigour. Quantitative analysis of eligible papers weighted SAPT in order preference. Idea Webbing and Triangulation were applied to complete analysis. Results: Across the subgroups core SAPT: MES, HSF, NNS and SSF-like had high-performance > 85% accuracy. Combination tools emerged with superior performance with four exceeding > 95% accuracy: SPiCE, HSF+SSF-like, HSF+SSF-like+MES, SPIDEX. Established SAPT: dbscSNA, PSSM and CADD alongside SpliceAI reported high performance. Innovative study design within MMS and IntSplice reported adequate performance 70% to 85% accuracy standalone. Conclusions: Evidence was robust with minimal bias across the studies. Improvements are required in the literature when reporting the delineation of thresholds. Common themes extracted: Effective tools performed best on large curated datasets with separation of candidate predictors, determined in statistical manner without human selection, using both positive and negative datasets. Highly targeted, small window < 100 nucleotide or whole genome, excluding invariant positions, returned results with established veracity. This study successfully developed a hierarchical list of SAPT effectiveness with recommendations on optimal use.

This record has no associated files available for download.

More information

Published date: 30 September 2020
Additional Information: © 2020 The Cochrane Collaboration
Keywords: Splicing, Genomics, Synthesis, SWiM, Analysis, Prediction, Bioinformatic tools, Accuracy

Identifiers

Local EPrints ID: 467450
URI: http://eprints.soton.ac.uk/id/eprint/467450
PURE UUID: 6d4d9877-7e1f-4202-ae4d-4fd84841080f
ORCID for Benjamin Jones: ORCID iD orcid.org/0000-0003-2410-5280

Catalogue record

Date deposited: 08 Jul 2022 16:43
Last modified: 17 Mar 2024 04:10

Export record

Altmetrics

Contributors

Author: Benjamin Jones ORCID iD

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×