The University of Southampton
University of Southampton Institutional Repository

Prediction modelling in acute hospital care: a case study of acute kidney injury

Prediction modelling in acute hospital care: a case study of acute kidney injury
Prediction modelling in acute hospital care: a case study of acute kidney injury
Background: acute kidney injury (AKI) is a global healthcare priority, with strategies to improve associated outcomes desirable. Prediction models or clinical prediction rules (CPRs), utilise multiple predictors to provide objective estimates of future risk and their use has been suggested in the field of AKI. A rapid expansion in derived CPRs has rarely been followed by external validation, with even fewer models undergoing impact analysis on patient outcomes. Using e-alert systems to identify AKI has become commonplace in the UK, though few studies have assessed their efficacy. Combining an inhospital e-alert system with an AKI CPR has not previously been described.

Methods: a systematic review of CPRs to predict hospital-acquired AKI (HA-AKI) in acute hospital settings was performed, followed by an external validation of one – the AKI prediction score (APS). Thirdly an impact analysis study using a controlled, before-and-after design on acute medical admissions to two adult non-specialist hospital sites was conducted (2014-16). At admission, the CPR highlighted patients at risk of HA-AKI in conjunction with an e-alert which triggered care bundles of interventions. Primary outcome was incident HA-AKI using a difference-in-differences analysis. Secondary outcomes in those developing HA-AKI included: in-hospital mortality, AKI progression, intensive care unit (ICU) escalation and effects on process measures. Patients with established community-acquired AKI (CA-AKI) were also highlighted only at the intervention site.

Results:
I. A systematic review found 53 CPR studies, the majority in specialised areas; of the 11 in general hospital settings five had external validation. Significant shortcomings in design and reporting were found.

II. External validation of the APS model found modest discrimination with area under the receiver operating characteristic curves (AUROCs) ranging 0.65-0.71 and acceptable calibration plots.

III. An impact analysis combining the CPR with an AKI e-alert found a reduction in HA-AKI at the intervention site (odds ratio, OR 0·990 (0·981-1·000), P=0·049). Of cases who developed HA-AKI mortality significantly reduced on unadjusted (27·46% pre vs 21·67% post intervention, OR 0·731 (0·560-0·954) P=0·021) and difference-in-differences analysis (OR0·924 [95% CI 0·858-0·996] P=0·038). Process measures significantly improved at the intervention site. In contrast no outcome improvements were found in patients presenting with CA-AKI following introduction of an AKI e-alert.

Conclusions: Few validated AKI CPRs have been described in general hospital settings. An external validation of one model, the APS, led on to an impact analysis of this CPR. This innovative study utilised IT to integrate the CPR and an AKI e-alert in an acute hospital setting. The major findings were a reduction in de novo hospital-acquired AKI and reduced mortality in those who developed AKI. Future research should assess if these findings are generalisable and sustainable. Integration with primary care IT and the employment of biomarkers to apply precision care are further avenues following on from this case study.
University of Southampton
Hodgson, Luke Eliot
f1159289-e374-4f11-b923-5781094b6de1
Hodgson, Luke Eliot
f1159289-e374-4f11-b923-5781094b6de1
Roderick, Paul
dbb3cd11-4c51-4844-982b-0eb30ad5085a
Dimitrov, Borislav
366d715f-ffd9-45a1-8415-65de5488472f

Hodgson, Luke Eliot (2018) Prediction modelling in acute hospital care: a case study of acute kidney injury. University of Southampton, Doctoral Thesis, 272pp.

Record type: Thesis (Doctoral)

Abstract

Background: acute kidney injury (AKI) is a global healthcare priority, with strategies to improve associated outcomes desirable. Prediction models or clinical prediction rules (CPRs), utilise multiple predictors to provide objective estimates of future risk and their use has been suggested in the field of AKI. A rapid expansion in derived CPRs has rarely been followed by external validation, with even fewer models undergoing impact analysis on patient outcomes. Using e-alert systems to identify AKI has become commonplace in the UK, though few studies have assessed their efficacy. Combining an inhospital e-alert system with an AKI CPR has not previously been described.

Methods: a systematic review of CPRs to predict hospital-acquired AKI (HA-AKI) in acute hospital settings was performed, followed by an external validation of one – the AKI prediction score (APS). Thirdly an impact analysis study using a controlled, before-and-after design on acute medical admissions to two adult non-specialist hospital sites was conducted (2014-16). At admission, the CPR highlighted patients at risk of HA-AKI in conjunction with an e-alert which triggered care bundles of interventions. Primary outcome was incident HA-AKI using a difference-in-differences analysis. Secondary outcomes in those developing HA-AKI included: in-hospital mortality, AKI progression, intensive care unit (ICU) escalation and effects on process measures. Patients with established community-acquired AKI (CA-AKI) were also highlighted only at the intervention site.

Results:
I. A systematic review found 53 CPR studies, the majority in specialised areas; of the 11 in general hospital settings five had external validation. Significant shortcomings in design and reporting were found.

II. External validation of the APS model found modest discrimination with area under the receiver operating characteristic curves (AUROCs) ranging 0.65-0.71 and acceptable calibration plots.

III. An impact analysis combining the CPR with an AKI e-alert found a reduction in HA-AKI at the intervention site (odds ratio, OR 0·990 (0·981-1·000), P=0·049). Of cases who developed HA-AKI mortality significantly reduced on unadjusted (27·46% pre vs 21·67% post intervention, OR 0·731 (0·560-0·954) P=0·021) and difference-in-differences analysis (OR0·924 [95% CI 0·858-0·996] P=0·038). Process measures significantly improved at the intervention site. In contrast no outcome improvements were found in patients presenting with CA-AKI following introduction of an AKI e-alert.

Conclusions: Few validated AKI CPRs have been described in general hospital settings. An external validation of one model, the APS, led on to an impact analysis of this CPR. This innovative study utilised IT to integrate the CPR and an AKI e-alert in an acute hospital setting. The major findings were a reduction in de novo hospital-acquired AKI and reduced mortality in those who developed AKI. Future research should assess if these findings are generalisable and sustainable. Integration with primary care IT and the employment of biomarkers to apply precision care are further avenues following on from this case study.

Text
Luke Hodgson Thesis - Version of Record
Available under License University of Southampton Thesis Licence.
Download (16MB)

More information

Published date: October 2018

Identifiers

Local EPrints ID: 434592
URI: http://eprints.soton.ac.uk/id/eprint/434592
PURE UUID: 9de99540-1a82-420b-9b8d-90ca3780310c
ORCID for Paul Roderick: ORCID iD orcid.org/0000-0001-9475-6850

Catalogue record

Date deposited: 02 Oct 2019 16:30
Last modified: 17 Mar 2024 02:41

Export record

Contributors

Author: Luke Eliot Hodgson
Thesis advisor: Paul Roderick ORCID iD
Thesis advisor: Borislav Dimitrov

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×