The University of Southampton
University of Southampton Institutional Repository

Establishing a global quality of care benchmark report

Establishing a global quality of care benchmark report
Establishing a global quality of care benchmark report

Background: the Movember funded TrueNTH Global Registry (TNGR) aims to improve care by collecting and analysing a consistent dataset to identify variation in disease management, benchmark care delivery in accordance with best practice guidelines and provide this information to those in a position to enact change. We discuss considerations of designing and implementing a quality of care report for TNGR. 

Methods: eleven working group sessions were held prior to and as reports were being built with representation from clinicians, data managers and investigators contributing to TNGR. The aim of the meetings was to understand current data display approaches, share literature review findings and ideas for innovative approaches. Preferred displays were evaluated with two surveys (survey 1: 5 clinicians and 5 non-clinicians, 83% response rate; survey 2: 17 clinicians and 18 non-clinicians, 93% response rate). 

Results: consensus on dashboard design and three data-display preferences were achieved. The dashboard comprised two performance summary charts; one summarising site’s relative quality indicator (QI) performance and another to summarise data quality. Binary outcome QIs were presented as funnel plots. Patient-reported outcome measures of function score and the extent to which men were bothered by their symptoms were presented in bubble plots. Time series graphs were seen as providing important information to supplement funnel and bubble plots. R Markdown was selected as the software program principally because of its excellent analytic and graph display capacity, open source licensing model and the large global community sharing program code enhancements. 

Conclusions: international collaboration in creating and maintaining clinical quality registries has allowed benchmarking of process and outcome measures on a large scale. A registry report system was developed with stakeholder engagement to produce dynamic reports that provide user-specific feedback to 132 participating sites across 13 countries.

R Markdown, benchmarking, data display, data science, international registry, quality indicators (health care)
1460-4582
146045822110157
Sampurno, Fanny
acc151e4-2c00-4a8b-8f50-4d1f133d43d8
Cally, Justin
d26f17fd-59e0-4bae-9d67-4e7ce157f00d
Opie, Jacinta L
9d7fcea4-5dda-4e13-a017-d33ffd75bbe9
Kannan, Ashwini
c66f650b-5456-4eca-be01-83ac82f3d835
Millar, Jeremy L
da9b82ad-a8b2-4955-bf9f-76210d51b4c8
Finelli, Antonio
446ef6e9-f814-4340-aa53-77d583436a24
Vickers, Andrew J
e39cb4e7-1e87-47c3-a19e-c643ae9c884e
Moore, Caroline M
87ccbdc5-40b6-41b5-8639-46f3f04896e9
Kowalski, Christoph
ca280beb-e499-40cf-8794-a50d8a68531d
Foster, Claire
00786ac1-bd47-4aeb-a0e2-40e058695b73
Barocas, Dan A
2fa5e1b3-a08b-4254-9600-d6a8018aeed7
Galvin, David
10a4c30e-567b-410c-bc92-30efb237e1bf
Van Basten, Jean-paul
c54c6f90-62e8-4ac7-abf2-6d7a875fb254
Gore, John L
002a7a3d-e8a0-47ea-b91f-7dbfdc740883
Ferencz, Julia
fb4216b4-699c-4d3b-acd3-6c8fbe24b18e
Lawson, Keith A
bbffbd70-f528-4b42-ac54-d703727c3495
Ghani, Khurshid R
7c08b02d-5fe1-4f1d-b278-e7e5e3418cec
Kwan, Lorna
cab647f4-70e7-4361-90d7-6693736e5951
Saarela, Olli
b1806228-8242-480a-b162-c6477575332a
Connor, Sarah E
0dd5d4b7-bf52-49ab-875d-781612d58088
Dieng, Sebastian
557b45a5-00df-49a8-b037-fc94bf45a156
Linsell, Susan
302fa783-1907-42ef-8686-32d993c5d8b3
Soeterik, Timo Fw
c38aa5c9-46be-422c-8cad-4657b74d9767
Villanti, Paul
622a6759-06c7-4742-8ef0-2666c46cc79b
Litwin, Mark S
c5be4772-8763-4a1e-b20f-016db1234b78
Evans, Sue M
f60f2b07-b6e9-4990-9a70-f4b42d8277eb
Sampurno, Fanny
acc151e4-2c00-4a8b-8f50-4d1f133d43d8
Cally, Justin
d26f17fd-59e0-4bae-9d67-4e7ce157f00d
Opie, Jacinta L
9d7fcea4-5dda-4e13-a017-d33ffd75bbe9
Kannan, Ashwini
c66f650b-5456-4eca-be01-83ac82f3d835
Millar, Jeremy L
da9b82ad-a8b2-4955-bf9f-76210d51b4c8
Finelli, Antonio
446ef6e9-f814-4340-aa53-77d583436a24
Vickers, Andrew J
e39cb4e7-1e87-47c3-a19e-c643ae9c884e
Moore, Caroline M
87ccbdc5-40b6-41b5-8639-46f3f04896e9
Kowalski, Christoph
ca280beb-e499-40cf-8794-a50d8a68531d
Foster, Claire
00786ac1-bd47-4aeb-a0e2-40e058695b73
Barocas, Dan A
2fa5e1b3-a08b-4254-9600-d6a8018aeed7
Galvin, David
10a4c30e-567b-410c-bc92-30efb237e1bf
Van Basten, Jean-paul
c54c6f90-62e8-4ac7-abf2-6d7a875fb254
Gore, John L
002a7a3d-e8a0-47ea-b91f-7dbfdc740883
Ferencz, Julia
fb4216b4-699c-4d3b-acd3-6c8fbe24b18e
Lawson, Keith A
bbffbd70-f528-4b42-ac54-d703727c3495
Ghani, Khurshid R
7c08b02d-5fe1-4f1d-b278-e7e5e3418cec
Kwan, Lorna
cab647f4-70e7-4361-90d7-6693736e5951
Saarela, Olli
b1806228-8242-480a-b162-c6477575332a
Connor, Sarah E
0dd5d4b7-bf52-49ab-875d-781612d58088
Dieng, Sebastian
557b45a5-00df-49a8-b037-fc94bf45a156
Linsell, Susan
302fa783-1907-42ef-8686-32d993c5d8b3
Soeterik, Timo Fw
c38aa5c9-46be-422c-8cad-4657b74d9767
Villanti, Paul
622a6759-06c7-4742-8ef0-2666c46cc79b
Litwin, Mark S
c5be4772-8763-4a1e-b20f-016db1234b78
Evans, Sue M
f60f2b07-b6e9-4990-9a70-f4b42d8277eb

Sampurno, Fanny, Cally, Justin, Opie, Jacinta L, Kannan, Ashwini, Millar, Jeremy L, Finelli, Antonio, Vickers, Andrew J, Moore, Caroline M, Kowalski, Christoph, Foster, Claire, Barocas, Dan A, Galvin, David, Van Basten, Jean-paul, Gore, John L, Ferencz, Julia, Lawson, Keith A, Ghani, Khurshid R, Kwan, Lorna, Saarela, Olli, Connor, Sarah E, Dieng, Sebastian, Linsell, Susan, Soeterik, Timo Fw, Villanti, Paul, Litwin, Mark S and Evans, Sue M (2021) Establishing a global quality of care benchmark report. Health Informatics Journal, 27 (2), 146045822110157. (doi:10.1177/14604582211015704).

Record type: Article

Abstract

Background: the Movember funded TrueNTH Global Registry (TNGR) aims to improve care by collecting and analysing a consistent dataset to identify variation in disease management, benchmark care delivery in accordance with best practice guidelines and provide this information to those in a position to enact change. We discuss considerations of designing and implementing a quality of care report for TNGR. 

Methods: eleven working group sessions were held prior to and as reports were being built with representation from clinicians, data managers and investigators contributing to TNGR. The aim of the meetings was to understand current data display approaches, share literature review findings and ideas for innovative approaches. Preferred displays were evaluated with two surveys (survey 1: 5 clinicians and 5 non-clinicians, 83% response rate; survey 2: 17 clinicians and 18 non-clinicians, 93% response rate). 

Results: consensus on dashboard design and three data-display preferences were achieved. The dashboard comprised two performance summary charts; one summarising site’s relative quality indicator (QI) performance and another to summarise data quality. Binary outcome QIs were presented as funnel plots. Patient-reported outcome measures of function score and the extent to which men were bothered by their symptoms were presented in bubble plots. Time series graphs were seen as providing important information to supplement funnel and bubble plots. R Markdown was selected as the software program principally because of its excellent analytic and graph display capacity, open source licensing model and the large global community sharing program code enhancements. 

Conclusions: international collaboration in creating and maintaining clinical quality registries has allowed benchmarking of process and outcome measures on a large scale. A registry report system was developed with stakeholder engagement to produce dynamic reports that provide user-specific feedback to 132 participating sites across 13 countries.

Text
14604582211015704 - Version of Record
Available under License Creative Commons Attribution.
Download (1MB)

More information

Accepted/In Press date: 14 April 2021
Published date: 3 June 2021
Additional Information: Funding Information: We would like to thank Mr Arturo Ramos Santracruz, Ms Anh Tran and Ms. Shu-Yu Tew for their contribution in the development of the TrueNTH Global Registry Quality of Care report. We acknowledged Helix Team at Monash University, Melbourne, Australia in assisting the development of the ?Report? page in the TrueNTH Global Registry web portal. This work was also supported by the Monash eResearch Centre and Helix at Monash University and by using the Monash University hosted Secure eResearch Platform (formerly known as Safe Haven). The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This work was supported by the Movember Foundation. Funding Information: We would like to thank Mr Arturo Ramos Santracruz, Ms Anh Tran and Ms. Shu-Yu Tew for their contribution in the development of the TrueNTH Global Registry Quality of Care report. We acknowledged Helix Team at Monash University, Melbourne, Australia in assisting the development of the ‘Report’ page in the TrueNTH Global Registry web portal. This work was also supported by the Monash eResearch Centre and Helix at Monash University and by using the Monash University hosted Secure eResearch Platform (formerly known as Safe Haven). Funding Information: The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This work was supported by the Movember Foundation. Publisher Copyright: © The Author(s) 2021.
Keywords: R Markdown, benchmarking, data display, data science, international registry, quality indicators (health care)

Identifiers

Local EPrints ID: 450116
URI: http://eprints.soton.ac.uk/id/eprint/450116
ISSN: 1460-4582
PURE UUID: ae62c424-2b3e-44cc-8a06-8efdcfddafd9
ORCID for Claire Foster: ORCID iD orcid.org/0000-0002-4703-8378

Catalogue record

Date deposited: 12 Jul 2021 16:30
Last modified: 10 Apr 2024 01:40

Export record

Altmetrics

Contributors

Author: Fanny Sampurno
Author: Justin Cally
Author: Jacinta L Opie
Author: Ashwini Kannan
Author: Jeremy L Millar
Author: Antonio Finelli
Author: Andrew J Vickers
Author: Caroline M Moore
Author: Christoph Kowalski
Author: Claire Foster ORCID iD
Author: Dan A Barocas
Author: David Galvin
Author: Jean-paul Van Basten
Author: John L Gore
Author: Julia Ferencz
Author: Keith A Lawson
Author: Khurshid R Ghani
Author: Lorna Kwan
Author: Olli Saarela
Author: Sarah E Connor
Author: Sebastian Dieng
Author: Susan Linsell
Author: Timo Fw Soeterik
Author: Paul Villanti
Author: Mark S Litwin
Author: Sue M Evans

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×