The University of Southampton
University of Southampton Institutional Repository

Assessment of the potential impact of a reminder system on the reduction of diagnostic errors: a quasi-experimental study

Assessment of the potential impact of a reminder system on the reduction of diagnostic errors: a quasi-experimental study
Assessment of the potential impact of a reminder system on the reduction of diagnostic errors: a quasi-experimental study
BACKGROUND: Computerized decision support systems (DSS) have mainly focused on improving clinicians' diagnostic accuracy in unusual and challenging cases. However, since diagnostic omission errors may predominantly result from incomplete workup in routine clinical practice, the provision of appropriate patient- and context-specific reminders may result in greater impact on patient safety. In this experimental study, a mix of easy and difficult simulated cases were used to assess the impact of a novel diagnostic reminder system (ISABEL) on the quality of clinical decisions made by various grades of clinicians during acute assessment. METHODS: Subjects of different grades (consultants, registrars, senior house officers and medical students), assessed a balanced set of 24 simulated cases on a trial website. Subjects recorded their clinical decisions for the cases (differential diagnosis, test-ordering and treatment), before and after system consultation. A panel of two pediatric consultants independently provided gold standard responses for each case, against which subjects' quality of decisions was measured. The primary outcome measure was change in the count of diagnostic errors of omission (DEO). A more sensitive assessment of the system's impact was achieved using specific quality scores; additional consultation time resulting from DSS use was also calculated. RESULTS: 76 subjects (18 consultants, 24 registrars, 19 senior house officers and 15 students) completed a total of 751 case episodes. The mean count of DEO fell from 5.5 to 5.0 across all subjects (repeated measures ANOVA, p < 0.001); no significant interaction was seen with subject grade. Mean diagnostic quality score increased after system consultation (0.044; 95% confidence interval 0.032, 0.054). ISABEL reminded subjects to consider at least one clinically important diagnosis in 1 in 8 case episodes, and prompted them to order an important test in 1 in 10 case episodes. Median extra time taken for DSS consultation was 1 min (IQR: 30 sec to 2 min). CONCLUSION: The provision of patient- and context-specific reminders has the potential to reduce diagnostic omissions across all subject grades for a range of cases. This study suggests a promising role for the use of future reminder-based DSS in the reduction of diagnostic error
diagnosis, research, great britain, safety management, students, humans, clinical, methods, decision support systems, time, medical, computer-assisted, responses, london, analysis of variance, no, outcome and process assessment (health care), hospital, reminder systems, benchmarking, specialties, consultants, diagnostic errors, sensitivity and specificity, prevention & control, safety, episode of care, medical staff
6-22
Ramnarayan, P.
329b32d9-0fcd-4a3c-ac20-4e4dc060643c
Roberts, G. C.
ea00db4e-84e7-4b39-8273-9b71dbd7e2f3
Coren, M.
974a97d4-1033-4ba0-bc1a-7a52f2326dbe
Nanduri, V.
f63e534d-5846-49ae-9c71-51c0a33cfc7a
Tomlinson, A.
ce56d0c5-4a06-46a6-93b5-ee6dbec80f07
Taylor, P. M.
fdb35081-6e9c-43b7-9be1-434a676e562c
Wyatt, J. C.
16035f8a-3530-48ea-aa54-b2c5a6a96067
Britto, J. F.
1b389574-e7cc-4a81-b5ae-ef6e82ca3d47
Ramnarayan, P.
329b32d9-0fcd-4a3c-ac20-4e4dc060643c
Roberts, G. C.
ea00db4e-84e7-4b39-8273-9b71dbd7e2f3
Coren, M.
974a97d4-1033-4ba0-bc1a-7a52f2326dbe
Nanduri, V.
f63e534d-5846-49ae-9c71-51c0a33cfc7a
Tomlinson, A.
ce56d0c5-4a06-46a6-93b5-ee6dbec80f07
Taylor, P. M.
fdb35081-6e9c-43b7-9be1-434a676e562c
Wyatt, J. C.
16035f8a-3530-48ea-aa54-b2c5a6a96067
Britto, J. F.
1b389574-e7cc-4a81-b5ae-ef6e82ca3d47

Ramnarayan, P., Roberts, G. C., Coren, M., Nanduri, V., Tomlinson, A., Taylor, P. M., Wyatt, J. C. and Britto, J. F. (2006) Assessment of the potential impact of a reminder system on the reduction of diagnostic errors: a quasi-experimental study. BMC Medical Informatics and Decision Making, 6, 6-22. (doi:10.1186/1472-6947-6-22).

Record type: Article

Abstract

BACKGROUND: Computerized decision support systems (DSS) have mainly focused on improving clinicians' diagnostic accuracy in unusual and challenging cases. However, since diagnostic omission errors may predominantly result from incomplete workup in routine clinical practice, the provision of appropriate patient- and context-specific reminders may result in greater impact on patient safety. In this experimental study, a mix of easy and difficult simulated cases were used to assess the impact of a novel diagnostic reminder system (ISABEL) on the quality of clinical decisions made by various grades of clinicians during acute assessment. METHODS: Subjects of different grades (consultants, registrars, senior house officers and medical students), assessed a balanced set of 24 simulated cases on a trial website. Subjects recorded their clinical decisions for the cases (differential diagnosis, test-ordering and treatment), before and after system consultation. A panel of two pediatric consultants independently provided gold standard responses for each case, against which subjects' quality of decisions was measured. The primary outcome measure was change in the count of diagnostic errors of omission (DEO). A more sensitive assessment of the system's impact was achieved using specific quality scores; additional consultation time resulting from DSS use was also calculated. RESULTS: 76 subjects (18 consultants, 24 registrars, 19 senior house officers and 15 students) completed a total of 751 case episodes. The mean count of DEO fell from 5.5 to 5.0 across all subjects (repeated measures ANOVA, p < 0.001); no significant interaction was seen with subject grade. Mean diagnostic quality score increased after system consultation (0.044; 95% confidence interval 0.032, 0.054). ISABEL reminded subjects to consider at least one clinically important diagnosis in 1 in 8 case episodes, and prompted them to order an important test in 1 in 10 case episodes. Median extra time taken for DSS consultation was 1 min (IQR: 30 sec to 2 min). CONCLUSION: The provision of patient- and context-specific reminders has the potential to reduce diagnostic omissions across all subject grades for a range of cases. This study suggests a promising role for the use of future reminder-based DSS in the reduction of diagnostic error

This record has no associated files available for download.

More information

Published date: 28 April 2006
Additional Information: PM:16646956
Keywords: diagnosis, research, great britain, safety management, students, humans, clinical, methods, decision support systems, time, medical, computer-assisted, responses, london, analysis of variance, no, outcome and process assessment (health care), hospital, reminder systems, benchmarking, specialties, consultants, diagnostic errors, sensitivity and specificity, prevention & control, safety, episode of care, medical staff

Identifiers

Local EPrints ID: 61455
URI: http://eprints.soton.ac.uk/id/eprint/61455
PURE UUID: 089c00b5-8304-4044-9180-8f2dff82aa3d
ORCID for G. C. Roberts: ORCID iD orcid.org/0000-0003-2252-1248

Catalogue record

Date deposited: 16 Apr 2009
Last modified: 16 Mar 2024 03:44

Export record

Altmetrics

Contributors

Author: P. Ramnarayan
Author: G. C. Roberts ORCID iD
Author: M. Coren
Author: V. Nanduri
Author: A. Tomlinson
Author: P. M. Taylor
Author: J. C. Wyatt
Author: J. F. Britto

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×