The University of Southampton
University of Southampton Institutional Repository

PRImary care Streptococcal Management (PRISM) study: in vitro study, diagnostic cohorts and a pragmatic adaptive randomised controlled trial with nested qualitative study and cost-effectiveness study

PRImary care Streptococcal Management (PRISM) study: in vitro study, diagnostic cohorts and a pragmatic adaptive randomised controlled trial with nested qualitative study and cost-effectiveness study
PRImary care Streptococcal Management (PRISM) study: in vitro study, diagnostic cohorts and a pragmatic adaptive randomised controlled trial with nested qualitative study and cost-effectiveness study
Background: antibiotics are still prescribed to most patients attending primary care with acute sore throat, despite evidence that there is modest benefit overall from antibiotics. Targeting antibiotics using either clinical scoring methods or rapid antigen detection tests (RADTs) could help. However, there is debate about which groups of streptococci are important (particularly Lancefield groups C and G), and uncertainty about the variables that most clearly predict the presence of streptococci.

Objective: this study aimed to compare clinical scores or RADTs with delayed antibiotic prescribing.

Design: the study comprised a RADT in vitro study; two diagnostic cohorts to develop streptococcal scores (score 1; score 2); and, finally, an open pragmatic randomised controlled trial with nested qualitative and cost-effectiveness studies.

Setting: the setting was UK primary care general practices.

Participants: participants were patients aged ? 3 years with acute sore throat.

Interventions: an internet program randomised patients to targeted antibiotic use according to (1) delayed antibiotics (control group), (2) clinical score or (3) RADT used according to clinical score.

Main outcome measures: the main outcome measures were self-reported antibiotic use and symptom duration and severity on seven-point Likert scales (primary outcome: mean sore throat/difficulty swallowing score in the first 2–4 days).

Results: the IMI TestPack Plus Strep A (Inverness Medical, Bedford, UK) was sensitive, specific and easy to use. Lancefield group A/C/G streptococci were found in 40% of cohort 2 and 34% of cohort 1. A five-point score predicting the presence of A/C/G streptococci [FeverPAIN: Fever; Purulence; Attend rapidly (? 3 days); severe Inflammation; and No cough or coryza] had moderate predictive value
(bootstrapped estimates of area under receiver operating characteristic curve: 0.73 cohort 1, 0.71 cohort 2) and identified a substantial number of participants at low risk of streptococcal infection.
In total, 38% of cohort 1 and 36% of cohort 2 scored ? 1 for FeverPAIN, associated with streptococcal percentages of 13% and 18%, respectively. In an adaptive trial design, the preliminary score (score 1; n = 1129) was replaced by FeverPAIN (n = 631). For score 1, there were no significant differences between groups. For FeverPAIN, symptom severity was documented in 80% of patients, and was lower in the
clinical score group than in the delayed prescribing group (–0.33; 95% confidence interval –0.64
to –0.02; p = 0.039; equivalent to one in three rating sore throat a slight rather than moderately bad problem), and a similar reduction was observed for the RADT group (–0.30; –0.61 to 0.00; p = 0.053).
Moderately bad or worse symptoms resolved significantly faster (30%) in the clinical score group (hazard ratio 1.30; 1.03 to 1.63) but not the RADT group (1.11; 0.88 to 1.40). In the delayed group, 75/164 (46%) used antibiotics, and 29% fewer used antibiotics in the clinical score group (risk ratio 0.71; 0.50 to 0.95; p = 0.018) and 27% fewer in the RADT group (0.73; 0.52 to 0.98; p = 0.033). No significant differences in complications or reconsultations were found. The clinical score group dominated both other
groups for both the cost/quality-adjusted life-years and cost/change in symptom severity analyses, being both less costly and more effective, and cost-effectiveness acceptability curves indicated the clinical score to be the most likely to be cost-effective from an NHS perspective. Patients were positive about RADTs. Health professionals’ concerns about test validity, the time the test took and medicalising self-limiting illness lessened after using the tests. For both RADTs and clinical scores, there were tensions with established clinical experience.

Conclusions: targeting antibiotics using a clinical score (FeverPAIN) efficiently improves symptoms and reduces antibiotic use. RADTs used in combination with FeverPAIN provide no clear advantages over FeverPAIN alone, and RADTs are unlikely to be incorporated into practice until health professionals’ concerns are met and they have experience of using them. Clinical scores also face barriers related to
clinicians’ perceptions of their utility in the face of experience. This study has demonstrated the limitation
of using one data set to develop a clinical score. FeverPAIN, derived from two data sets, appears to be
valid and its use improves outcomes, but diagnostic studies to confirm the validity of FeverPAIN in other data sets and settings are needed. Experienced clinicians need to identify barriers to the use of clinical
scoring methods. Implementation studies that address perceived barriers in the use of FeverPAIN are needed.

Trial registration: Current Controlled Trials ISRCTN32027234.

Source of funding: this project was funded by the NIHR Health Technology Assessment programme and will be published in full in Health Technology Assessment; Vol. 18, No. 6. See the NIHR Journals Library website for further project information
1366-5278
1-101
Little, Paul
1bf2d1f7-200c-47a5-ab16-fe5a8756a777
Hobbs, FD Richard
2e48ac78-1c66-4738-844b-a0ea0cb85d6f
Moore, Michael
1be81dad-7120-45f0-bbed-f3b0cc0cfe99
Mant, David
d2e30212-70ec-48c9-b80a-a45cf4bcc46e
Williamson, Ian
12381296-edbf-4ac5-969b-dcb559c22f27
McNulty, Cliodna
212425d9-06ca-4ef8-9982-1acbd579c8ee
Lasseter, Gemma
5d143f95-5052-41f2-b3a2-b0de64ba63e8
Cheng, MY Edith
a2fb8a9b-cd0c-4876-8b5c-99bb24d38117
Leydon, Geraldine
c5cdaff5-0fa1-4d38-b575-b97c2892ec40
McDermott, Lisa
5e895229-decd-4a30-8d08-dd9cc5b8f443
Turner, David
39dc4dc8-88b4-4950-8bbd-c647ff110ec9
Pinedo-Villanueva, Rafael
d038070d-b785-4ec9-9b27-4724561fd6ef
Raftery, James
27c2661d-6c4f-448a-bf36-9a89ec72bd6b
Glasziou, Paul
c1890d0d-7bb1-45c9-9841-5a38c834eac2
Mullee, Mark
fd3f91c3-5e95-4f56-8d73-260824eeb362
Little, Paul
1bf2d1f7-200c-47a5-ab16-fe5a8756a777
Hobbs, FD Richard
2e48ac78-1c66-4738-844b-a0ea0cb85d6f
Moore, Michael
1be81dad-7120-45f0-bbed-f3b0cc0cfe99
Mant, David
d2e30212-70ec-48c9-b80a-a45cf4bcc46e
Williamson, Ian
12381296-edbf-4ac5-969b-dcb559c22f27
McNulty, Cliodna
212425d9-06ca-4ef8-9982-1acbd579c8ee
Lasseter, Gemma
5d143f95-5052-41f2-b3a2-b0de64ba63e8
Cheng, MY Edith
a2fb8a9b-cd0c-4876-8b5c-99bb24d38117
Leydon, Geraldine
c5cdaff5-0fa1-4d38-b575-b97c2892ec40
McDermott, Lisa
5e895229-decd-4a30-8d08-dd9cc5b8f443
Turner, David
39dc4dc8-88b4-4950-8bbd-c647ff110ec9
Pinedo-Villanueva, Rafael
d038070d-b785-4ec9-9b27-4724561fd6ef
Raftery, James
27c2661d-6c4f-448a-bf36-9a89ec72bd6b
Glasziou, Paul
c1890d0d-7bb1-45c9-9841-5a38c834eac2
Mullee, Mark
fd3f91c3-5e95-4f56-8d73-260824eeb362

Little, Paul, Hobbs, FD Richard, Moore, Michael, Mant, David, Williamson, Ian, McNulty, Cliodna, Lasseter, Gemma, Cheng, MY Edith, Leydon, Geraldine, McDermott, Lisa, Turner, David, Pinedo-Villanueva, Rafael, Raftery, James, Glasziou, Paul and Mullee, Mark (2014) PRImary care Streptococcal Management (PRISM) study: in vitro study, diagnostic cohorts and a pragmatic adaptive randomised controlled trial with nested qualitative study and cost-effectiveness study. Health Technology Assessment, 18 (6), 1-101. (doi:10.3310/hta18060). (PMID:24467988)

Record type: Article

Abstract

Background: antibiotics are still prescribed to most patients attending primary care with acute sore throat, despite evidence that there is modest benefit overall from antibiotics. Targeting antibiotics using either clinical scoring methods or rapid antigen detection tests (RADTs) could help. However, there is debate about which groups of streptococci are important (particularly Lancefield groups C and G), and uncertainty about the variables that most clearly predict the presence of streptococci.

Objective: this study aimed to compare clinical scores or RADTs with delayed antibiotic prescribing.

Design: the study comprised a RADT in vitro study; two diagnostic cohorts to develop streptococcal scores (score 1; score 2); and, finally, an open pragmatic randomised controlled trial with nested qualitative and cost-effectiveness studies.

Setting: the setting was UK primary care general practices.

Participants: participants were patients aged ? 3 years with acute sore throat.

Interventions: an internet program randomised patients to targeted antibiotic use according to (1) delayed antibiotics (control group), (2) clinical score or (3) RADT used according to clinical score.

Main outcome measures: the main outcome measures were self-reported antibiotic use and symptom duration and severity on seven-point Likert scales (primary outcome: mean sore throat/difficulty swallowing score in the first 2–4 days).

Results: the IMI TestPack Plus Strep A (Inverness Medical, Bedford, UK) was sensitive, specific and easy to use. Lancefield group A/C/G streptococci were found in 40% of cohort 2 and 34% of cohort 1. A five-point score predicting the presence of A/C/G streptococci [FeverPAIN: Fever; Purulence; Attend rapidly (? 3 days); severe Inflammation; and No cough or coryza] had moderate predictive value
(bootstrapped estimates of area under receiver operating characteristic curve: 0.73 cohort 1, 0.71 cohort 2) and identified a substantial number of participants at low risk of streptococcal infection.
In total, 38% of cohort 1 and 36% of cohort 2 scored ? 1 for FeverPAIN, associated with streptococcal percentages of 13% and 18%, respectively. In an adaptive trial design, the preliminary score (score 1; n = 1129) was replaced by FeverPAIN (n = 631). For score 1, there were no significant differences between groups. For FeverPAIN, symptom severity was documented in 80% of patients, and was lower in the
clinical score group than in the delayed prescribing group (–0.33; 95% confidence interval –0.64
to –0.02; p = 0.039; equivalent to one in three rating sore throat a slight rather than moderately bad problem), and a similar reduction was observed for the RADT group (–0.30; –0.61 to 0.00; p = 0.053).
Moderately bad or worse symptoms resolved significantly faster (30%) in the clinical score group (hazard ratio 1.30; 1.03 to 1.63) but not the RADT group (1.11; 0.88 to 1.40). In the delayed group, 75/164 (46%) used antibiotics, and 29% fewer used antibiotics in the clinical score group (risk ratio 0.71; 0.50 to 0.95; p = 0.018) and 27% fewer in the RADT group (0.73; 0.52 to 0.98; p = 0.033). No significant differences in complications or reconsultations were found. The clinical score group dominated both other
groups for both the cost/quality-adjusted life-years and cost/change in symptom severity analyses, being both less costly and more effective, and cost-effectiveness acceptability curves indicated the clinical score to be the most likely to be cost-effective from an NHS perspective. Patients were positive about RADTs. Health professionals’ concerns about test validity, the time the test took and medicalising self-limiting illness lessened after using the tests. For both RADTs and clinical scores, there were tensions with established clinical experience.

Conclusions: targeting antibiotics using a clinical score (FeverPAIN) efficiently improves symptoms and reduces antibiotic use. RADTs used in combination with FeverPAIN provide no clear advantages over FeverPAIN alone, and RADTs are unlikely to be incorporated into practice until health professionals’ concerns are met and they have experience of using them. Clinical scores also face barriers related to
clinicians’ perceptions of their utility in the face of experience. This study has demonstrated the limitation
of using one data set to develop a clinical score. FeverPAIN, derived from two data sets, appears to be
valid and its use improves outcomes, but diagnostic studies to confirm the validity of FeverPAIN in other data sets and settings are needed. Experienced clinicians need to identify barriers to the use of clinical
scoring methods. Implementation studies that address perceived barriers in the use of FeverPAIN are needed.

Trial registration: Current Controlled Trials ISRCTN32027234.

Source of funding: this project was funded by the NIHR Health Technology Assessment programme and will be published in full in Health Technology Assessment; Vol. 18, No. 6. See the NIHR Journals Library website for further project information

Text
FullReport-hta18060.pdf - Version of Record
Download (2MB)

More information

e-pub ahead of print date: 1 January 2014
Published date: 30 January 2014
Organisations: Faculty of Natural and Environmental Sciences, Faculty of Medicine, Primary Care & Population Sciences, Psychology

Identifiers

Local EPrints ID: 361649
URI: http://eprints.soton.ac.uk/id/eprint/361649
ISSN: 1366-5278
PURE UUID: c23dba06-fe32-4a99-b76c-6a530b06a21c
ORCID for Paul Little: ORCID iD orcid.org/0000-0003-3664-1873
ORCID for Michael Moore: ORCID iD orcid.org/0000-0002-5127-4509
ORCID for Geraldine Leydon: ORCID iD orcid.org/0000-0001-5986-3300

Catalogue record

Date deposited: 31 Jan 2014 08:49
Last modified: 12 Jul 2024 01:43

Export record

Altmetrics

Contributors

Author: Paul Little ORCID iD
Author: FD Richard Hobbs
Author: Michael Moore ORCID iD
Author: David Mant
Author: Ian Williamson
Author: Cliodna McNulty
Author: Gemma Lasseter
Author: MY Edith Cheng
Author: Lisa McDermott
Author: David Turner
Author: Rafael Pinedo-Villanueva
Author: James Raftery
Author: Paul Glasziou
Author: Mark Mullee

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×