The effect of methodological quality, sample size and statistical rigour on outcomes of randomised controlled trials in low back pain
The effect of methodological quality, sample size and statistical rigour on outcomes of randomised controlled trials in low back pain
Purpose and Background: Reliable and valid RCTs are essential in guiding clinical practice, but shortcomings in methodological quality have been reported in RCTs on LBP. The aim of this paper was to use the results of a systematic review on exercise or manual therapies for persistent LBP to evaluate the effect of methodological quality, sample size and statistical rigour on the outcomes of these trials.
Methods and Results: The systematic review included 41 RCTs on exercise or manual therapies (i.e. manipulation, mobilisation and/or massage) for persistent (>6 weeks) non-specific LBP. Quality of the RCTs was assessed using an adapted 10-point Van Tulder scale. Sample size was defined as the number of subjects in the intervention group. Adequate statistical testing was defined as analyses that compared the change in pain or function achieved by the intervention group with the change in the same parameter achieved by the control or alternative group. The results showed that the RCTs with smaller sample sizes or RCTs of lower methodological quality more often reported larger differences in effectiveness than RCTs of higher methodological quality or larger sample sizes. Furthermore, small differences in effectiveness reported by smaller RCTs were often not statistically significant, while larger trials showed that such differences actually were statistically significant.
Conclusion: Low methodological quality and small sample size has resulted in misinterpretation of RCTs. Small or low quality RCTs overestimated differences in effectiveness or failed to detect smaller but statistically significant differences. Future RCTs and systematic reviews should address these shortcomings in order to provide reliable guidance for clinical practice.
Hettinga, D.
462451c6-f73f-4e3a-b0e9-31f73d1b984e
June 2009
Hettinga, D.
462451c6-f73f-4e3a-b0e9-31f73d1b984e
Hettinga, D.
(2009)
The effect of methodological quality, sample size and statistical rigour on outcomes of randomised controlled trials in low back pain.
The Journal of Bone and Joint Surgery, 91-B, supplement II, 282.
Abstract
Purpose and Background: Reliable and valid RCTs are essential in guiding clinical practice, but shortcomings in methodological quality have been reported in RCTs on LBP. The aim of this paper was to use the results of a systematic review on exercise or manual therapies for persistent LBP to evaluate the effect of methodological quality, sample size and statistical rigour on the outcomes of these trials.
Methods and Results: The systematic review included 41 RCTs on exercise or manual therapies (i.e. manipulation, mobilisation and/or massage) for persistent (>6 weeks) non-specific LBP. Quality of the RCTs was assessed using an adapted 10-point Van Tulder scale. Sample size was defined as the number of subjects in the intervention group. Adequate statistical testing was defined as analyses that compared the change in pain or function achieved by the intervention group with the change in the same parameter achieved by the control or alternative group. The results showed that the RCTs with smaller sample sizes or RCTs of lower methodological quality more often reported larger differences in effectiveness than RCTs of higher methodological quality or larger sample sizes. Furthermore, small differences in effectiveness reported by smaller RCTs were often not statistically significant, while larger trials showed that such differences actually were statistically significant.
Conclusion: Low methodological quality and small sample size has resulted in misinterpretation of RCTs. Small or low quality RCTs overestimated differences in effectiveness or failed to detect smaller but statistically significant differences. Future RCTs and systematic reviews should address these shortcomings in order to provide reliable guidance for clinical practice.
This record has no associated files available for download.
More information
Published date: June 2009
Organisations:
Faculty of Health Sciences
Identifiers
Local EPrints ID: 365982
URI: http://eprints.soton.ac.uk/id/eprint/365982
ISSN: 0021-9355
PURE UUID: 19b0088a-20d8-4d95-9ce4-de87da9c4f23
Catalogue record
Date deposited: 15 Dec 2015 09:44
Last modified: 11 Dec 2021 04:26
Export record
Contributors
Author:
D. Hettinga
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.
View more statistics