Circular instead of hierarchical: methodological principles for the evaluation of complex interventions
Circular instead of hierarchical: methodological principles for the evaluation of complex interventions
Background
The reasoning behind evaluating medical interventions is that a hierarchy of methods exists which successively produce improved and therefore more rigorous evidence based medicine upon which to make clinical decisions. At the foundation of this hierarchy are case studies, retrospective and prospective case series, followed by cohort studies with historical and concomitant non-randomized controls. Open-label randomized controlled studies (RCTs), and finally blinded, placebo-controlled RCTs, which offer most internal validity are considered the most reliable evidence. Rigorous RCTs remove bias. Evidence from RCTs forms the basis of meta-analyses and systematic reviews. This hierarchy, founded on a pharmacological model of therapy, is generalized to other interventions which may be complex and non-pharmacological (healing, acupuncture and surgery).
Discussion
The hierarchical model is valid for limited questions of efficacy, for instance for regulatory purposes and newly devised products and pharmacological preparations. It is inadequate for the evaluation of complex interventions such as physiotherapy, surgery and complementary and alternative medicine (CAM). This has to do with the essential tension between internal validity (rigor and the removal of bias) and external validity (generalizability).
Summary
Instead of an Evidence Hierarchy, we propose a Circular Model. This would imply a multiplicity of methods, using different designs, counterbalancing their individual strengths and weaknesses to arrive at pragmatic but equally rigorous evidence which would provide significant assistance in clinical and health systems innovation. Such evidence would better inform national health care technology assessment agencies and promote evidence based health reform.
reproducibility of results, placebos, technology assessment, cohort, surgery, acupuncture, research design, review, health, randomized controlled trials as topic, biomedical, evidence-based medicine
[9pp]
Walach, Harald
b6c1f873-105c-4825-9b9b-2a3cf9dc4fb2
Falkenberg, Torkel
38b7bd1d-039e-4acf-bd3b-a40e7c81d7a9
Fonnebo, Vinjar
8a6a4201-badd-458d-b652-32080f04b31b
Lewith, George
0fc483fa-f17b-47c5-94d9-5c15e65a7625
Jonas, Wayne B.
c47c8e9c-7271-4ff4-b6cc-43f9449315bf
24 June 2006
Walach, Harald
b6c1f873-105c-4825-9b9b-2a3cf9dc4fb2
Falkenberg, Torkel
38b7bd1d-039e-4acf-bd3b-a40e7c81d7a9
Fonnebo, Vinjar
8a6a4201-badd-458d-b652-32080f04b31b
Lewith, George
0fc483fa-f17b-47c5-94d9-5c15e65a7625
Jonas, Wayne B.
c47c8e9c-7271-4ff4-b6cc-43f9449315bf
Walach, Harald, Falkenberg, Torkel, Fonnebo, Vinjar, Lewith, George and Jonas, Wayne B.
(2006)
Circular instead of hierarchical: methodological principles for the evaluation of complex interventions.
BMC Medical Research Methodology, 6 (29), .
(doi:10.1186/1471-2288-6-29).
Abstract
Background
The reasoning behind evaluating medical interventions is that a hierarchy of methods exists which successively produce improved and therefore more rigorous evidence based medicine upon which to make clinical decisions. At the foundation of this hierarchy are case studies, retrospective and prospective case series, followed by cohort studies with historical and concomitant non-randomized controls. Open-label randomized controlled studies (RCTs), and finally blinded, placebo-controlled RCTs, which offer most internal validity are considered the most reliable evidence. Rigorous RCTs remove bias. Evidence from RCTs forms the basis of meta-analyses and systematic reviews. This hierarchy, founded on a pharmacological model of therapy, is generalized to other interventions which may be complex and non-pharmacological (healing, acupuncture and surgery).
Discussion
The hierarchical model is valid for limited questions of efficacy, for instance for regulatory purposes and newly devised products and pharmacological preparations. It is inadequate for the evaluation of complex interventions such as physiotherapy, surgery and complementary and alternative medicine (CAM). This has to do with the essential tension between internal validity (rigor and the removal of bias) and external validity (generalizability).
Summary
Instead of an Evidence Hierarchy, we propose a Circular Model. This would imply a multiplicity of methods, using different designs, counterbalancing their individual strengths and weaknesses to arrive at pragmatic but equally rigorous evidence which would provide significant assistance in clinical and health systems innovation. Such evidence would better inform national health care technology assessment agencies and promote evidence based health reform.
This record has no associated files available for download.
More information
Published date: 24 June 2006
Keywords:
reproducibility of results, placebos, technology assessment, cohort, surgery, acupuncture, research design, review, health, randomized controlled trials as topic, biomedical, evidence-based medicine
Identifiers
Local EPrints ID: 62185
URI: http://eprints.soton.ac.uk/id/eprint/62185
ISSN: 1471-2288
PURE UUID: 635c8336-c094-410c-b3a3-cd24157c0ce1
Catalogue record
Date deposited: 10 Sep 2008
Last modified: 15 Mar 2024 11:29
Export record
Altmetrics
Contributors
Author:
Harald Walach
Author:
Torkel Falkenberg
Author:
Vinjar Fonnebo
Author:
George Lewith
Author:
Wayne B. Jonas
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.
View more statistics