updated 11/26/10
In July of 2009 I attended the Science-Based Medicine (SBM) Conference in Las Vegas. I was so impressed by what I learned that I volunteered to assist in any way that I could, and I have been a volunteer editor at Science-Based Medicine ever since. SBM is not a replacement for the more familiar concept of evidence-based medicine (EBM), but it does importantly emphasize some neglected aspects of EBM. This short article explains the differences.
What works? How do we know? History has shown that human “intuition” and the experience of doctors and patients are terrible ways to figure out which treatments are actually effective. Although science is far from perfect, careful experimental testing is by far the best way to find out if medicine or therapy works. Hooray for science! It’s the basis for every single major medical advance in the last hundred years.
Evidence-based medicine was founded as a named concept in 1990, though its principles go back much further.
Evidence-based medicine (EBM) aims to apply the best available evidence gained from the scientific method to medical decision making. It seeks to assess the strength of evidence of the risks and benefits of treatments (including lack of treatment) and diagnostic tests.
Evidence-based medicine. Wikipedia.com.
The idea of emphasizing science was first publicly proposed by Yale neurologist Dr. Steven Novella and infamous medical blogger and surgical oncologist Dr. David Gorski in early 2008, along with several other physician co-authors:
EBM is a vital and positive influence on the practice of medicine, but it has its limitations. Most relevant to this blog is the focus on evidence to the exclusion of scientific plausibility. The focus on evidence has its utility, but fails to properly deal with medical modalities that lie outside the scientific paradigm, or for which the scientific plausibility ranges from very little to nonexistent.
Announcing the Science-Based Medicine Blog, ScienceBasedMedicine.org contributors
EBM, although a step forward over prior dogma-based medical models, ultimately falls short of making medicine as effective as it can be. As currently practiced, EBM appears to worship clinical trial evidence above all else and nearly completely ignores basic science considerations, relegating them to the lowest form of evidence, lower than even small case series. This blind spot has directly contributed to the infiltration of quackery into academic medicine and so-called EBM …
Evidence-based medicine by definition rigorously limits itself to considering only the evidence. To an EBM purist, all that matters is testing. If a treatment works, it should pass scientific tests with flying colours. If it doesn’t, it won’t pass.
Sounds good. And don’t doctors and scientists already pretty much get that? Sure they do — most of them. But they aren’t the problem.
This EBM thing would work out great if no one was ever dishonest. But snake oil is real, and snake oil salesman know full well that they can co-opt EBM simply by claiming that the evidence does support them, and/or that “more study” is needed.
When experts contradict this, the disagreement supposedly becomes a controversy — actually a manufactroversy.1
Thus the snake oil salesman leapfrogs right over awkward problems like whether their product is consistent with the laws of physics. And so, sadly and strangely, the EBM movement has actually levelled the playing field for poor quality ideas — for which the evidence can be misinterpreted and misrepresented ad nauseum. Arguments about the quality and value of the evidence can drag on for years, ironically protecting the quack, who is immune to the charge that the idea was never any good to begin with and that “further study” is a waste of time.
The classic absurd unintended consequence of EBM is that a really bad idea can easily be made to seem as though it is perpetually on the verge of legitimacy, no different than a much better idea that simply hasn’t yet been validated by research.
For instance, a quack selling sharp-stick-in-the-eye therapy could use pitch perfect EBM-speak to say technically correct but patently ridiculous things like this: “There is insufficient evidence to support the use of sharp sticks in the eye to treat blindness, so we should keep studying it!” Prominent EBM publications like The Cochrane Collaboration and The Natural Standard contain wonderful real-world examples: they routinely publish remarkably uncritical statements about therapies that have never yet had any evidence supporting them and — importantly — almost certainly never will.
This “quasi-scientific obfuscation” gives some amazingly bad ideas the appearance of far more legitimacy than they deserve, keeping them going like the Energizer bunny.
Physical and manual therapists are rarely inflicting harm on people’s bodies, but we’re probably doing something even worse: we’re using their bodies to justify our existence through myth propagation and quasi-scientific obfuscation.
John Ware, Physical Therapist, comment in an EBM vs. SBM debate
What does SBM have to say about sharp sticks in the eye? Simple: “That’s insane! Stop spending taxpayer dollars on studying something that stupid! There’s serious research that desperately needs funding and doing!”
There’s a tone of no-time-for-nonsense pragmatism in SBM, which I really like.
Extraordinary (implausible) claims require extraordinary evidence, and ignoring implausibility makes Carl Sagan turn in his grave. With its name, SBM suggests that we take basic science (much) more seriously when we’re talking about health care. We need to place greater emphasis on the value of a huge body of scientific knowledge about how humans work.2
The difference between SBM and EBM might seem like hair-splitting to many people. However, our civilization and tax dollars have better things to do than carry on studying and being distracted by low quality ideas in health care. Ironically, EBM has allowed extraordinary claims to cling to life without any evidence at all — not even ordinary evidence.
A science-based perspective is needed to address this problem.
I suspect that the originators of EBM … never thought of the possibility of EBM being applied to hypotheses as awe-inspiringly implausible as those of CAM. It simply never occurred to them; they probably assumed that any hypothesis that reaches a clinical trial stage must have good preclinical (i.e., basic science) evidence to support its efficacy.
Answering a criticism of science-based medicine, Dr. David Gorski
EBM and SBM are not competitors. SBM is not intended to usurp EBM — just to emphasize some neglected and abused aspects of it. Was coining a new term the best way to do that? Does it undermine EBM? Should Drs. Novella and Gorski have just put their effort into fighting for better EBM? Maybe. I don’t know, and I don’t think it matters much. I think they are fighting for better EBM.
It is not that we are opposed to EBM, nor is it that we believe EBM and SBM to be mutually exclusive. On the contrary: EBM is currently a subset of SBM, because EBM by itself is incomplete. We eagerly await the time that EBM considers all the evidence and will have finally earned its name. When that happens, the two terms will be interchangeable.
Jacqueline: EBM ought to be Synonymous with SBM, Dr. Kimball Atwood
This is a listing of most of the articles at Science-Based Medicine that address the idea of SBM and the reasons for the existence of the blog, in the order that they have appeared: