Articles & Studies
How Strong is Your Evidence?
If you’ve had heart problems, chances are you’ve received some advice from your doctor on how best to care for your condition. Maybe you were advised to take an aspirin daily, exercise regularly, or cut down on the salt in your diet. Maybe you were handed a sheaf of prescriptions bearing foreign-sounding medication names with the assurances that they would help stave off future problems. And if you’re like many patients, you took the doctor at his or her word, assuming he or she was acting based on sound medical evidence. Unfortunately, that assumption may have been false.
The push in medical education for several years has been towards more evidence-based medicine; that is, we should teach our young doctors to recommend to their patients what has been scientifically proven to be beneficial. However, a recent study published in the Journal of the American Medical Association (JAMA) found that, at least with regards to cardiovascular problems, the vast majority of the medical evidence supporting current recommendations is weak. Researchers examined the current recommendations of the American Heart Association and the American College of Cardiology on 22 different cardiovascular topics. They graded the strength of the evidence supporting these recommendations from A to C, with A being the best evidence, and C being very little or weak evidence. Only 12% of the recommendations were in the A category. A staggering 45% earned a C.
There are many potential reasons for this, not the least of which is simply the lack of powerful data. The ideal medical study is a large, multicenter, randomized, double-blind, controlled trial funded by an organization with no vested interest in the outcome. The closer a study comes to this ideal, the stronger the evidence is to support its findings. However, many studies fall short of this ideal on numerous fronts. They involve a small or restricted subgroup of patients. They’re performed at only one medical center. They’re funded by the company that makes the medication or device being studied. Any of these shortcomings call the results of the study into question and weakens the strength of the evidence. Can these findings be applied to a larger or less restricted population? Can the results be reproduced at a different hospital? Are the researchers biased towards finding a positive outcome for the company that funds their research?
So should you ignore the majority of what your doctor says for lack of strong evidence? Not necessarily. Most doctors are simply working with the best information they have, even if the data supporting it is weak. What studies like this highlight is the need for better research to ensure that our recommendations are based on sound scientific evidence.
References
P. Tricoci, J. M. Allen, J. M. Kramer, R. M. Califf, S. C. Smith (2009). Scientific Evidence Underlying the ACC/AHA Clinical Practice Guidelines JAMA: The Journal of the American Medical Association, 301 (8), 831-841 DOI: 10.1001/jama.2009.205
3 Comments/Trackbacks
Be sure to read Dr. Grace Jackson’s “Open Letter to the Federal Coordinating Council for Comparative Effectiveness Research” posted at the Institute for Nearly Genuine Research web site:
http://www.bonkersinstitute.org/jacksonletter.html
Trackbacks
- Mar 13, 2009 | Why I love the ResearchBlogs twitter feed « info-fetishist
Leave a Reply
Tuesday, February 9, 2010
- Religion - A "Natural" Phenomenon?
- Creating an Artificial Brain
- How Culture Shapes Our Mind and Brain
- Sex, Violence and The Male Warrior Hypothesis
- The Secret to Good Health – Listen to the Data
- If Herbal Medicine is Medicine, Shouldn't it be Treated as Such?
- Too Much Information?
- Swine Flu - A Lose-Lose Situation for Public Health Authorities
- Logging On for Psychotherapy
- The Neural Basis of the Self
- Income Inequality and Health Outcomes
- Ginkgo Biloba Ineffective... Again
- The Evolution of Depression
- Post-Partum Psychosis - Rare but Real
- Worried Well on the Web
- Is Your Doctor Happy or Burnt-Out?
- Journal Retracts Autism Research
- How Young is Too Young to Diagnose Depression?
- In Sickness and Mental Health
- Health Insurance for All - A Weighty Issue
- “I Feel Your Pain” – The Neural Basis of Empathy
- Speaking in Tongues – A Neural Snapshot
- Neuro Case 1 – Using Transcranial Doppler for Basilar Artery Occlusion
- Journal Retracts Autism Research
- Crossing the Line from Physician to Journalist
- Ginkgo Biloba Ineffective… Again
- The Smart Ones are Living Longer
- Too Much Information?
- Drugs and Pharmacology, Nineteenth Edition
- Coping with Trauma – Lessons from Resilient Individuals
- Worried Well on the Web
- Neurology, Neurosurgery, and Neuroscience Conferences for 2010
- One Puff Forward, Two Pounds Back
- Income Inequality and Health Outcomes
- Farewell 2009, Welcome 2010
- When the Drugs Don’t Work, or Just Make it Worse
- Is a Slim Santa Claus Coming to Town?
- Stimulants May Offer Protection in ADHD
- Sex, Violence and The Male Warrior Hypothesis
- Is Time on Your Side?
- We all get depressed every now and then. It's part of life. Sometimes you feel g...
- it will take many test to prove whether gingko biloba is effective..but for now ...
- i do not know which Australlia you are talking abiuy. My impression about this c...
- The Institute of Natural Excellence has a new way to look at this and many other...
- My guessI expect that in their childhood...free flowing care free ...
- its the mind game when it comes to good healthy survival. better iq means better...
- the ability of brain to store information, regarding different languages while c...
- 12 children were taken as subjects for a very controversial research , the resu...
- Below is how and why the Swine flu was Genetically Engineered. For full version...
- Having worked with developmentally disabled persons for 17 years, I see many par...
- Great job. I've posted a link to here from the ...
- Yeah... I don't buy it. Know why? Because rotund Santa was around for many gener...
- For those unfamiliar with Dr. John Cannell's Vitamin D Theory of Autism see the...
- It is a pity that very little coverage of this issue names the journalist who is...
- I would like to see some research into what Ginkgo biloba does do instead of wha...
- It is easier for us to ignore the problem than really attack the problem, due to...
- I was going by Alan MacFarlane's description of Hunter Gatherer societies.( les...
- Javaid, where on earth do you get the idea that hunter-gatherers have little or ...
- This is my angle ..Hunter Gatherers have the lightest density footprint and ...
- yes , i really like it. isuggest everyone to be fit and healthy....
Sponsored Links
Diet and Health Supplements, Best vitamins supplements, Brain Fitness DVD, Home Care, Alcohol Rehab, Emergency Lighting, Online Criminal Justice Degrees, Tattoo, Health Insurance, Electronic Accessories , Credit Score Cowboy , Rollup Banner Stands , Sofas , Biotechnology , Metastatic Breast Cancer , Kenacomb Cream , Cystic Fibrosis Disease , Lung Cancer Treatment , Dallas health insurance , Arthritis Treatment , Short Term Disability Insurance , Colon Cancer Treatment , Allen personal injury attorneys , How Are Pinworm Infections Treated? , Edgepark Medical , Hydroxycut, Astrology compatibility.
Neuroscience & Neurology
February 09, 2010 | 1 Comment | By Meghan Meyer, PhD student
“I Feel Your Pain” – The Neural Basis of Empathy
More In Neuroscience & Neurology
- Speaking in Tongues – A Neural Snapshot
- Neuro Case 1 – Using Transcranial Doppler for Basilar Artery Occlusion
- Neurology, Neurosurgery, and Neuroscience Conferences for 2010
- Are Physicians Spending Too Much Time Diagnosing Patients?
- Two Wrongs Make a Right – Abnormal Brain Circuitry May Stop Abnormal Movement
Neuroscience & Neurology
Opinion
February 01, 2010 | 0 Comments | By Jennifer Gibson, PharmD
Crossing the Line from Physician to Journalist
More In Opinion
- Sex, Violence and The Male Warrior Hypothesis
- Bruxism and the Brain
- Religion – A “Natural” Phenomenon?
- Natural Good, Chemical Bad – Right?
- Time for a Change – Gender Reassignment
Opinion
Psychiatry & Psychology
February 03, 2010 | 5 Comments | By Jennifer Gibson, PharmD
Journal Retracts Autism Research
More In Psychiatry & Psychology
- White Bears – The Paradox of Mental Suppression
- Sugar and Spice and Everything Nice?
- The Evolution of Depression
- Why So Serious About The Self?
- New Report on the Use of Antidepressants During Pregnancy


Evidence based medicine is inherently conservative and limited by the prejudices of researchers.
To get good quality evidence for the kinds of recommendations needed for behavioural modification would be incredibly complex and expensive. Worth doing of course, but clinically do we have the 30 years needed before recommendations are needed?