Articles & Studies
How Strong is Your Evidence?
If you’ve had heart problems, chances are you’ve received some advice from your doctor on how best to care for your condition. Maybe you were advised to take an aspirin daily, exercise regularly, or cut down on the salt in your diet. Maybe you were handed a sheaf of prescriptions bearing foreign-sounding medication names with the assurances that they would help stave off future problems. And if you’re like many patients, you took the doctor at his or her word, assuming he or she was acting based on sound medical evidence. Unfortunately, that assumption may have been false.
The push in medical education for several years has been towards more evidence-based medicine; that is, we should teach our young doctors to recommend to their patients what has been scientifically proven to be beneficial. However, a recent study published in the Journal of the American Medical Association (JAMA) found that, at least with regards to cardiovascular problems, the vast majority of the medical evidence supporting current recommendations is weak. Researchers examined the current recommendations of the American Heart Association and the American College of Cardiology on 22 different cardiovascular topics. They graded the strength of the evidence supporting these recommendations from A to C, with A being the best evidence, and C being very little or weak evidence. Only 12% of the recommendations were in the A category. A staggering 45% earned a C.
There are many potential reasons for this, not the least of which is simply the lack of powerful data. The ideal medical study is a large, multicenter, randomized, double-blind, controlled trial funded by an organization with no vested interest in the outcome. The closer a study comes to this ideal, the stronger the evidence is to support its findings. However, many studies fall short of this ideal on numerous fronts. They involve a small or restricted subgroup of patients. They’re performed at only one medical center. They’re funded by the company that makes the medication or device being studied. Any of these shortcomings call the results of the study into question and weakens the strength of the evidence. Can these findings be applied to a larger or less restricted population? Can the results be reproduced at a different hospital? Are the researchers biased towards finding a positive outcome for the company that funds their research?
So should you ignore the majority of what your doctor says for lack of strong evidence? Not necessarily. Most doctors are simply working with the best information they have, even if the data supporting it is weak. What studies like this highlight is the need for better research to ensure that our recommendations are based on sound scientific evidence.
References
P. Tricoci, J. M. Allen, J. M. Kramer, R. M. Califf, S. C. Smith (2009). Scientific Evidence Underlying the ACC/AHA Clinical Practice Guidelines JAMA: The Journal of the American Medical Association, 301 (8), 831-841 DOI: 10.1001/jama.2009.205
3 Comments/Trackbacks
Be sure to read Dr. Grace Jackson’s “Open Letter to the Federal Coordinating Council for Comparative Effectiveness Research” posted at the Institute for Nearly Genuine Research web site:
http://www.bonkersinstitute.org/jacksonletter.html
Trackbacks
- Mar 13, 2009 | Why I love the ResearchBlogs twitter feed « info-fetishist
Leave a Reply
Sunday, March 21, 2010
- Religion - A "Natural" Phenomenon?
- Psychotropics and Youth, Part 1 - The Five Myths
- How Culture Shapes Our Mind and Brain
- Sex, Violence and The Male Warrior Hypothesis
- The Secret to Good Health – Listen to the Data
- If Herbal Medicine is Medicine, Shouldn't it be Treated as Such?
- Neurology, Neurosurgery, and Neuroscience Conferences for 2010
- Too Much Information?
- "I Feel Your Pain" - The Neural Basis of Empathy
- Income Inequality and Health Outcomes
- The Evolution of Depression
- Journal Retracts Autism Research
- Speaking in Tongues - A Neural Snapshot
- Post-Partum Psychosis - Rare but Real
- Is Your Doctor Happy or Burnt-Out?
- Ginkgo Biloba Ineffective... Again
- Worried Well on the Web
- Psychotropics and Youth, Part 2 - The Solutions
- Why Some Human Brains Become Leaders, While Others Followers?
- Postoperative Cognitive Dysfunction
- Let the Matches Begin!
- My Nephew and his Brain, Part 4 – Their Life Today
- My Nephew and his Brain, Part 3 – Try to Work Out their Troubles
- My Nephew and his Brain, Part 2 – Revealed to be Complicated
- My Nephew and his Brain, Part 1 – Introduction
- Deep Brain Stimulation – A New Frontier in Psychiatry
- Psychotropics and Youth, Part 3 – Equip Teachers with Prescription Pads?
- Why Some Human Brains Become Leaders, While Others Followers?
- Brain Blogger Finalist for Two 2010 Research Blogging Awards in Neuroscience and Psychology
- Tall Tales of Diabetic Amputations
- Psychotropics and Youth, Part 2 – The Solutions
- Brain Blogging, Forty-Ninth Edition
- How Your Brain Groups Words
- The Child Brain and the Playing Teacher
- You Have a Right to Choose if we Agree
- Measuring Quality in Primary Care
- Matchmaker, Matchmaker Make Me A Match – The NRMP Main Residency Match
- Psychotropics and Youth, Part 1 – The Five Myths
- When It Comes to Aging, Size Matters
- “I Feel Your Pain” – The Neural Basis of Empathy
- yea ur right lol lughter the best medicine i cnt do without it in a day!!!!!!!!!...
- Very touching story. My heart goes out to your family. Seizures are tough. And ...
- Thank you for sharing your nephew's story. So hard on those who love him, but I...
- Congratulations to all who've matched! Although the results of NRMP Main Residen...
- It's been almost 25 years since my son suffered a TBI in an accident. He was onl...
- I tend to agree with the teachers.But a teacher can only keep a record about the...
- Very interesting article, the 5th paragraph gets a little biased...but I still e...
- Dear Dan,There is certainly much clinical interest in this field. ClinicalTr...
- I recently commented on a sciencedaily.com article reporting success with TRD an...
- I have family members who are teachers. After sharing this article with them, th...
- It is great that people are challenging the use of this medication. As, a societ...
- I agree with the stand of the teachers and their children's that more than half ...
- I think that there’s also a social aspect to it. If you grow up in an area where...
- I have had epilepsy since I was 9 and am now 42. I have tried about every med. o...
- In this text is a serious error. Brain areas are found that contain religious ex...
- It's amazing how the brain works....
- Organ transplant for unavoidable patients have been around for quite some time a...
- Diet plays a major role in having diabetes. In today's world, people are finding...
- Interesting... I think that there's also a social aspect to it. If you grow up i...
- I think the article is actually describing a normal human being. Leadership tra...
Sponsored Links
Brain Fitness DVD, Home Care, Alcohol Rehab, Emergency Lighting, Online Criminal Justice Degrees, Tattoo, Diet and Health Supplements, Best vitamins supplements, Health Insurance, Electronic Accessories , Retractable Banner Stands , Biomedical Research , Breast Cancer Stages , Buy Nutropin , Cystic Fibrosis Lung Treatment , Pancreatic Cancer Treatment , Dallas health insurance , Hand and Finger , Mail Order Pharmacy , Lung Cancer Treatment , auto accident attorneys Allen , Is All Chest Pain angina? , Edgepark Medical , Mattress , Hydroxycut, Astrology compatibility.
Neuroscience & Neurology
March 06, 2010 | 6 Comments | By Simi Agarwal, DDS
Why Some Human Brains Become Leaders, While Others Followers?
More In Neuroscience & Neurology
- How Your Brain Groups Words
- The Child Brain and the Playing Teacher
- “I Feel Your Pain” – The Neural Basis of Empathy
- Speaking in Tongues – A Neural Snapshot
- Neuro Case 1 – Using Transcranial Doppler for Basilar Artery Occlusion
Neuroscience & Neurology
Opinion
February 01, 2010 | 1 Comment | By Jennifer Gibson, PharmD
Crossing the Line from Physician to Journalist
More In Opinion
- Sex, Violence and The Male Warrior Hypothesis
- Bruxism and the Brain
- Religion – A “Natural” Phenomenon?
- Natural Good, Chemical Bad – Right?
- Time for a Change – Gender Reassignment
Opinion
Psychiatry & Psychology
March 12, 2010 | 3 Comments | By Shaheen E Lakhan, MS, MEd, PhD, MD
Deep Brain Stimulation – A New Frontier in Psychiatry
More In Psychiatry & Psychology
- Psychotropics and Youth, Part 2 – The Solutions
- Psychotropics and Youth, Part 1 – The Five Myths
- Journal Retracts Autism Research
- White Bears – The Paradox of Mental Suppression
- Sugar and Spice and Everything Nice?


Evidence based medicine is inherently conservative and limited by the prejudices of researchers.
To get good quality evidence for the kinds of recommendations needed for behavioural modification would be incredibly complex and expensive. Worth doing of course, but clinically do we have the 30 years needed before recommendations are needed?