Skip to main content

Medical Statistics - The Art of Deception

Image
By
“There are three kinds of lies: lies, damned lies and statistics.”   There is much truth in this quotation of uncertain provenance.  We see this phenomenon regularly in the medical profession.  We see it in medical journals when statistics are presented in a manner that exaggerates the benefit of a treatment or a diagnostic test.  Massaging numbers is raised to an art form by the pharmaceutical companies who will engage in numerical gymnastics to shine a favorable light on their product.   It’s massaging, not outright mendacity.   The promotional material that pharmaceutical representatives present to doctors is riddled with soft deception.

A favorite from their bag of tricks is to rely upon relative value rather than absolute value.  Here’s how this works in this hypothetical example.

A drug named Profitsoar is tested to determine if it can reduce the risk of a heart attack.  Two thousand patients are participating in the study.  Each patients receives either Profitsoar or a placebo at  random.  Here are the results.

                                1000 Profitsoar Patients      1000 Placebo Patients

# Heart Attacks                     4                                           6

As is evident,  only 2 patients were spared a heart attack by the drug.   This is a trivial benefit as only 6 of 1000 patients in the placebo group suffered a heart attack.  This means that taking the drug provides no meaningful protection for an individual patient.  However, the drug companies will highlight the results in relative terms to package the results differently.   They will claim that Profitsoar reduced heart attack rates by 33%, which would lure many patients, and a few doctors to drink the Kool Aid. 

Check out this promotional piece below which was recently mailed to me about Uceris, a steroid that I use at times for colitis patients.




See how low the actual remission rates are for the drug.  Only 18% of patients responded to the drug, a small minority, and the placebo rate was 6%.  No worries.   Just brag that Uceris is 3 times more effective than placbo!

Is this a lie?  Not exactly.  Is it the truth?  Technically yes.  

Most physicians are tuned into this deception.  I know from my own patients that the public is easily seduced by this slick presentation of data.  The next time you see a TV ad for a medication, which will be about 5 minutes after you turn on the TV, see if you can spot the illusion.  You'll have to watch quickly and repeatedly.  Like all skilled magicians, these guys are expert at distraction and sleight of hand.  Hint: Whenever you hear the word 'percent', as in "35% of patients responded...", you should pay particular attention.  

When we used to see a woman sawed in half on stage, we knew it was a trick even if we couldn't explain how it was done.  I've taken you behind the curtain here.  Let's make it a fair fight between us and illusionists.
Labels:

Comments

Post a Comment

Popular posts from this blog

Becoming a Part-Time Physician

By
Next month my schedule will change.  I will henceforth be off on Fridays with my work week truncated to Monday through Thursday.   I am excited to be enjoying a long weekend every weekend.  And while the schedule change is relatively minor, this event does feel like an important career moment for me.  It is the first step on a journey that will ultimately lead beyond my professional career.  It is this recognition that makes this modest schedule modification more significant than one would think it deserves.  As some readers know,   my current employed position has been a dream job for me.   Prior to this, I was in a small private practice, which I loved, but was much more challenging professionally and personally.   My partner and I ran the business.   Working nights, weekends and holidays were routine for decades.   On an on-call night, if I slept  through until morning, I felt as if I had won the lottery.   And w...
15 comments
Read more

When Should Doctors Retire?

By
I am asked with some regularity whether I am aiming to retire in the near term.  Years ago, I never received such inquiries.  Why now?   Might it be because my coiffure and goatee – although finely-manicured – has long entered the gray area?  Could it be because many other even younger physicians have given up their stethoscopes for lives of leisure? (Hopefully, my inquiring patients are not suspecting me of professional performance lapses!) Interestingly, a nurse in my office recently approached me and asked me sotto voce that she heard I was retiring.    “Interesting,” I remarked.   Since I was unaware of this retirement news, I asked her when would be my last day at work.   I have no idea where this erroneous rumor originated from.   I requested that my nurse-friend contact her flawed intel source and set him or her straight.   Retirement might seem tempting to me as I have so many other interests.   Indeed, reading and ...
69 comments
Read more

Will Smarter Lawyers End Frivolous Lawsuits?

By
How do you know if a lawyer is any good?  Of course, they've all passed the bar, but now their profession is lowering it.  While most of us strive for excellence, and raise our children to value this virtue, prominent legal educators are establishing a new quality intitiative for their profession.  Who says that lawyers can't reform themselves?  Perhaps, we physicians can follow their bold example and raise the credentials of our pre-medical students.  I’ll present the facts. You be the judge. I have written a dozen posts on tort reform on this blog, which always generate spirited and adversarial retorts from attorneys and their supporters. They accuse me and other tort reform advocates of carrying water for insurance companies. They repeatedly point out that I know nothing about the legal system and are unqualified to opine on its flaws. They deride me when I argue that effective tort reform would reduce the practice of defensive medicine, despite the re...
83 comments
Read more