Evaluating Treatment Products, a Doctors' Perspective
Melissa Conrad Stöppler, MD
Melissa Conrad Stöppler, MD
Melissa Conrad Stöppler, MD, is a U.S. board-certified Anatomic Pathologist with subspecialty training in the fields of Experimental and Molecular Pathology. Dr. Stöppler's educational background includes a BA with Highest Distinction from the University of Virginia and an MD from the University of North Carolina. She completed residency training in Anatomic Pathology at Georgetown University followed by subspecialty fellowship training in molecular diagnostics and experimental pathology.
Why do doctors recommend some health products or measures but not others?
Many of us are interested in taking steps to prevent diseases, stay healthy, and to preserve and improve our quality of life. But deciding what diets and nutritional products are best, and what medications to take is not easy. There are a bewildering number of nutritional products and medications that purportedly can prevent diseases and keep us healthy. While some of these products have proven safety and effectiveness, many have not been subjected to any scientific evaluation, and some are downright harmful. Increasingly, doctors are being asked to advise patients on how to prevent diseases. However, the medications and measures doctors recommend can be quite different from those recommended by nutritionists, chiropractors, complementary or alternative health providers, etc. What is the reason for these differences? Why do doctors recommend some products but not others? How do doctors determine whether a product is good or bad? How good are doctors' recommendations? What are the doctors' weaknesses and limitations?
The process (steps) doctors commonly adopt in evaluating any disease prevention medication or product is imperfect. And the resultant doctors' recommendations are not always right (most of the recommendations in fact change over time as more scientific evidence becomes available). But the process itself is "honest"; it is there to minimize harm while trying to do some good.
How do doctors evaluate effectiveness and safety?
These are the questions doctors ask when evaluating a new health product, medication, treatment, or prevention measure:
What are doctors' limitations in evaluating products?
Ideally all products used in treating and preventing diseases should undergo prospective, randomized, double blind placebo-controlled trials involving a large number of study subjects. But these studies are costly, and not all proposed studies can be funded. Furthermore, disease prevention studies generally take many years to complete. Therefore, doctors often have to make recommendations based on incomplete knowledge and scientific data. When conclusive proof of effectiveness and safety are not available, doctors sometimes rely on less reliable information from observational studies and even anecdotes.
Even expertly designed and carefully conducted clinical trials may not detect all the adverse effects of a drug or product. Some adverse side effects of a new product may not show up until many (often millions) of users have used it for a long time (months to years).
What is an anecdote in medicine?
In medicine, an anecdote is a treatment response observed on a single person or a number of people. The observations are made outside of a formally conducted, double-blind, randomized, placebo-controlled trial.
What are the shortcomings of anecdotes in medicine?
Anecdotal benefits cannot be distinguished from placebo effects. More often than not, anecdotal benefits cannot be confirmed by double-blind randomized placebo-controlled trials. Therefore, doctors generally are hesitant to recommend treatments solely based on anecdotal evidence. Moreover, potentially serious adverse side effects may only be uncovered by a carefully conducted placebo controlled clinical trial.
However, anecdotal reports of benefits, especially if they seem plausible in a scientific sense, may induce medical researchers to conduct clinical trials to determine the effectiveness and safety of a given product or treatment.
What is a placebo?
A placebo is a biologically inert substance that does not have any effect on the disease under investigation Placebos are given to persons participating in double-blind controlled clinical trials. For example, a placebo can be sugar powder or salt placed in capsules that are made to look exactly like the medication being tested, so that neither the person giving the drug, or the person taking the drug know whether a placebo or the test drug is being administered.
What is a placebo effect?
A placebo effect is a beneficial response of a disease and its symptoms to a placebo. The placebo effect can be found in almost every clinical trial. For example, in all the randomized double-blind, placebo-controlled trials involving ulcer medications, a consistent number of placebo-treated patients will experience ulcer healing and symptom improvement. Thus the only way to prove that a test medication is effective is by demonstrating its superiority over a placebo.
What is an observational study?
An observational study is a retrospective analysis comparing the health status of one group of subjects (for example, women who took folic acid supplements) to another group (for example, women who did not take folic acid supplements). Observational studies can only provide circumstantial evidence. Conclusive proof of treatment benefit has to come from prospective, randomized, and placebo-controlled trials.
How do doctors recommend treatments for disease prevention?
The decision-making process in disease prevention is necessarily imperfect; it is a combination of judgment, experience, and science. It is a balancing act between being cautious (by doing no harm) versus being proactive.
Preventing disease is different from treating diseases. In treating diseases, doctors and patients are often willing to accept a finite degree of risk of side effects in order to achieve a cure or improvement in symptoms. In preventing diseases, doctors are extremely risk adverse. Remember, the first priority in doctoring is to "do no harm". Thus when prescribing an agent for prolonged periods of time to prevent a disease that may or may not occur, the doctor would not want that agent to cause adverse side effects in a healthy person.
Do not always insist on conclusive proof
Sometimes doctors are willing to recommend a long-term preventive treatment in the absence of any conclusive proof of benefit, provided that we know the treatment is safe. This is especially true if the treatment also has a sound scientific basis and has been found beneficial by observational studies.
Learn from history
Consider blood cholesterol as another example. Thirty years ago, observational studies suggested that high blood cholesterol (like homocysteine) could cause coronary artery disease and heart attacks. Even though there were no double-blind, placebo-controlled trials available, doctors in those days suspected (correctly) that lowering blood cholesterol could reduce heart attacks. They were recommending low fat diet and exercise to lower blood cholesterol, and medications such as statins only when diet and exercise failed. They also did one very important thing-they started numerous, large scale randomized, placebo-controlled trials to determine if lowering cholesterol actually prevents heart attacks.
Today the prospective trials they started have been completed. These trials have conclusively shown that lowering cholesterol (especially the bad LDL cholesterol) reduces heart attack risks and prolongs life. These trials further showed that the benefits of lowering cholesterol outweigh the risks of side effects of the statin medications. Therefore doctors today are much more aggressive than doctors of yesteryears. Doctors are much more willing to use medications such as statins to lower cholesterol, and the "normal cholesterol level" has been rapidly reduced.
Medically reviewed by Avrom Simon, MD
Board Certified Preventative Medicine with Subspecialty in Occupational Medicine
Medically Reviewed by a Doctor on 10/16/2015