A New Venue From a Surprising Source to Discuss "External Threats to Good Decision-Making"

A new blog, entitled the Medical Professionalism Blog, signed on last week with a post emphasizing some themes that should be familiar to Health Care Renewal readers:

There is an increasing focus on the sustainability of the U.S. health care system based on current cost trends. Predictions are for the health care system to consume 19% of the GDP by 2019. How did we get here?

Some point to the overuse and misuse of health care services, inefficiencies and lack of care coordination. Others blame the lack of clinical evidence, primary care workforce and the external threats to good decision-making, such as a toxic payment system and the influence of pharmaceutical and device companies.

While there are many different ideas about what got us here and what should be done, there is wide consensus that physicians and other stakeholders must begin to develop new more effective and efficient systems of care and make wise choices that preserve our health care system�s sustainability.

We have been underlining concerns that health care professionals' values, the mission of academic medicine, and truly evidence-based practice are under a series of threats.  (For a recent, but already out of date list of threats to the academic medical mission, see this post.)  It is nice to see that that others are now alarmed by these threats and looking for ways to counter them.

So, our new colleague in the blog-sphere raised the following questions:

* What is the appropriate role of physicians and other stakeholders in preserving these resources?

* What behaviors foster and which threaten wise choices in medical decision-making?

* How can waste be removed from the system without sacrificing quality or safety?

* What system changes are needed to achieve better health care outcomes, reduce costs and improve the patient experience?

* What effect do the nature and performance of partnerships � clinician-patient, clinician-organization and clinician-society � have on professional behaviors and resource use?

Again, the importance of threats was emphasized, and concerns about conflicts of interest affecting physicians' professionals were implied. This blog will apparently have a unique focus which I hope will complement our approach on Health Care Renewal.

What we�re hearing from folks is the need to 'show me how' to answer these questions. Through analysis of promising practices, we hope to provide examples of what works � and what doesn�t.

So we welcome The Medical Professionalism Blog to our blog-roll and look forward to some interesting content.

For a final twist, I need to note that this blog's authorship appears to be unique. The Health Care Renewal bloggers, and most of our blogging friends mostly seem to include, in no particular order: academic physicians, often tenured or retired (and thus able to speak more freely), other generally senior or retired academics, independent or retired practicing physicians, journalists, independent consultants, some whistle-blowers and others who once worked in the health care establishment, and some very anonymous bloggers in the belly of the beast.  Thus, we are generally an very independent and iconoclastic, if a somewhat rag-tag lot.

However, the chief blogger on The Medical Professionalism Blog is Daniel Wolfson, who is Executive Vice President and Chief Operating Officer of the ABIM (American Board of Internal Medicine) Foundation,  and the blog itself is a project of the foundation.  Thus, this is a blog from the heart of the medical establishment, the powers that be, etc, etc.  No other blog on our blog-roll comes from a current leader of such an organization.  (One is written by someone who was a CEO of a major academic medical center/ hospital system, but who lost his job under controversial circumstances.)

It is truly refreshing to have a voice coming from the inside, so to speak, proclaim:

The Medical Professionalism Blog was created by the ABIM Foundation to stimulate conversation and highlight best practices related to professionalism....

Furthermore,

Open for considerable debate is my belief that physicians� engagement in quality, safety and the management of health care resources ultimately improves the care they give their patients and adds to their joy of work. I look forward to hearing your point of view, even if it�s a dissenting one.

Lately, we have not heard a lot of calls for vigorous debate and dissent from the medical establishment, the powers that be, etc, etc. In fact, the anechoic effect is how we describe how such debate and dissent has been suppressed.

So it appears the The Medical Professionalism Blog may be a real breath of fresh air. We hope it can truly inspire some discussion, especially open discussion of issues which used to be not what one was supposed to talk about in polite health care company.  This could help advance the transparency which we have long been advocating.

Read More

What the November, 2009, Breast Cancer Screening Argument Obscured

In November, 2009, a rancorous argument about screening mammography for women aged 40-49 was touched off by the publication of updated guidelines(1), supported by a systematic literature review(2) by the US Preventive Services Task Force (USPSTF).  The guidelines suggested that yearly mammographic screening for women in that age group should not be automatic, but a decision made for individual patients after discussion between the patients and their doctors.  This was based on a critical review of the best available data which suggested that the benefits of screening acrue to only a few patients.  1904 women would have to start screening and continue for multiple rounds to prevent one cancer death over 11-20 years of follow-up.  These benefits had to be balanced against a number of potential risks, including the risks of treatment of cancers that might never behave malignantly, and the at least theoretical risk of generating new cancers through radiation exposure from mammography. 

These seemingly reasonable recommendations generated heated responses.  The debate, to be charitable, seemed to be at its core about how one should weigh benefits and harms in making individual and health policy decisions.  Since different people value different outcomes differently, I was not sure at the time how to make a meaningful contribution to this debate, or whether the debate had to do with the issues we usually discuss on Health Care Renewal.

I should note that the USPSTF guidelines never said "do not screen" women under age 50, or that the government should not pay for such screening.  They did say "the decision to start regular, biennial screening mammography before the age of 50 years should be an individual one and take pateint context into account, including the patient's values regarding specific benefits and harms."  It is hard to see how anyone could argue with that as an expression empowering patients' choices and values.  (For further discussion about how the recommendations were actually modest and reasonable, see Partridge and Winer.)(3)

Now that the dust has settled, it may be useful to reflect further on this.  Doing so suggests that the rancorous US debate mainly obscured rather than illuminated the major issues regarding mammography screening, particularly about our lack of clear evidence from clinical research needed to make the best individual and  policy decisions about mammography. 

It seems to me that the main questions one must answer to make an individual or policy decision about screening mammography are:

Does it improve longevity?

This is not the same as asking whether mammography reduces mortality from breast cancer.  It is theoretically possible that while decreasing mortality due to breast cancer, screening and its downstream consequences increases mortality from other causes.  At least in theory, screening may detect small tumors that would never grow or metastasize.  Treating such tumors could sometimes lead to premature death due to complications of surgery, radiation, or chemotherapy.  Furthermore, screening also involves periodically exposing large numbers of women to radiation, which may sometimes cause new tumors.  So reducing breast cancer mortality does not automatically mean that overall longevity would be improved.

There have been eight major trials of breast cancer screening which included women younger than 50. (See reference 2.)  None demonstrated a statistically significant increase in overall survival (that is, an increase unlikely to have been due to chance alone) due to screening.

Does it reduce suffering, improve functioning or generally improve quality of life?

To my knowledge, no major trial attempted to answer this question.  No such data is mentioned in the USPSTF systematic review.

Do the above benefits outweigh all its potential harms and risks?

So we cannot answer this question, because the benefits that might be most meaningful to patients (overall survival, symptom reduction, functional improvement, overall quality of life improvement) have not been clearly measured.

A Lack of Relevant Evidence

So the USPSTF guidelines, like other relevant guidelines, were based on the evidence that is available.  Since the evidence did not directly answer the most important questions, the guideline writers were left doing the best they could with evidence that only indirectly addressed the main issues.  No wonder they ended up unable to make a clear recommendation, and leaving the decisions to individual discussions, and individual discussions that would necessarily hinge on guesses about the unknown. 

One would think that a big point of discussion about breast cancer screening would be why after eight trials enrolling a total of about 350,000 patients reported over 20 years we still cannot answer the big clinical questions.  A related point for discussion in the US is why only one, and the earliest trial was conducted here.  If we here in the US think breast cancer screening is such a major concern (and we should think so), why have we been unable to mount a single important trial of it since the HIP trial conducted more than 30 years ago?

Instead, the rancorous debate in the US included...

Anecdotes, Some Irrelevant

The press found a number of women who said they would not be alive were it not for screening mammography before age 50.  With all due respect, one cannot tell whether an individual whose tumor was found on screening mammography would still have been diagnosed early enough for succesful treatment in the absence of screening mammography.  (And also with all due respect, we have no idea whether there also are cases of women who died as a result of treatments of tumors that never would have progressed, or cases of women who died of tumors caused by radiation from multiple mammograms.)  Reasoning from single cases when people, diseases, and treatment results vary so much is likely to mislead. 

It is somewhat ironic that some of the cases cited were of women who had breast cancer diagnosed before age 40, even though the debate was supposedly about screening from ages 40-49.  For example, in an inflammatory article that suggested that some "oncologists" might want the USPSTF sent to the prison at Guantanamo Bay, Washington Post editorialist Dana Milbank cited cancer activist Nancy Brinker, who mentioned her sister "whose breast cancer was found with a mammogram at age 37," (and apparently who tragically is no longer alive).(4) 

Going Well Beyond the Evidence

As noted above, no trial has shown that screening mammography for women under 50 increases overall longevity.  We all hope it does, but so far, there is no clear evidence that it does. 

Yet multiple media reports included assertions that screening mammography saves lives.   For example, the breast cancer activist mentioned above said, "mammography saves lives," apparently including mammography under age 50.(4)  An op-ed column by Dr Alan Kaye, chairman of radiology at Bridgeport Hospital, asserted "large, multinational research studies have shown that mammography saves lives in all age groups covered by the current guidelines."(5)  I would challenge him to show me a single such study that found a statistically significant increase in overall survival for patients under 50.  A Texas radiologist stated, "I diagnosed a 40-year old woman with breast cancer last week.  If she had waited 10 years, with pre-menopause breast cancer she would have been dead."(6)  Unfortunately, since she was just diagnosed, how can he be certain that she will survive any given amount of time?  How could he know that the cancer might not have become manifest, absent that single mammogram, later while still treatable? 

I do not want to be too hard on patients who do not appreciate that the outcomes of testing and treatment for breast cancer are not certain.  However, one would hope that physicians would be able to deal with this uncertainty.

Conflicted Opinions

Some of the more strident discourse came from those who may have had financial vested interests in promoting screening mammography.  Fugh-Berman and Bell pointed out numerous "fact-free emotionally charged statements" made by people who appeared to "reading from the same script-book."(7)  They identified that many of the loudest critics of the USPSTF guidelines were affiliated with not-for-profit organizations with impressive names, but also with substantial financial support from corporations that make products used in mammography.  Also, some had personal financial relationships with such corporations. 

An op-ed article by former US Food and Drug Agency (FDA) commissioner Dr Andrew von Eschenbach and Ms Nancy Desmond distorted the USPSTF guidelines to mean "most women should delay screening until they are 50," and claimed that was based on cost concerns, not clinical evidence.(8).  Desmond is the CEO of and von Eschenbach is now a senior advisor to the Center for Health Transformation.  The Center's members include numerous pharmaceutical and device manufacturing corporations, including several that make mammography equipment (e.g., GE Healthcare and Siemens).

Summary

Cancer, especially breast cancer, has major emotional connotations, and can be a difficult issue to deal with from many people.  The conflicting emotions cancer brings out in many patients may understandably affect their physicians, as well as friends and family.  Nonetheless, physicians, other health policy professionals, and health policy experts can serve patients better if they do not allow the patients' understandable affective responses cloud their understanding of the clinical and scientific issues. 

Yet the late 2009 debate in the US about screening mammography included many responses in which emotion seemed to overwhelm reason.  It may also be that some such responses came from people who had vested interests, or whose employers had vested interests that supported the emotional, rather than the reasoned approach.  Meanwhile, no one seemed to acknowledge that a big reason we are still debating this topic is that we have not made the effort or expended the resources to do good trials of sufficient size to answer the questions that need answering.  Of course, such trials might provide answers that would upset some people, or threaten others' incomes.  (As one news article pointed out, mammography is now a $5 billion a year industry in the US.)(6)

So my end of annus horribilis 2009 message on Health Care Renewal is to better serve our patients, from 2010 onward we health care professionals need  to try harder to put evidence and logic ahead of our own emotions, and certainly ahead of our financial self-interest.  

Note that numerous bloggers have taken on this topic, so see posts on Respectful Insolence, GoozNews,  Health Care Organizational Ethics, and the Evidence in Medicine blog.
References

1. US Preventive Services Task Force. Screening for breast cancer: U.S. Preventive Services Task Force recommendation statement.  Ann Intern Med 2009; 151: 716-726. [link here]
2. Nelson HD, Tyne K, Naik A et al. Screening for breast cancer: an update for the U.S. Preventive Services Task Force.   Ann Intern Med 2009; 151: 727-737.  [link here]
3. Partridge AH, Winer EP. On mammography - more agreement than disagreement.  N Engl J Med 2009; 361: 2499-2501. [link here]
4. Milbank D. Feeling farther from the finish.  Washington Post, Nov 24, 2009.  [link here] 
5. Kaye A. An alarming retreat on early detection.  Hartford Courant, Nov 25, 2009 [link here]
6.  Jacobson SJ. Dallas-area clinics ignore proposed rules, still push for mammograms. Dallas News, Nov 27, 2009.  [link here]
7. Fugh-Berman A, Bell A. Mammography and the corporate breast.  Bioethics Forum, Nov 24, 2009.  [link here]
8. von Eschenbach A, Desmond N. Government panels can't put price on human life. Associated Press, Nov 24, 2009.  [link here]

Read More

The Editorial that Wasn't: Evidence for Systematic Research Manipulation Undetectable by Critical Review

Woe to those of us who have been advocates for evidence-based medicine.  A short description of the evidence-based medicine is medicine whose practice is informed by critical, rigorous review of the best available evidence from clinical research as revealed by systematic search of the published research literature, as well as by the clinician's understanding of biology and the medical and biopsychosocial context, and by the patient's own values.

Evidence-based medicine is based on some key assumptions.  One is that a systematic review will reveal all the results of research studies that are relevant to the issue at hand.  A second is that while the research studies may be flawed and imperfect, they are reported honestly.

Unfortunately, as we have repeatedly discussed, there is more and more evidence that a systematic review will not reveal all relevant results, because research studies may be suppressed, perhaps often, when their results are unfavorable to vested interests.  (Look here for further discussion.)  There is also considerable anecdotal evidence that the design, implementation, and analysis of research studies may be manipulated to make the results more likely to favor vested interests.  (Look here for further discussion.)

An article by Vedula et al just published in the renowned New England Journal of Medicine suggests that such manipulation might be systemic, and that the reporting of manipulated studies may not clearly show what manipulation was done. (1)

To summarize, the authors got access through legal proceedings to internal study protocols and research reports from clinical trials sponsored by Parke-Davis (later merged into Pfizer Inc) of gabapentin (Neurontin) for a variety of clinical problems other than seizures.  Gabapentin was originally marketed as an anti-seizure drug, but Pfizer later "admitted guilt for off-label marketing."  (We discussed the stealth marketing campaign for Neurontin here.)  Vedula et al compared the primary outcome variables specified in the original research protocols, internal research reports, and any publications of the trials' results.  They identified 21 trials, 13 of which were published.  For 12 of the 13, the authors had access to the internal protocol, report, or both.  The main results were:

For 8 of the 12 published trials, there was a disagreement between the definition of the primary outcome in the protocol and that in the published report.... Sources of disagreement included the introduction of an entirely new primary outcome in the published report (in the case of 6 trials); failure to distinguish between primary and secondary outcomes in the published report, even though the protocol did distinguish between them (2 trials); relegation of a primary outcome in the protocol to a secondary outcome in the published report (2 trials); and failure to include in the published report one or more primary outcomes specified in the protocol (5 trials).

Furthermore, it appeared that failure of published articles to clearly and fully report results in terms of the original, pre-specified primary outcome variables occurred when these comparisons were not favorable to gabapentin. As the authors summarized:

Thus, trials with findings that were not statistically significant (P=0.05) for the protocol-defined primary outcome, according to the internal documents, either were not published in full or were published with a changed primary outcome.

As shown in Figure 3, all the changes that took place between what was specified in the protocol, what was known before publication (as presented in the internal company research reports), and what was reported to the public led to a more favorable presentation in the medical literature of gabapentin's efficacy for unapproved indications.

They concluded:

We are concerned that the reporting practices observed in our analysis do not meet the ethical standards for clinical research or maintain the integrity of scientific knowledge. Fair and honest treatment of patients enrolled in clinical trials of any kind requires full, open, and unbiased reporting. Journal publication, a formalized platform for scientific discourse and dissemination of knowledge, should not be used as a marketing tool for off-label drug use.

Reporting biases such as those we describe here increase the likelihood that interventions will appear to be effective when they are not. Such biases can lead to the omission of negative findings in systematic reviews of intervention effectiveness and in evidence-based guidelines. For example, the 2005 Cochrane systematic review regarding the effectiveness of gabapentin for acute and chronic pain concluded that it is effective on the basis of published findings and should now be updated with the inclusion of unpublished information made available through litigation.

I believe that the article by Vedula et al is particularly important because it shows what appears to be systematic manipulation of the analysis and reporting of multiple clinical trials of the same drug (but for different indications) that had the effect of making the drug appear efficacious when it likely was not. Furthermore, the manipulation was concealed. The published research articles did not completely describe what the intended primary efficacy outcome variables were, did not provide results in terms of these variables, and instead provided results only in terms of variables that were chosen post-hoc as new primary outcome variables.

To address that latter point, I independently reviewed three of the research publications cited by Vedula et al.(2,3,4) All three were noted to have reported significant results favoring gabapentin in terms of a primary efficacy outcome variable that was not identified as such in the corresponding studies' original research protocols or reports (see the supplementary data provided with the New England Journal article.) Per my review, none of the three published articles offered any hint that what they reported as primary outcome variables were not the variables originally chosen in that capacity, nor did they identify what those original primary outcome variables were, or how comparisons made using them turned out.

The implications of the article by Vedula et al are very important. Hence, I was surprised that the article appeared without an accompanying editorial to discuss these implications, and that its publication did not generate much media interest.

So that gives me an opportunity to comment further.

One could start with the implications for evidence-based medicine. As noted above, a short description of the evidence-based medicine is medicine whose practice is informed by critical, rigorous review of the best available evidence from clinical research as revealed by systematic search of the published research literature, as well as by the clinician's understanding of biology and the medical and biopsychosocial context, and by the patient's own values. Evidence-based medicine depends on critical, rigorous review, but the review process is generally done under the assumptions that research publications honestly describe what was done and what its results were. The review process was never designed to detect dishonest reporting or find information that was deliberately concealed. Manipulation of research (design, analysis, and implementation), concealment of that manipulation, and outright suppression of research threaten the foundations of evidence-based medicine. Yet the article by Vedula et al is part of a growing body of evidence that such manipulation, concealment and suppression are widespread, and done to serve vested interests, often commercial.

That is a huge problem for proponents of evidence-based medicine, but also for physicians who want their practices to be based on science, for patients who want their care to be based on science, and for all those in society who see the advancement of medical science as a way to improve peoples' lives.

As senior author Professor Kay Dickersin noted in an interview with Bloomberg "The trouble is, as a scientist, the publication has always been held up to me as the truth. It's the scientific record. What this study indicated is we can't believe that record."

Furthermore, to be a bit more concrete, most physicians, patients, and policy makers depend on what appears to be honest clinical research to make decisions about individual care and health policy. Deliberate and deceitful manipulation of clinical research to favor sponsors' products has likely lead to excessive use of and payments for drugs and devices that are less effective than advertised, if not useless or dangerous. Thus, it is likely that such manipulation is partially responsible for ever increasing health costs and poor health outcomes.

Finally, we need to start thinking about how we can detect and compensate for manipulation of clinical research in the past, and deter such manipulation in the future. One possible deterrent would be, as was noted by Vedula et al, detailed clinical trials registries that contain complete information about trial protocols.  For this to be effective, there need to be mechanisms to assure compliance, and penalties for non-compliance.  Moreover, since clinical research is now global, the registries must have global scope, and enforced assurance of compliance must also be global.

Registries might decrease future manipulation and suppression of research.   No one has suggested, as far as I know, a systematic way to detect and correct for previous manipulation. It would require a major, global investigative effort to uncover manipulation, and it would be a major scientific and policy endeavor to reveal most suppressed research and correct most manipulations.

However, before anything is done, patients, physicians and policy makers must acknowledge and understand the problem.  Yet it seems that even discussing these may be topics that are very uncomfortable for some of us. The longer we shrink from addressing them, however, the worse will be the results for patients, physicians, science and society.

References


1. Vedula SS, Bero L, Scherer RW, Dickersin K. Outcome reporting in industry-sponsored tirals of gabapentin for off-label use. N Engl J Med 2009; 361: 1963-1971. Link here.


2. Mathew NT, Rapoport A, Saper J et al. Efficacy of gabapentin in migraine prophylaxis. Headache 2001; 41: 119-128. Link here.


3. Vieta E, Goikolea JM, Martinea-Aran A et al. A double-blind, randomized, placebo-controlled, prophylaxis study of adjunctive gabapentin for bipolar disorder. J Clin Psychiatr 2006; 67: 473-477.  Link here.


4. Caraceni A, Zecca E, Bonezzi C et al. Gabapentin for neuropathic cancer pain: a randomized controlled trial from the gabapentin cancer pain study group. J Clin Oncol 2004; 22: 2909-2917. Link here.

Read More

Failing to Report Adverse Effects of Treatments

We have frequently advocated the evidence-based medicine (EBM) approach to improve the care of individual patients, and to improve health care quality at a reasonable cost for populations. Evidence-based medicine is not just medicine based on some sort of evidence. As Dr David Sackett, and colleagues wrote [Sackett DL, Rosenberg WM, Muir Gray JA, Haynes RB, Richardson WS. Evidence-based medicine; what it is and what it isn't. BMJ 1996; 312: 71-72. Link here. ]

Evidence based medicine is the conscientious, explicit, and judicious use of current best evidence in making decisions about the care of individual patients. The practice of evidence based medicine means integrating individual clinical expertise with the best available external clinical evidence from systematic research.

One can find other definitions of EBM, but nearly all emphasize that the approach is designed to appropriately apply results from the best clinical research, critically reviewed, to the individual patient, taking into account that patient's clinical characteristics and personal values.

When making decisions about treatments for individual patients, the EBM approach suggests using the best available evidence about possible benefits and harms of treatment, so that the treatment chosen is most likely to maximize benefits and minimize harms for the individual patient. The better the evidence about specific benefits and harms applicable to a particular patient, the greater will be the likelihood that a particular decision based on this evidence will result in the best possible outcomes for the patient.

A new study in the Archives of Internal Medicine focused on how articles report adverse effects found by clinical trials. [Pitrou I, Boutron I, Ahmad N et al. Reporting of safety results in published reports of randomized controlled trials. Arch Intern Med 2009; 169: 1756-1761. Link here.] The results were not encouraging.

The investigators assessed 133 articles reporting the results of randomized controlled trials published in 2006 in six English language journals with high impact factors, that is, the most prestigious journals, including the New England Journal of Medicine, Lancet, JAMA, British Medical Journal, and Annals of Internal Medicine. They excluded trials with less common designs, such as randomized cross-over trials. The majority of trials (54.9%) had private, or private mixed with public funding.

The major results were:
15/133 (11.3%) did not report anything about adverse events
36/133 (27.1%) did not report information about the severity of adverse events
63/133 (47.4%) did not report how many patients had to withdraw from the trial due to adverse events
43/133 (32.3%) had major limitations in how they reported adverse events, e.g., reporting only the most common events (even though most trials do not enroll enough patients to detect important but uncommon events).

The authors concluded, "the reporting of harm remains inadequate."

An accompanying editorial [Ioannidis JP. Adverse events in randomized controlled trials: neglected, distorted, and silenced. Arch Intern Med 2009; 169: 1737-1739. Link here] raised concerns about why the reporting of adverse events is so shoddy:

Perhaps conflicts of interest and marketing rather than science have shaped even the often accepted standard that randomized trials study primarily effectiveness, whereas information on harms from medical interventions can wait for case reports and nonrandomized studies. Nonrandomized data are very helpful, but they have limitations, and many harms will remain long undetected if we just wait for spontaneous reporting and other nonrandomized research to reveal them. In an environment where effectiveness benefits are small and shrinking, the randomized trials agenda may need to reprogram its whole mission, including its reporting, toward better understanding of harms.

Pitrou and colleagues have added to our knowledge about the drawbacks of the evidence about treatments that is publicly available to physicians and patients when making decisions about treatment. Even reports of studies with the best designs (randomized controlled trials) in the best journals seem to omit important information about the harms of the treatments they test.

It appears that the majority of the reports that Pitrou and colleagues studied received "private" funding, presumably meaning most were funded by drug, biotechnology, or device companies and were likely meant to evaluate the sponsoring companies' products. However, note that this article did not analyze the relationship of funding source to the completeness of information about adverse effects.

Nonetheless, on Health Care Renewal we have discussed many cases in which research has been manipulated in favor of the vested interests of research sponsors (funders), or in which research unfavorable to their interests has been suppressed. Therefore, it seems plausible that sponsors' influence over how clinical trials are designed, implemented, analyzed and reported may reduce information about the adverse effects of their products reported in journal articles. Trials may be designed not to gather information about adverse events. Analyses of some adverse events, or some aspects of these events may not be performed, or if performed, not reported. The evidence from clinical research available to make treatment decisions consequently may exaggerate the ratios of certain drugs' and devices' benefits to their harms.

Patients may thus receive treatments which are more likely to hurt than to help them, and populations of patients may be overtreated. Impressions that treatments are safer than they actually are may allow their manufacturers to overprice them, so health care costs may rise.

The article by Pitrou and colleagues adds to concerns that we physicians may too often really be practicing pseudo-evidence based medicine when we think we are practicing evidence-based medicine. We cannot judiciously balance benefits and harms of treatments to make the best decisions for patients when evidence about harms is hidden. Clearly, as Ioannidis wrote, we need to "reprogram." However, what we need to reprogram is our current dependence on drug and device manufacturers to pay for (and hence de facto run) evaluations of their own products. If health care reformers really want to improve quality while controlling costs, this is the sort of reform they need to start considering.

NB - See also the comments by Merrill Goozner in the GoozNews blog.

Read More