TORTINI

For your delectation and delight, desultory dicta on the law of delicts.

Bad Gatekeeping or Missed Opportunity – Allen v. Martin Surfacing

November 30th, 2012

Sometimes when federal courts permit dubious causation opinion testimony over Rule 702 objections, the culprit is bad lawyering by the opponent of the proffered testimony.  Allen v. Martin Surfacing, 263 F.R.D. 47 (D. Mass. 2009), may be an important example.

THE CLAIMS

Daniel Allen was the former football coach of the College of The Holy Cross, in Worcester, Massachusetts.  In spring of 2001, defendant Martin Surfacing refinished the gymnasium floor at the college.  Coach Allen was exposed to solvent fumes, including toluene fumes, during defendant’s work, as well as for a couple of months afterwards.   While exposed, Allen experienced “dizziness, headaches, and disorientation.” 263 F.R.D. at 51.  After the gym floor resurfacing was completed, Allen experienced other symptoms, such as fatigue, muscle weakness, and fasciculations in his lower limbs.  In January 2002, at the age of 45, Allen was diagnosed with amyotrophic lateral sclerosis (ALS).  Id. Allen’s condition progressed, and he died three years later, in May 2004.  Id. at 52.

Allen’s family sued for wrongful death.  The parties’ apparently agreed on the following:

  • ALS occurs as a sporadic ALS, as well as “familial ALS,”
  • the cause of sporadic ALS is unknown,
  • Allen developed and died of sporadic ALS,
  • no air sampling established overexposure to any chemical,
  • there were no reliable exposure models to quantify Allen’s exposures,
  • there are no known causes of sporadic ALS, and
  • toluene did not cause Allen’s ALS

Remarkably, defendant lost the Rule 702 challenge to plaintiffs’ expert witnesses’ opinion testimony.  It is easy to suspect that the district judge was sleep at the gate, and that his gatekeeping was deficient.  A close read of the opinion supports the view that this was not Rule 702’s finest moment, but much more was going on to get to admissibility.

First, the plaintiffs’ counsel cleverly avoided running into a wall by avoiding a claim that toluene caused Allen’s ALS. Instead, plaintiffs’ claimed that toluene accelerated the onset of the disease.  This claim was equally dubious, but it allowed the expert witnesses to avoid a mountain of medical opinion, authoritative and well-supportive, that there is no known cause of sporadic ALS.

Second, the plaintiffs’ counsel took the initiative by filing an affirmative motion to admit the testimony of their expert witnesses.  Rather than ceding the initiative to the defendant, the plaintiffs seized the initiative and had the first and last word on admissibility.  As a result, plaintiffs were able to present and frame their witnesses’ opinions sympathetically rather than defensively.

Third, the plaintiffs had the good fortune of the defendant’s counsel’s apparent failure to find the key fallacies, invalidities, and flaws in plaintiffs’ questionable expert witness opinions.

The Allen case teaches that sometimes good lawyering can win a losing case.

The plaintiffs’ counsel retained and presented an array of expert witnesses who might be the usual suspects in a district court’s exclusion of expert witness testimony:

None of these four expert witnesses was a specialist in ALS or ALS causation; none was a neurologist; none had ever addressed ALS causation in a peer-reviewed article.  All four witnesses were frequent testifiers in tort litigation, and some have are repeat offenders when it comes to offering questionable or excludable opinion testimony.  Somehow, the defense dashed this opportunity by retaining only one expert, Dean M. Hashimoto, M.D., J.D., M.P.H., who was also not a specialist in ALS, who was not a neurologist, and who had never published anything on ALS.  And to make matters worse, the defense proceeded to challenge the plaintiffs’ expert witnesses for lack of qualifications!

The defense’s challenges to qualifications takes up a good deal of Judge Saylor’s published opinion, which illustrates the maxim that judges have short attention spans, and you should not waste the opportunity of a motion on an issue that is so easily decided against you.  The scientific issues are difficult and the temptation to avoid them is great.  By leading with an issue that will almost certainly lose, the defense wasted a valuable advocacy opportunity to show the court the fallacious reasoning in the plaintiffs’ case.  By submitting reports from only one expert witness, who had all the deficiencies claimed in the plaintiffs’ set of witnesses, the defense exhibited a duplicity that must have seriously undermined its credibility for the entire set of Rule 702 motion issues.

THE WITNESSES

Dr. Christine Oliver has been testifying in asbestos and other occupational lung disease cases for decades.  She is a pulmonary physician on staff at Massachusetts General Hospital, in Boston, and an associate professor of clinical medicine at the Harvard Medical School.  She is board certified in internal medicine and in occupational medicine (American Board of Preventive Medicine), and her clinical interests are asthma occupational lung disease, and health hazards of construction work.  If the defense had presented real expert witnesses in ALS causation, Dr. Oliver’s expertise would have seemed quite irrelevant.  Dr. Oliver has, as well as I can determine, never researched or published on ALS causation.  She has, however, published on “multiple chemical sensitivity,” which should give a disinterested court some pause.  See L. Christine Oliver and Alison Johnson, “Multiple Chemical Sensitivity: Reflections” (Nov. 4, 2011).

Richard Clapp, professor emeritus at the Boston University School of Public Health, is a known purveyor of dubious courtroom testimony. See, e.g., Sutera v. The Perrier Group of America Inc., 986 F.Supp. 655 (D. Mass. 1997).  He is a frequent testifier and a charter member of the surreptitiously funded SKAPP organization.  Clapp is a non-physician epidemiologist, who has never published on ALS.

Marcia Ratner Ph.D. may be best known for her possession of mace and an unlicensed gun, but she does occasionally show up in civil litigation as an expert witness.  SeeQuincy District Court News,” Patriot Ledger June 09, 2010 (reporting that Ratner pleaded guilty to criminal possession of mace and a firearm).

Ratner is a postdoctoral researcher at Boston University, where she works as a neurotoxicologist.  She does not appear to have ever published a peer-reviewed paper on ALS or ALS causation.  Plaintiffs’ counsel claimed that she was researching a new drug with therapeutic potential for ALS treatment, although they were quite sketchy about details.  Ratner does not appear to hold any NIH grants for ALS drug research.

[Please see update on the discussion of Dr. Ratner at http://schachtmanlaw.com/gatekeeping-in-allen-v-martin-surfacing-postscript/]

William Ewing, an industrial hygienist, frequently testifies in asbestos litigation.  He offered no opinion on causation.

Against this field of witnesses, the defense punted on presenting its own witness with relevant expertise. Dr. Dean M. Hashimoto, the defense’s sole witness on causation, is a physician, lawyer, and has a master’s degree in occupational health.  Hashimoto has no specialized training in ALS or clinical neurology, although he serves on the Massachusetts Workers’ Compensation Board. A pubmed search  shows that Hashimoto has never published on the neurology or causation of ALS.

CAUSATION

The plaintiffs had a huge problem to avoid:  ALS has no known cause.  Counsel table could be filled up with textbooks and review articles, but perhaps the following, lengthy quote from the National Institute for Neurological Disorders and Stroke website suffices to make the point:

“What causes ALS?

The cause of ALS is not known, and scientists do not yet know why ALS strikes some people and not others. An important step toward answering that question came in 1993 when scientists supported by the National Institute of Neurological Disorders and Stroke (NINDS) discovered that mutations in the gene that produces the SOD1 enzyme were associated with some cases of familial ALS. This enzyme is a powerful antioxidant that protects the body from damage caused by free radicals. Free radicals are highly reactive molecules produced by cells during normal metabolism. If not neutralized, free radicals can accumulate and cause random damage to the DNA and proteins within cells. Although it is not yet clear how the SOD1 gene mutation leads to motor neuron degeneration, researchers have theorized that an accumulation of free radicals may result from the faulty functioning of this gene. In support of this, animal studies have shown that motor neuron degeneration and deficits in motor function accompany the presence of the SOD1 mutation.

Studies also have focused on the role of glutamate in motor neuron degeneration. Glutamate is one of the chemical messengers or neurotransmitters in the brain. Scientists have found that, compared to healthy people, ALS patients have higher levels of glutamate in the serum and spinal fluid. Laboratory studies have demonstrated that neurons begin to die off when they are exposed over long periods to excessive amounts of glutamate. Now, scientists are trying to understand what mechanisms lead to a buildup of unneeded glutamate in the spinal fluid and how this imbalance could contribute to the development of ALS.

Autoimmune responses—which occur when the body’s immune system attacks normal cells—have been suggested as one possible cause for motor neuron degeneration in ALS. Some scientists theorize that antibodies may directly or indirectly impair the function of motor neurons, interfering with the transmission of signals between the brain and muscles.

In searching for the cause of ALS, researchers have also studied environmental factors such as exposure to toxic or infectious agents. Other research has examined the possible role of dietary deficiency or trauma. However, as of yet, there is insufficient evidence to implicate these factors as causes of ALS.

Future research may show that many factors, including a genetic predisposition, are involved in the development of ALS.”

NINDS – “Amyotrophic Lateral Sclerosis (ALS) Fact Sheet.”

As a result, the plaintiffs adopted a strategy of confession and avoidance; they renounced any claim that they were asserting a causal claim.  Instead, they insisted that they were “merely” claiming that toluene exposure had accelerated the onset of sporadic ALS in Coach Allen.  This mere claim, however, was actually a causal claim in disguise, and the district judge was taken in by the ruse.  If plaintiffs were claiming that toluene can accelerate the onset of ALS by a meaningful period of time (years), then they were making a causal claim, legally and scientifically.  A shift in the age of onset of a sporadic disease is a causal claim, and it requires supporting evidence, not hand waving.

PLAUSIBLE MECHANISM

One scientist could postulate a reasonable mechanism even for a sporadic disease.  Professional journals and textbooks are filled with such speculation.  These postulations are part of science in that they inform research hypotheses and funding, but they are not conclusions of causality.  The quote above from the NINDS discusses the lack of an anti-oxidizing enzyme and glutamate toxicity as potential mechanisms in familial ALS, but even there, the authors are appropriately modest in avoiding a claim to know the pathogenesis of familial ALS.

The plaintiffs’ approach was to take the suggestion of a mechanism, misrepresent it as a known mechanism, and then claim that toluene activated glutamate toxicity and exercised an oxidizing effect on neurons. The plaintiffs’ team had no basis for claiming that short-term exposure to solvents, or toluene specifically, translated into a toxicity to the relevant human motor neurons that are involved in ALS.  It is a long stretch from suggesting a mechanism to documenting the mechanism to be actually at work in producing, or accelerating, a disease in humans.

A typical statement, from the Yale School of Medicine, Division of Neurology, in 2012:

Why the motor neurons begin to die is still unknown. Recent evidence, however, have implicated glutamate excitotoxicity, free radical toxicity, and mitochondrial dysfunction as possible mechanisms, and this is an area of active research.”

Amyotrophic Lateral Sclerosis (ALS)” (emphasis added).   See also Adams and Victor’s Principles of Neurology 1157-58 (7th ed. 2001) (noting that the pathogenesis of ALS and similar motor neuron diseases is not known).

The district judge seemed mesmerized by Ratner’s having providing a biologically plausible theory for tying ALS progression to toluene exposure.  263 F.R.D. at 60.  Judge Saylor stated that the defense did not address any flaw in Ratner’s methodology other than to point out that her theory was not supported by epidemiology.  The court seemed to equate providing a plausible theory with establishing a scientific conclusion.  More to the point, the court was truly asleep at its gatekeeping task because Ratner’s theory actually presupposed that she knew that Coach Allen was going to develop ALS in any event, only not as early as 2001.  The court faulted the defense for not showing that Ratner’s (and the other plaintiffs’ witnesses’) theory was unreliable, but the burden was on the plaintiffs to show reliability.  Id.  The court not only faulted the defense for carrying a burden it did not have, but it overlooked the very telling criticisms of Ratner’s theories of acceleration and mechanism.

EXCUSES – EPIDEMIOLOGY

Plaintiffs’ expert witnesses had a welter of excuses as to why there was no epidemiologic data to support their theories.  The absence of statistical significance, according to plaintiffs’ expert witnesses does not mean that a study should be disregarded.  Id. at 58.  Their claim is superficially true, but a study not disregarded does not necessarily support a causal inference, either alone or conjunction with other such studies. Similarly, plaintiffs’ claim that flawed studies should not be disregarded is also a half truth.  A flawed study may lead to a much better one, which can support valid inferences.  Flawed studies are thus part of the scientific process because they may lead to a self-correcting triangulation of the truth, but there is little to recommend relying upon flawed studies to support scientific conclusions of causality.  Nevertheless, the district court appeared to swallow these half truths, whole.

Ratner also advanced a claim that the acceleration theory had not been subjected to epidemiologic analysis because of “funding limitations, as most funding goes toward finding treatment or cures for the disease, not towards finding what accelerates the course of the disease.”  Id. at 59 n. 14.  The district court repeats this excuse without critical thought.  If a commonly used solvent such as toluene accelerated the onset of a terrible disease such as ALS by decades, such a putative effect would be amenable to epidemiologic analysis and would be a source of incredible concern and funding efforts by the NIH, NINDS, NIEHS, and other granting agencies and organizations.  Despite excusifying verbiage, Ratner maintained that there were no epidemiologic data that refuted her novel acceleration.  Id. at 59.  Of course, if her excuses were taken seriously, then this absence of refutation was fairly irrelevant, but in any event, this supposed absence could not support the reliability of Ratner’s inferences or conclusions.

The defense focused on the lack of short-term exposures in epidemiologic studies, and also the lack of statistical significance in some studies.  What appears to have been missing from both sides was a comprehensive analysis of the available epidemiologic data.  If long-term exposure were associated with earlier age of onset of ALS, or even a greater risk of ALS, then it would have given some support to Ratner’s novel theory.  The defense appeared to punt on the epidemiology by claiming its irrelevance.  It might have been helpful to point out internal as well as external validity issues to the court.

As for both sides citing different studies, and no side presenting a comprehensive view of the epidemiologic evidence, the court could have given some consideration to the ethical considerations of the incomplete presentation:

“Basis of Expert Medical Testimony

The testimony of an expert medical witness should be founded on a thorough and critical review of the pertinent medical and scientific facts, available data, and relevant literature.”

Ethical Guidelines for Occupational and Environmental Medicine Physicians Serving as Expert Witnesses (Oct. 25, 2007).

DIFFERENTIAL DIAGNOSIS

The plaintiffs’ claim that they were not asserting causation was disingenuous.  As noted above, acceleration of onset is a form of causation.  Of course, exposure to a neurotoxic material, with some symptoms, might have made Allen more aware of other symptoms, and so the time to diagnosis was abbreviated.  The plaintiffs, however, were claiming more than earlier ascertainment; they claimed the toluene exposure caused an underlying disease process to accelerate.

Oliver actually went further and performed an invalid differential etiologic analysis. Oliver reviewed medical records and claimed to have applied “differential diagnosis to the review.”  Id. at 63. This claim was quite bogus because there was no dispute that Allen had and died of ALS, but the district court was beguiled.  Having ruled out family history, Oliver claimed to then rule out other “putative causes” of ALS:  “pesticides and agricultural chemicals containing solvents, 60-hertz magnetic fields, and welding fumes.”  Id. at 63.  In one fell swoop, Oliver created several known causes to be ruled out, and then ruled them out in Allen’s case.  This is remarkable given that NINDS and most of medical sciences does not recognize any known or putative causes of sporadic ALS, and that Oliver failed to rule out the one potential cause that some scientists take seriously:  cigarette smoking.  See, e.g., Hao Wang, Éilis J. O’Reilly, Marc G. Weisskopf, Giancarlo Logroscino, Marji L. McCullough, Michael Thun, Arthur Schatzkin, Laurence N. Kolonel, Alberto Ascherio, “Smoking and risk of amyotrophic lateral sclerosis: a pooled analysis of 5 prospective cohorts” 68 Arch. Neurol. 207 (2011); A. Alonso, G. Logroscino, M.A. Hernán, “Smoking and the risk of amyotrophic lateral sclerosis: a systematic review and meta-analysis,” 81 J. Neurol. Neurosurg. & Psychiatry 1249 (2010); F. Fang & W. Ye, “Smoking may be considered an established risk factor for sporadic ALS,” 74 Neurology 1927 (2010).

Of course, Oliver, and the entire plaintiffs’ expert witness team failed to rule out the most obvious, most prevalent explanation for Allen’s ALS:  unknown.

GENETIC SUSCEPTIBILITY

Ratner testified “to a reasonable degree of scientific certainty that Allen was genetically predisposed to develop ALS and would have developed and died from ALS later in his life.”  263 F.R.D. at 61.  This assertion was truly an incredible, unsupported, unverifiable, and unfalsifiable statement.  If a drug company ever made a similarly unsupported claim in an electronically transmitted document, the Department of Justice would prosecute it for wire fraud.  United States v. Harkonen, 2010 WL 2985257 (N.D. Calif. 2010).

The parties had essentially stipulated that Allen did not suffer from familial ALS, and neither Ratner nor anyone else identified any gene that was responsible for his “susceptibility.”  The district court, of course, did not report how Ratner could possibly have known that Allen was going to develop ALS, only at some unspecified date later than the date when Allen first became aware of signs and symptoms of motor neuron disease.  The district court announced that plaintiffs’ expert witnesses were not propounding “junk science,” but perhaps the heavy perfume helped masquerade the garbage.

POST HOC ERGO PROPTER HOC

The court conclusorily noted, without explanation, that the temporal relationship between exposure and disease manifestation would allow a conclusion of causality:

“Finally, after interpreting the data within a chronological context, the clinician may conclude that the patient’s disease is a neurotoxic illness.”

Id. at 61.  The court appears to accept the temporal pattern as sufficient in itself, or with other information, to support the conclusion.  This reasoning is fallacious.

AGE OF ONSET

Allen developed ALS when he was 45 years old.  Ratner reasoned that the average age of onset was 60, and Allen developed his disease “much earlier than would be expected”; therefore toluene accelerated the onset of Allen’s disease.  Id. at 61. The problem is that there is no “therefore” that can reasonably be claimed in the court’s sentence.

Most publications put the mean and median of age of ALS onset around 55 years, but even if the court were to accept Ratner’s reference to 60 as correct, surely the court recognized that half the cases therefore occurred below the age of 60.  The question of course is the variability in age of onset, and the court’s opinion is silent about the scatter or distribution of age-of-onset data.  Ratner’s reasoning was prima facie invalid unless there was additional information to show a very narrow distribution of age of onset around the mean.  It is difficult to discern whether the defense made this point, but Ratner could not have supported this counterfactual claim.

Here is what the ALS association has to say about the issue:

“Most people who develop ALS are between the ages of 40 and 70, with an average age of 55 at the time of diagnosis. However, cases of the disease do occur in persons in their twenties and thirties.”

Who Gets ALS.”

Ratner essentially conceded that her argument was vacuous and invalid.  When confronted at her deposition about whether age of onset greater than the mean would have changed her opinion, she emphatically denied its relevance:

“My opinion would be the same even if that guy died at 60 instead of 75 and had history of this exposure … but you wouldn’t have bothered to depose me in that case… . Somebody else has moved down from where they are to here. But it may not result in a lawsuit, and I wouldn’t be here, because— I wouldn’t be here.”

Ratner Deposition at 172-3.

RULE 702 ANALYSIS

The district court recognized the novelty of Ratner’s analysis, but opined that Ratner, Oliver, and Clapp had provided sufficient cumulative evidence to support their theories.  263 F.R.D. at 61.  The trial court apparently conducted a Rule 702 hearing, over three days. Both sides filed what appears to have been extensive briefing and affidavits.  There are some huge gaps in the reasoning of the plaintiffs’ expert witnesses, and in the district court’s opinion.  Perhaps those gaps could be filled in with volumes of testimony.  My unscientific opinion is to doubt it. Although the plaintiffs should have had the burden of showing admissibility, the defendant had the practical burden of illustrating the analytical gaps, ipse dixit, fallacies, and invalid inferences that were before the court.  The defense may have indeed pointed out such problems, which were fulsomely present, but the district court’s opinion does not report the obvious defense arguments.  Without more background information, it is difficult to evaluate comprehensively the court’s or the defense’s handling of the scientific issues that were clearly before the court on the Rule 702 motions.  What is clear from what the district court reports is, however, sufficient to document an unsatisfactory judicial review of the evidence discussed.

Wells v. Ortho Pharmaceutical Corp. Reconsidered – Part 6

November 21st, 2012

In 1984, before Judge Shoob gave his verdict in the Wells case, another firm filed a birth defects case against Ortho for failure to warn in connection with its non-ionic surfactant spermicides, in the same federal district court, the Northern District of Georgia. The mother in Smith used Ortho’s product about the same time as the mother in Wells (in 1980).  The case was assigned to Judge Shoob, who recused himself.  Smith v. Ortho Pharmaceutical Corp., 770 F. Supp. 1561, 1562 n.1 (N.D. Ga. 1991) (no reasons for the recusal provided).  The Smith case was reassigned to Judge Horace Ward, who entertained Ortho’s motion for summary judgment in July 1988.  Two and one-half years later, Judge Ward granted summary judgment to Ortho on grounds that the plaintiffs’ expert witnesses’ testimony was not based upon the type of data reasonably relied upon by experts in the field, and was thus inadmissible under Federal Rule of Evidence 703. 770 F. Supp. at 1681.

A prevalent interpretation of the split between Wells and Smith is that the scientific evidence developed with new studies, and that the scientific community’s views matured in the five years between the two district court opinions. The discussion in Modern Scientific Evidence is typical:

“As epidemiological evidence develops over time, courts may change their view as to whether testimony based on other evidence is admissible. In this regard it is worth comparing Wells v. Ortho Pharmaceutical Corp., 788 F.2d 741 (11th Cir. 1986), with Smith v. Ortho Pharmaceutical Corp., 770 F. Supp. 1561 (N.D. Ga. 1991). Both involve allegations that the use of spermicide caused a birth defect. At the time of the Wells case there was limited epidemiological evidence and this type of claim was relatively novel.  In a bench trial the court found for the plaintiff.  *** The Smith court, writing five years later, noted that, ‘The issue of causation with respect to spermicide and birth defects has been extensively researched since the Wells decision.’ Smith v. Ortho Pharmaceutical Corp., 770 F. Supp. 1561, 1563 (N.D. Ga. 1991).”

1 David L. Faigman, Michael J. Saks, Joseph Sanders, and Edward K. Cheng, Modern Scientific Evidence:  The Law and Science of Expert Testimony, “Chapter 23 – Epidemiology,” § 23:4, at 213 n.12 (West 2011) (internal citations omitted).

Although Judge Ward was being charitable to his judicial colleague, this attempt to reconcile Wells and Smith does a disservice to Judge Ward’s hard work in Smith, and Judge Shoob’s errors in Wells.

Even a casual reading of Smith and Wells reveals that the injuries were completely differently.  Plaintiff Crystal Smith was born with a chromosomal defect known as Trisomy-18; Plaintiff Katie Wells was born with limb reduction deficits.   Some studies relevant to one injury had no information about the other.  Other studies, which addressed both injuries, yielded different results for the different injuries.  Although some additional studies were available to Judge Ward in 1988, this difference is hardly the compelling difference between the two cases.

Perhaps the most important difference between the cases is that in Smith, the biologically plausibility that spermicides could cause a Trisomy-18 was completely absent.  The chromosomal defect arises from a meiotic disjunction, an error in meiosis that is part of the process in which germ cells are formed.  Simply put, spermicides arrive on the scene too late to cause a Trisomy-18.  Notwithstanding the profound differences between the injuries involved in Wells and Smith, the Smith plaintiffs sought the application of collateral estoppel.  Judge Ward refused this motion, on the basis of the factual differences in the cases, as well as the availability of new evidence.  770 F.Supp. at 1562.

The difference in injuries, however, was not the only important difference between these two cases.  Wells was actually tried, apparently without any challenge under Frye, or Rules 702 or 703, to the admissibility of expert witness testimony.  There is little to no discussion of scientific validity of studies, or analysis of the requisites for evaluating associations for causality.  It is difficult to escape the conclusion that Judge Shoob decided the Wells case on the basis of superficial appearances, and that he frequently ignored validity concerns in drawing invidious distinctions between plaintiffs’ and defendant’s expert witnesses and their “credibility.”  Smith, on the other hand, was never tried.  Judge Ward entertained and granted dispositive motions for summary judgment, on grounds that the plaintiffs’ expert witnesses’ testimony was inadmissible. Legally, the cases are light years apart.

In Smith, Judge Ward evaluated the same FDA reports and decisions seen by Judge Shoob.  Judge Ward did not, however, dismiss these agency materials simply because one or two of dozens of independent scientists involved had some fleeting connection with industry. 770 F.Supp. at 1563-64.

Judge Ward engaged with the structure and bases of the expert witnesses’ opinions, under Rules 702 and 703.  The Smith case thus turned on whether expert witness opinions were admissible, an issue not considered or discussed in Wells.  As was often the case before the Supreme Court decided Daubert in 1993, Judge Ward paid little attention to Rule 702’s requirement of helpfulness or knowledge.  The court’s 702 analysis was limited to qualifications.  Id. at 1566-67.  The qualifications of the plaintiffs’ witnesses were rather marginal.  They relied upon genetic and epidemiologic studies, but they had little training or experience in these disciplines. Finding the plaintiffs’ expert witnesses to meet the low threshold for qualification to offer an opinion in court, Judge Ward focused on Rule 703’s requirement that expert witnesses reasonably rely upon facts and data that are not otherwise admissible.

The trial court in Smith struggled with how it should analyze the underpinnings of plaintiffs’ witnesses’ proffered testimony.  The court acknowledged that conflicts between expert witnesses typically raise questions of weight, not admissibility.  Id. at 1569.  Ortho had, however, challenged plaintiffs’ witnesses for having given opinions that lacked a “sound underlying methodology.” Id.  The trial court found at least one Fifth Circuit case that suggested that Rule 703 requires trial courts to evaluate the reliability of expert witnesses’ sources.  Id. (citing Soden v. Freightliner Corp., 714 F.2d 498, 505 (5th Cir. 1983). Elsewhere, the trial court also found precedent from Judge Weinstein’s opinion in Agent Orange, as well as Court of Appeals decisions involving Bendectin, all of which turned to Rule 703 as the legal basis for reviewing, and in some cases limiting or excluding expert witness opinion testimony.  Id.

The defendant’s argument under Rule 703 was strained; Ortho argued that the plaintiffs’

“experts’ selection and use of the epidemiological data is faulty and thus provides an insufficient basis upon which experts in the field of diagnosing the source of birth defects normally form their opinions. The defendant also contends that the plaintiffs’ experts’ data on genetics is not of the kind reasonably relied upon by experts in field of determining causation of birth defects.”

Id. at 1572.  Nothing in Rule 703 addresses the completeness or thoroughness of expert witnesses in their consideration of facts and data; nor does Rule 703 address the sufficiency of data or the validity vel non of inferences drawn from facts and data considered.  Nonetheless, the trial court in Smith took Rule 703 as its legal basis for exploring the epistemic warrant for plaintiffs’ witnesses’ causation opinions.

Although plaintiffs’ expert witnesses stated that they had relied upon epidemiologic studies and method, the trial court in Smith went beyond their asseverations.  The Smith trial court explored the credibility of these witnesses at a whole other level.  The court reviewed and discussed the basic structure of epidemiologic studies, and noted that the objective of such studies is to provide a statistical analysis:

“The objective of both case-control and cohort studies is to determine whether the difference observed in the two groups, if any, is ‘statistically significant’, (that is whether the difference found in the particular study did not occur by chance alone).40 However, statistical methods alone, or the finding of a statistically significant association in one study, do not establish a causal relationship.41 As one authority states:

‘Statistical methods alone cannot establish proof of a causal relationship in an association’.42

As a result, once a statistical association is found in an epidemiological study, that data must then be evaluated in a systematic manner to determine causation. If such an association is present, then the researcher looks for ‘bias’ in the study.  Bias refers to the existence of factors in the design of a study or in the manner in which the study was carried out which might distort the result.43

If a statistically significant association is found and there is no apparent ‘bias’, an inference is created that there may be a cause-and-effect relationship between the agent and the medical effect. To confirm or rebut that inference, an epidemiologist must apply five criteria in making judgments as to whether the associations found reflect a cause-and-effect relationship.44 The five criteria are:

1. The consistency of the association;

2. The strength of the association;

3. The specificity of the association;

4. The temporal relationship of the association; and,

5. The coherence of the association.

Assuming there is some statistical association, it is these five criteria that provide the generally accepted method of establishing causation between drugs or chemicals and birth defects.45

The Smith court acknowledged that there were differences of opinion in weighting these five factors, but that some of them were very important to drawing a reliable inference of causality.  Id. at 1775.

A major paradigm shift thus separates Wells and Smith.  The trial court in Wells contented itself with superficial and subjective indicia of witnesses’ personal credibility; the trial in Smith delved into the methodology of drawing an appropriate scientific conclusion about causation.  Telling was the Smith court’s citation to Moultrie v. Martin, 690 F.2d 1078, 1082 (4th Cir. 1982) (“In borrowing from another discipline. a litigant cannot be selective in which principles are applied.”).  770 F.Supp. at 1575 & n.45.  Gone is the Wells retreat from engagement with science, and the dodge that the court must make a legal, not a scientific decision.

Applying the relevant principles, the Smith court found that the plaintiffs’ expert witnesses had deviated from the scientific standards of reasoning and analysis:

“It is apparent to the court that the testimony of Doctors Bussey and Holbrook is insufficiently grounded in any reliable evidence. * * * The conclusions Doctors Bussey and Holbrook reach are also insufficient as a basis for a finding of causality because they fail to consider critical information, such as the most relevant epidemiologic studies and the other possible causes of disease.81

The court finds that the opinions of plaintiffs’ experts are not based upon the type of data reasonably relied upon by experts in determining the cause of birth defects. Experts in determining birth defects rely upon a consensus in genetic or epidemiological investigations or specific generally accepted studies in these fields. While a consensus in genetics or epidemiology is not a prerequisite to a finding of causation in any and all birth defect cases, Rule 703 requires some reliable evidence for the basis of an expert’s opinion.

Experts in determining birth defects also utilize methodologies and protocols not followed by plaintiffs’ experts. Without a well-founded methodology, opinions which run contrary to the consensus of the scientific community and are not supported by any reliable data are necessarily speculative and lacking in the type of foundation necessary to be admissible.

For the foregoing reasons, the court finds that plaintiffs have failed to produce admissible evidence sufficient to show that defendant’s product caused Crystal’s birth defects.”

Id. at 1581.  Rule 703 was forced into a service to filter out methodologically specious opinions.

Not all was smooth sailing for Judge Ward.  Like Judge Shoob, Judge Ward seemed to think that a physical examination of the plaintiff provided helpful, relevant evidence, but he never articulated what the basis for this opinion was. (His Honor did note that the parties agreed that the physical examination offered no probative evidence about causation.  Id. at 1572 n.32.) No harm came of this opinion.  Judge Ward wrestled with the lack of peer review in some unpublished studies, and the existence of a study only in abstract form.  See, e.g., id. at 1579 (“a scientific study not subject to peer review has little probative value”); id. at 1578 (insightfully noting that an abstract had insufficient data to permit a reader to evaluate its conclusions).  The Smith court recognized the importance of statistical analysis, but it confused Bayesian posterior probabilities with significance probabilities:

“Because epidemiology involves evidence on causation derived from group based information, rather than specific conclusions regarding causation in an individual case, epidemiology will not conclusively prove or disprove that an agent or chemical causes a particular birth defect. Instead, its probative value lies in the statistical likelihood of a specific agent causing a specific defect. If the statistical likelihood is negligible, it establishes a reasonable degree of medical certainty that there is no cause-and-effect relationship absent some other evidence.”

The confusion here is hardly unique, but ultimately it did not prevent Judge Ward from reaching a sound result in Smith.

What intervened between Wells and Smith was not any major change in the scientific evidence on spermicides and birth defects; the sea change came in the form of judicial attitudes toward the judge’s role in evaluating expert witness opinion testimony.  In 1986, for instance, after the Court of Appeals affirmed the judgment in Wells, Judge Higginbotham, speaking for a panel of the Fifth Circuit, declared:

“Our message to our able trial colleagues: it is time to take hold of expert testimony in federal trials.”

 In re Air Crash Disaster at New Orleans, 795 F.2d 1230, 1234 (5th Cir. 1986).  By the time the motion for summary judgment in Smith was decided, that time had come.

Evidence-Based Specific Causation

November 7th, 2012

In the last post, I discussed an important article by Professors Davidson and Guzelian, on the legal implications of evidence-based medicine (EBM).  Terence M. Davidson & Christopher P. Guzelian, “Evidence-based Medicine (EBM): The (Only) Means for Distinguishing Knowledge of Medical Causation from Expert Opinion in the Courtroom,” 47 Tort Trial & Ins. Practice L. J. 741 (2012) [cited as Davidson].

Their criticism of the deficiencies in current gatekeeping practice cries out for reform of much current judicial practice.  Education of the judiciary in EBM would be helpful to both plaintiffs and defendants in civil cases, as well as prosecutors and defendants in criminal cases.  I will leave for another day a discussion of whether the boundary between knowledge and “mere opinion” is so easily discernible.

Although the authors’ call for EBM in judicial decisions is timely and needed, I noted my dissent to their assessment of one defense expert witness’s specific causation opinion in the hormone therapy litigation. Davidson and Guzelian criticize one district judge for having admitted the challenged testimony of a defense expert witness, Dr. Blaustein, who opined that (1) estrogen + progesterone combination post-menopausal hormone replacement therapy (CHRT) has not been shown to cause breast cancer, and (2) there is no generally accepted method for determining a cause of a woman’s breast cancer.  Cross v. Wyeth Pharms., Inc., CASE NO.: 8:06-cv-429-T-23AEP, 2011 U.S. Dist. LEXIS 89078; 2011 WL 3498305 (M.D. Fla. 2011) (Merryday, J.).

Here is how Davidson & Guzelian put the matter:

“Blaustein also opined that there is no generally accepted method for diagnosing specific medical causation—that is, whether a medical intervention or treatment, even if it is known to generally cause a result ‘X’ (e.g., breast cancer), caused a particular patient’s result ‘X’. Blaustein’s statement, accepted by the judge as befitting of presentation to the jury, is ‘simply false’.”

The claim that Blaustein’s statement is “simply false” is pretty strong for both general and specific causation, and partially explains my initial dissent.  The prestige of the Women’s Health Initiative (WHI), a large, randomized, clinical meta-trial of  CHRT, with its finding of an increased risk for breast cancer among women, certainly has made Dr. Blaustein’s opinion on general causation a distinctly minority view.  There are, however, some careful authors who have challenged the findings of the WHI on grounds of internal and external validity.  See, e.g., Samuel Shapiro, Richard Farmer, Helen Seaman, J. C. Stevenson, “Does hormone replacement therapy cause breast cancer? An application of causal principles to three studies: part 2. The Women’s Health Initiative: estrogen plus progestogen,” 37 J. Family Planning & Reproductive Health Care 165, 165 (2011) (“HRT with estrogen plus progestogen may or may not increase the risk of breast cancer, but the WHI did not establish that it does.”).  In any event, given the state of the science, most defendants would hedge their position on general causation even if they stopped short of saying it was not established.  Still, the validity concerns may cause us to have some doubts that the conclusions drawn from the WHI and other studies are truly “knowledge.”

Professor Guzelian has persuaded me that their indictment of Blaustein’s opinion on specific causation is correct, at least technically.  There are, to be sure, a few genetic causes of breast cancer, such as the BrCa 1, and 2, genes, which can cause breast cancer, and which, if present in a particular woman, would constitute an adequate description of the cause of that woman’s cancer.  Blaustein claimed that there is no generally accepted method for attributing an individual woman’s breast cancer to known causes, and Davidson and Guzelian are correct that Blaustein’s claim is, therefore, “simply false.”

Given how cursory and conclusory the trial court’s opinion is, Davidson and Guzelian’s derision is, however, relatively uncharitable.  We can probably credit the plaintiff’s counsel with sufficient entrepreneurial savvy to have not pressed the claims of a woman who had a known genetic cause of breast cancer.  And we can similarly credit the defense counsel with sufficient intelligence not to have overlooked the presence of such a gene if it were present.

With genetic causes taken out of the equation, Blaustein’s opinion seems fairly unremarkable.  Even if the criticism of the trial court’s refusal to preclude Dr. Blaustein’s testimony on general causation were correct under Federal Rule of Evidence 702, Davidson and Guzelian have failed to make their case against the trial court, and Dr. Blaustein, on specific causation.

Here is what Davidson and Guzelian have to say about Blaustein’s specific causation opinion:

“EBM has documented and catalogued the best practices regarding how to diagnose whether generally applicable evidence-based conclusions hold for specific patients.51 Moreover, even if in a specific case it were plausible to assert that it is impossible to reach a specific causation conclusion for a particular patient’s condition using the scientific method, that is very different than saying that there is no scientific method for analyzing specific causation. According to EBM’s strictures, Blaustein’s proposed blanket denial of the possibility of specific causation should have been precluded from his testimony.52

Davidson at 757. The footnotes in this passage are to the section of an article on evidence-based toxicology, which deals with attribution of an adverse drug reaction.  Philip Guzelian et al., “Evidence-Based Toxicology: A Comprehensive Framework for Causation,” 24 Human & Experimental Toxicol. 161, 190-91 (Table 9) (2005) (presenting “an overview of evidence-based specific causation diagnostic criteria”). Putting aside the very substantial differences between cancer causation and the general run of adverse drug reactions, we can see that the proposed criteria for specific causation in the referenced article contain this extremely important criterion:

“No good alternative candidate (unexplained exacerbation or recurrence of underlying illness).”

Id.  Specific causation in a breast cancer case falls outside this criterion because most cases of breast cancer (with the exception of the genetic cases mentioned above) have no identifiable risk factor.  Dr. Blaustein’s opinion on specific causation — that there is no generally accepted method for attributing breast cancer to exogenous cause(s) — seems then exactly on point, even on the EBM criteria for specific causation urged by the authors.

In Cross, the trial court does not provide any insight into the basis for the plaintiffs’ challenge to Blaustein’s specific causation opinion, and I am aware of none.  The trial court does not give us any particulars of the plaintiff’s use of CHRT or development of breast cancer, and there is no suggestion that she had an extraordinarily high risk (say > 10-fold increase, which I have never seen reported, in any event).

The plaintiffs did not attempt to infer causation from risk.  Perhaps they thought better of it, or perhaps one of their testifying epidemiologists, Dr. Graham Colditz, refused to support such an inference:

“Knowledge that a factor is associated with increased risk of disease does not translate into the premise that a case of disease will be prevented if a specific individual eliminates exposure to that risk factor. Disease pathogenesis at the individual level is extremely complex. As Rose stated, a preventive measure that brings large benefits to the community offers little to each participating individual [3]. Accordingly, epidemiology must be harnessed to identify the population level strategies that will reduce the burden of illness.”

Graham A. Colditz, “From epidemiology to cancer prevention: implications for the 21st Century,” 18 Cancer Causes Control 117, 118 (2007).  Professor Colditz’ view is hardly unique; there are many similar refusals to base an inference of specific causation upon an increased risk, whether or not that increased risk is quantified as a relative risk greater than two.  The late David Freedman, who was the co-author of the chapters on statistics in all three editions of the Reference Manual on Scientific Evidence, was also a naysayer when it came to transmuting risk into cause:

“The scientific connection between specific causation and a relative risk of two is doubtful. *** Epidemiologic data cannot determine the probability of causation in any meaningful way because of individual differences.”

David Freedman & Philip Stark, “The Swine Flu Vaccine and Guillaine-Barré Syndrome:  A Case Study in Relative Risk and Specific Causation,” 64 Law & Contemporary Problems 49, 61 (2001).

The plaintiffs’ challenge to Blaustein’s claim that there was no “generally accepted” method for specific causal attribution took the form of advancing their own “method”:  differential diagnosis. At face value, the plaintiffs’ use of differential diagnosis to advance a claim of specific causation is “simply false.”  There was no dispute about diagnosis, and no differential diagnosis at issue.  Unfortunately, courts have permitted lawyers to corrupt the meaning of differential diagnosis and contend that it covers something akin to differential etiology.

Davidson and Guzelian, in their reference back to an earlier article on evidence-based toxicology, embrace differential etiology as a method of specific case attribution.  I agree that there is really no dispute about the logically validity of such reasoning, generally.  The logic of differential etiology is simple.  If you can specify all the known causes of a disease, and eliminate all but one cause, then you have ruled in the specific cause.  Logically, this is an iterative disjunctive syllogism, also known as the process of elimination.  The syllogism requires an exhaustive statement of disjuncts, with the negation of all but one:

A v B v C v D

~A and ~B and ~ C.

Therefore, D.

In “The Adventure of the Beryl Coronet,” Sir Arthur Conan Doyle had his famous detective, Sherlock Holmes, articulate this method in ordinary English, with a bit more flair:

“It is an old maxim of mine that when you have excluded the impossible, whatever remains, however improbable, must be the truth.”

Arthur Conan Doyle, The Penguin Complete Sherlock Holmes 315 (Penguin 1981). The process of elimination was a mainstay of Holmes’ forensic thought:

“Eliminate all other factors, and the one which remains must be the truth.”

“The Sign of the Four,” chap. 1 (“The Science of Deduction”), in Arthur Conan Doyle, The Penguin Complete Sherlock Holmes at 92 (Penguin 1981).

The problem of course is, for a disease such as breast cancer, is that one of the disjuncts has been, and will remain, for some time: the proposition that this case is “idiopathic” or “sporadic.” The plaintiffs in Cross did not advance any plausible method for eliminating this disjunct.  As a result, they can never arrive at a conclusion that CHRT was a cause of Ms. Cross’s breast cancer.  The closest they can get to their desired conclusion with this “method,” once they have eliminated genetic causes, is a conclusion that:

The case is idiopathic OR the case resulted from CHRT.

This conclusion is not really a conclusion at all, but an indeterminate statement, which would be quite unhelpful to the trier in deciding the case. Furthermore, as the case is described by the trial court’s opinion, the plaintiffs did not even attempt a quantification of the probability of each of these two disjuncts.  Thus, the plaintiffs failed to offer any substantial evidence that a jury could believe to find in their favor on specific causation.  The trial court was correct to reject the challenge to Dr. Blaustein’s specific causation opinion, but the court should have granted the defendants’ challenge to the plaintiffs’ expert witnesses, who had no method at all on the crucial element of specific causation.

Interestingly, one of the plaintiffs’ better arguments against Dr. Blaustein was that he was, as a clinician, unqualified to opine on causation.  Cross, *9.  The trial court did not elaborate on the argument other than to point out that plaintiffs had emphasized that Dr. Blaustein relied upon his “unquantifiable and untested clinical experience.” Cross, *10. The courts have been remarkably resistant to the argument that physicians are generally unqualified to interpret scientific evidence of causation.  Sadly, there is a good deal of empirical evidence to show that physicians are not particularly well trained in statistics or in interpreting clinical research.  See, e.g., Donna Windish, Stephen Huot, and Michael Green, “Medicine Residents’ Understanding of the Biostatics and Results in the Medical Literature,” 298 J. Am. Med. Ass’n 1010, 1010 (2007) (“Most residents in this study lacked the knowledge in biostatistics to interpret many of the results in published clinical research.”).

Broadbent on the Relative Risk > 2 Argument

October 31st, 2012

Alex Broadbent, of the University of Johannesburg, Department of Philosophy, has published a paper that contributes to the debate over whether a relative risk (RR) greater than (>) two is irrelevant, helpful, necessary, or sufficient in inferring that an exposure more likely than not caused an individual claimant’s disease. Alex Broadbent, “Epidemiological Evidence in Proof of Specific Causation,” 17 Legal Theory 237 (2011) [cited as Broadbent].  I am indebted to his having called his paper to my attention. Professor Broadbent’s essay is clearly written, which is helpful in assessing the current use of the RR > 2 argument in judicial decisions.

General vs. Specific Causation

Broadbent carefully distinguishes between general and specific causation.  By focusing exclusively upon specific causation (and assuming that general causation is accepted), he avoids the frequent confusion over when RR > 2 might play a role in legal decisions. Broadbent also “sanitizes” his portrayal of RR by asking us to assume that “the RR is not due to anything other than the exposure.” Id. at 241. This is a BIG assumption and a tall order for observational epidemiologic evidence.  The study or studies that establishes the RR we are reasoning from must be free of bias and confounding. Id.  Broadbent does not mention, however, the statistical stability of the RR, which virtually always will be based upon a sample, and thus subject to the play of random error.  He sidesteps the need for statistical significance in comparing two proportions, but the most charitable interpretation of his paper requires us to assume further that the hypothetical RR from which we are reasoning is sufficiently statistically stable that random error, along with bias and confounding, can be also ruled out as likely explanations for the RR > 1.

Broadbent sets out to show that RR > 2 may, in certain circumstances, suffices to show specific causation, but he argues that RR > 2 is never logically necessary, and must never be required to support a claim of specific causation.  Broadbent at 237.  On the same page in which he states that epidemiologic evidence of increased risk is a “last resort,” Broadbent contradicts himself by stating RR > 2 evidence “must never be required,” and then, in an apparent about face, he argues:

“that far from being epistemically irrelevant, to achieve correct and just outcomes it is in fact mandatory to take (high-quality) epidemiological evidence into account in deciding specific causation. Failing to consider such evidence when it is available leads to error and injustice. The conclusion is that in certain circumstances epidemiological evidence of RR > 2 is not necessary to prove specific causation but that it is sufficient.”

Id. at 237 (emphasis added). I am not sure how epidemiologic evidence can be mandatory but never logically necessary, and something that we should never require.

Presumably, Broadbent is using “to prove” in its legal and colloquial sense, and not as a mathematician.  Let us also give Broadbent his assumptions of “high quality” epidemiologic studies, with established general causation, and ask why, and explore when and whether, RR > 2 is not necessary to show specific causation.

The Probability of Causation vs. The Fact of Causation

Broadbent notes that he is arguing against what he perceives to be Professor Haack’s rejection of probabilistic inference, which would suggest that epidemiologic evidence is “never sufficient to establish specific causation.” Id. at 239 & n.3 (citing Susan Haack, “Risky Business: Statistical Proof of Individual Causation,” in Causación y Atribucion de Responsabilidad (J. Beltran ed., forthcoming)). He correctly points out that sometimes the probabilistic inference is the only probative inference available to support specific causation.  His point, however, does not resolve the dispute; it suffices only to show that whether we allow the probabilistic inference may be outcome determinative in many lawsuits.  Broadbent characterizes Haack’s position as one of two “serious mistakes in judicial and academic literature on this topic.”  Broadbent at 239.  The other alleged mistake is the claim that RR > 2 is needed to show specific causation:

“What follows, I conclude, is that epidemiological evidence is relevant to the proof of specific causation. Epidemiological evidence says that a particular exposure causes a particular harm within a certain population. Importantly, it quantifies: it says how often the exposure causes the harm. However, its methods are limited: they measure only the net effect of the exposure, leaving open the possibility that the exposure is causing more harm than the epidemiological evidence suggests—but ruling out the possibility that it causes less. Accordingly I suggest that epidemiological evidence can be used to estimate a lower bound on the probability of causation but that no epidemiological measure can be required. Thus a relative risk (RR, defined in Section II) of greater than 2 can be used to prove causation when there is no other evidence; but RR < 2 does not disprove causation. Given high-quality epidemiological evidence, RR > 2 is sufficient for proof of specific causation when no other evidence is available but not necessary when other evidence is available.”

Some of this seems reasonable enough.  Contrary to the claims of authors such as Haack and Wright, Broadbent maintains that some RR evidence is relevant and indeed probative of specific causation.  In a tobacco lung cancer, with a plaintiff who has smoked three packs a day, for 50 years (and RR > 50), we can confidently attribute the lung cancer to smoking, and rest assured that background cosmic radiation did not likely play a substantial role. The RR quantifies the strength of the association, and it does lead us to a measure of “attributable risk” (AR), also known as the attributable fraction (AF):

AR = 1 – 1/RR.

So far, so good.

Among the perplexing statements above, however, Broadbent suggests that:

1. The methods of epidemiologic evidence measure only the net effect of the exposure.  Epidemiologic evidence (presumably the RR or other risk ratio) provides a lower bound on the probability of causation.  I take up this suggestion in discussing Broadbent’s distinction between the “excess fraction,” and the “etiologic fraction,” below.

2. A RR > 2 “can be used to prove causation when there is no other evidence; but RR < 2 does not disprove causation.” (My emphasis.) When an author is usually clear about his qualifications, and his language generally, it is distressing for him to start comparing apples to oranges.  Note that RR > 2 suffices “when there is no other evidence,” but the parallel statement about RR < 2 is not similarly qualified, and the statement about RR < 2 is framed in terms of disproof of causation. Even if the RR < 2 did not “disprove” specific causation, when there was no other evidence, it would not prove causation.  And if there is no other evidence, judgment for the defense must result. Broadbent fails to provide us a persuasive scenario in which a RR ≤ 2, with no other evidence, would support an inference of specific causation.

Etiological Fraction vs. Excess Fraction — Occam’s Disposable Razor

Broadbent warns that the expression “attributable risk” (AR or “attributable fraction,” AF) is potentially misleading.  The numerical calculation identifies the excess number of cases, above “expected” per base rate, and proceeds from there.  The AR thus identifies the “excess fraction,” and not the “etiological fraction,” which is the fraction of all cases in which exposure makes a contribution. Broadbent tells us that:

“Granted a sound causal inference, we can infer that all the excess cases are caused by the exposure. But we cannot infer that the remaining cases are not caused by the exposure. The etiologic fraction—the cases in which the exposure makes a causal contribution—could be larger. Roughly speaking, this is because, in the absence of substantive biological assumptions, it is possible that the exposure could contribute to cases that would have occurred12 even without the exposure.13 For example, it might be that smoking is a cause of lung cancer even among some of those who would have developed it anyway. The fact that a person would have developed lung cancer anyway does not offer automatic protection against the carcinogenic effects of cigarette smoke (a point we return to in Section IV).”

Id. at 241. In large measure here, Broadbent has adopted (and acknowledged) his borrowings from Professor Sander Greenland.  Id. at 242 n.11. The argument  still fails.  What Broadbent has interposed is a “theoretical possibility” that the exposure in question may contribute to those cases that would have occurred anyway.  Note that raising theoretical possibilities here now alters the hypothetical; Broadbent is no longer working from a hypothetical that we have a RR and no other evidence.  Even more important, we are left guessing what it means to say that an exposure causes some cases that would have occurred anyway.  If we accept the postulated new evidence at face value, we can say confidently that the exposure is not the “but for” cause of the case at issue.  Without sufficient evidence of “but for” causation, plaintiff will lose. Furthermore, we are being told to add a new fact to the hypothetical, namely that the non-excess cases are causally over-determined.  If this is the only additional new fact being added, a court might invoke the rule in Summers v. Tice, but even so, the defense will be entitled to a directed verdict if the RR < 2. (If the RR = 2, I suppose, the new fact, and the change in the controlling rule, might alter the result.)

Exposures that Cause Some and Prevent Some Cases of Disease

Broadbent raises yet another hypothetical possibility, which adds to, and materially alters,  his original hypothetical.  If the exposure in question, causes some cases, and prevents others, then the RR ≤ 2 will not permit us to infer that a given case is less likely than not the result of the exposure.  (Broadbent might have given an example of what he had in mind, from well-established biological causal relationships; I am skeptical that he would have found one that would have satisfactorily made his argument.) The bimodal distribution of causal effects is certainly not typical of biological processes, but even if we indulge the “possibility,” we are now firmly in the realm of speculation.  This is a perfectly acceptable realm for philosophers, but in court, we want evidence.  Assuming that the claimant could present such evidence, finders of fact would still founder because the new evidence would leave them guessing whether the claimant was a person who would have gotten the disease anyway, or got it because of the exposure, or even got it in spite of the exposure.

Many commentators who urge a “probability of [specific] causation” approach equate the probability of causation (PC) with the AR.  Broadbent argues that because of the possibility that some biological model results in the etiologic fraction exceeded the excess fraction, the usual equation of PC = AR, must be represented as an equality:

PC ≥ AR

While the point is logically unexceptional, Broadbent must concede that some other evidence, which supports and justifies the postulated biological model, is required to change the equality to an inequality.  If no other evidence besides the RR is available, we are left with the equality.  Broadbent tells us that the biological model “often” requires that the etiological fraction exceeds the excess fraction, but he never tells us how often, or how we would ascertain the margin of error.  Id. at 256.

Broadbent does not review any of the decided judicial cases to point out which ones involved biological models that invalidated the equality.  Doing so would be an important exercise because it might well show that even where PC ≥ AR, with a non-quantified upper bound, the plaintiff might still fail in presenting a prima facie case of specific causation.  Suppose the population RR for the exposure in question were 1.1, and we “know” (and are not merely speculating) that the etiological fraction > excess fraction.   Unless we know how much greater is the etiological fraction, such that we can recalculate the PC, then we are left agnostic about specific causation.

Broadbent treats us to several biological scenarios in which PC possibly is greater than AR.  All of these scenarios violate his starting premiss that we have a RR with no other evidence. For instance, Broadbent hypothesizes that exposure might accelerate onset of a disease.  Id. at 256. This biological model of acceleration can be established with the same epidemiologic evidence that established the RR for the population.  Epidemiologists will frequently look at time windows from onset of exposure to explore whether there is an acceleration of onset of cases in a younger age range that offsets a deficit later in the lives of the exposed population.  If there were firm evidence of such a phenomenon, then we would look to the RR within the relevant time window.  If the relevant RR ≤ 2, the biological model will have added nothing to the plaintiff’s case.

Broadbent cites Greenland for the proposition that PC > AR:

“We know of no cancer or other important chronic disease for which current biomedical knowledge allows one to exclude mechanisms that violate the assumptions needed to claim that PC = [AF].”

Id. at 259, quoting form Sander Greenland & James Robins, “Epidemiology, Justice, and the Probability of Causation,” 40 Jurimetrics J. 321, 325 (2000).  Here, not only has Broadbent postulated a mechanism that makes PC > AR, but he has shifted the burden of proof to the defense to exclude it!

The notion that the etiological fraction may exceed the excess fraction is an important caveat.  Courts and lawyers should take note.  It will not do, however, wave hands and exclaim that the RR > 2 is not a “litmus test,” and proceed to let any RR > 1, or even RR ≤ 1 support a verdict.  The biological models that may push the etiological fraction higher than the excess fraction can be tested, and quantified, with the same epidemiologic approaches that provided a risk ratio, in the first place.  Broadbent gives us an example of this sort of hand waving:

“Thus, for example, evidence that an exposure would be likely to aggravate an existing predisposition to the disease in question might suffice, along with RR between 1 and 2, to make it more likely than not that the claimant’s disease was caused by the exposure.”

Id. at 275. This is a remarkable, and unsupported claim.  The magnitude of the aggravation might still leave the RR ≤ 2.  What is needed is evidence that would allow quantification of the risk ratio in the scenario presented. Speculation will not do the trick; nor will speculation get the case to a jury, or support a verdict.

 

Call for Evidence-Based Medicine in Medical Expert Opinions

October 30th, 2012

Evidence-based medicine (EBM) seeks to put health care decision making on a firm epistemic foundation, rather than on the personal opinion of health care providers.  David Sackett, et al., “Evidence based medicine: what it is and what it isn’t,” 312 Brit. Med. J. 71 (1996).  EBM thus offers a therapeutic intervention, sometimes in the form of strong medicine, to the sloppy thinking, intuition, mothers’ hunches, and leveling of studies that remain prevalent in the Rule 702 gatekeeping of medical causation opinion testimony in courts.  There are some who have suggested that EBM addresses therapeutic interventions only, and not disease causation by exogenous substances or processes.  A very recent publication in the Tort Trial & Insurance Practice Law Journal provides a strong rebuttal to the naysayers and a clear articulation of the need now, more than ever, for greater acknowledgment of EBM in the evaluation of expert witness opinion testimony.  Terence M. Davidson & Christopher P. Guzelian, “Evidence-based Medicine (EBM): The (Only) Means for Distinguishing Knowledge of Medical Causation from Expert Opinion in the Courtroom,” 47 Tort Trial & Ins. Practice L. J. 741 (2012) [cited as Davidson].

Terence M. Davidson is a physician, a Professor of Surgery, and the Associate Dean for Continuing Medical Education at the University of California, San Diego School of Medicine.  Christopher P. Guzelian   is an Assistant Professor of Law at Thomas Jefferson School of Law, in San Diego, California. Davidson and Guzelian bring the Rule 702 discussion and debate back to the need for epistemic warrant, not glitz, glamour, hunches, prestige, and the like.  Their article is a valuable contribution, and the authors’ presentation and defense of EBM in the gatekeeping process is commendable.

There are some minor dissents I would offer.  For instance, in applying EBM principles to causation of harm assessments, we should recognize that there are asymmetries between determining therapeutic benefit and environmental or occupational harm.  Physicians, even those practicing EBM, may well recommend removal from a potentially toxic exposure because the very nature of their clinical judgment is often precautionary.  Tamraz v. BOC Group Inc., No. 1:04-CV-18948, 2008 WL 2796726 (N.D. Ohio July 18, 2008) (denying Rule 702 challenge to treating physician’s causation opinion), rev’d sub nom., Tamraz v. Lincoln Elec. Co., 620 F.3d 665, 673 (6th Cir. 2010) (carefully reviewing record of trial testimony of plaintiffs’ treating physician; reversing judgment for plaintiff based in substantial part upon treating physician’s speculative causal assessment created by plaintiffs’ counsel; “Getting the diagnosis right matters greatly to a treating physician, as a bungled diagnosis can lead to unnecessary procedures at best and death at worst. But with etiology, the same physician may often follow a precautionary principle: If a particular factor might cause a disease, and the factor is readily avoidable, why not advise the patient to avoid it? Such advice—telling a welder, say, to use a respirator—can do little harm, and might do a lot of good. This low threshold for making a decision serves well in the clinic but not in the courtroom, where decision requires not just an educated hunch but at least a preponderance of the evidence.”) (internal citations omitted), cert. denied, ___ U.S. ___ , 131 S. Ct. 2454, 2011 WL 863879 (2011).

The wisdom of the Tamraz decision (in the 6th Circuit) lies in its recognition of the asymmetries involved in medical decision making.  For most diseases, physicians rarely have to identify an etiology to select efficacious treatment.  This asymmetry affects the general – specific causation distinction.  A physician will want some epistemic warrant for the judgment that a therapy or medication is efficacious.  In other words, the physician needs to know that there is efficacy, even though the intervention may not be efficacious in every case.  If the risk ratio for an intervention (where the risk is cure of the disease or disorder), is greater than 1.0, and chance, bias, and confounding are eliminated as explanations for the observed efficacy, then that intervention likely goes into the physician’s therapeutic armamentarium.  The risk ratio, of course, need not be greater than two for the intervention to remain clinically attractive.  Furthermore, if the therapy is provided, and the patient improves, the determination whether therapy itself was efficacious is often not a pressing clinical matter.  After all, if the risk ratio was greater than one, but two or less, then the improvement may have been spontaneous and unrelated to therapy.

Davidson and Guzelian do not fully recognize this asymmetry, which leads the authors into error.  They give an example in which a defense expert witness proferred a personal opinion about general causation of breast cancer by post-menopausal hormone replacement therapy, which opinion is undermined and contradicted by a judgment reached with EBM principles.  See Cross v. Wyeth Pharm., Inc., 2011 U.S. Dist. LEXIS 89078, at *10 (M.D. Fla. Aug. 10, 2011).  Fair enough, but Davidson and Guzelian then claim that the errant defense expert had no basis for claiming that there was no generally accepted basis for “diagnosing specific medical causation.” Davidson at 757.  The authors go even further and claim that the defense expert’s statement is “simply false.” Id.

I would suggest that the authors have gotten this dead wrong.  In this sort of case, the plaintiff’s expert witness is usually the one casting about for a basis to support specific attribution.  The authors offer no basis for their judgment that the defense expert witness is wrong, or lacks a basis for his specific causation judgment. The poor, pilloried defense expert was, in the cited case, opining that there was no way to attribute a particular patient’s breast cancer to her prior use of post-menopausal hormone replacement therapy.  Putting aside the possibility of long-term use (with risk ratio greater than 2.0), the expert’s opinion is reasonable. General causation does not logically or practically imply specific causation; they are separate and distinct determinations.  Perhaps a high risk ratio might justify a probabilistic inference that the medication caused the specific patient’s breast cancer, but for many HRT-use factual scenarios, the appropriate risk ratio is two or less.  If there is some other method Davidson and Guzelian have in mind, they should say so. The authors miss an important point, which is that EBM sets out to provide a proper foundation for judgments of causality (whether of therapeutic benefit or harm), but it often does not have the epistemic foundation to provide a resolution of the individual causation issue. In medicine, there often is simply no need to do so.

One other nit.  The authors briefly discuss statistical significance, citing the Supreme Court’s recent foray into statistical theory.  Davidson at 747 & n. 14 (citing Matrixx Initiatives, Inc. v. Siracusano, 131 S. Ct. 1309, 1321 (2011)).  In their explanatory parenthetical, however, the authors describe the case as “holding that a lack of statistical significance in a pharmaceutical company’s results does not exempt the company from material disclosure requirements for reporting adverse events during product testing.”  Id. 

Matrixx Initiatives held no such thing; the Supreme Court was faced with an adequacy of pleadings case. No evidence was ever offered; nor was there any ruling on the reliability or insufficiency of evidence of causation. Matrixx Initiative’s attempt to import Rule 702 principles of reliability into a motion to dismiss on the pleadings was seriously misguided. Even assuming that statistical significance was necessary to causation, regulatory action did not require a showing of causality. Therefore, statistical significance was never necessary for the plaintiffs’ case. Second, the company’s argument that the adverse event reports at issue were “not statistically significant” was fallacious because adverse event reports, standing alone, could not be “statistically significant” or “insignificant.” The company would need to know the expected base rate for anosmia among Zicam users, and it would need to frame the adverse event reports in terms of an observed rate, so that the expected and observed rates could be compared against an assumption of no difference. Third, the class plaintiffs had alleged considerably more than just the adverse events, and the allegations taken together deserved the attention of a reasonable investor.  Bottom line:  the comments that the Court made about the lack of necessity for statistical significance were pure obiter dictum.

Highlighting these two issues in the Davidson & Guzelian article should not detract from the importance of the authors’ general enterprise. There is an aversion to examining the “epistemic warrant” behind opinion evidence in federal court gatekeeping.  Anything that treats that aversion, such as Davidson & Guzelian’s article, is good medicine.

“Trust Me” Rules of Evidence

October 18th, 2012

Stating what should be obvious, Judge Posner noted that the “[l]aw lags science, it does not lead it.” Rosen v. Ciba Geigy, 78 F.3d 316, 319 (7th Cir. 1996). Science as a method and a process has long ago moved away from authoritative pronouncements.  Since 1663, the Royal Society has sported the motto:  “Nullius in verba.”  When confronted with a pamphlet entitled “100 Authors against Einstein,” Albert Einstein quipped “if I were wrong, one would have been enough.”  See Remigio Russo, 18 Mathematical Problems in Elasticity 125 (1996) (quoting Einstein). Disputes in science are resolved with data, from high-quality, reproducible experimental or observational studies, not with appeals to the prestige of the speaker.

Almost 20 years ago, the Supreme Court, in Daubert v. Merrell Dow Pharms., Inc.,  509 U.S. 579 (1993), redirected the course of the federal system of evidence, which had exalted expert witness opinion over knowledge.  The Court attempted to put expert witness testimony on the same footing as knowledge, or true justified belief, as required by the plain language of Rule 702.  The Court’s leadership culminated in today’s revised Federal Rule of Evidence 702.

Many rules of evidence, however, remain mired in the “trust me” authoritarian regime of subjective opinion.  Recently, the Committee on Rules of Practice and Procedure has approved draft amendments to three rules with built-in “trustworthiness” elements:

·       Rules 803(6) (Records of a Regularly Conducted Activity),

·       FRE 803(7) (Absence of a Record of a Regularly Conducted Activity), and

·       FRE 803(8) (Public Records).

Public comment on the draft rules closes on February 13, 2012. The amendments are designed to make clear that the party against whom the business or public record is offered must show the untrustworthiness of the record to keep the record out of evidence.  These exceptions to the rule against hearsay are problematic because medical records and governmental reports may be larded with subjective opinions that would never pass Rule 702 scrutiny.

There is something peculiar about this aspect of the federal rules and its insistence that a party, facing the admission of evidence, must show the absence of trustworthiness.  These exceptions to the rule against hearsay, dealing with public and business records, are not alone in employing trustworthiness of the source as a proxy for the truth.  For many years, Rule 703 was viewed as an exception to the rule against hearsay, with the predicate to admissibility being the reliance by a party’s expert witness.  The changes wrought by Daubert made this interpretation of Rule 703 untenable, and today, the text of the rule ensures against this once popular evidentiary fallacy.  In hindsight, the use of a party’s hired witness to provide the predicate for admissibility seems a fairly primitive move within the Federal Rules of Evidence.

This pending revision to the Federal Rules of Evidence ignores another trustworthiness-based rule, Rule 803(18), which creates limited admissibility for “statements in learned treatises, periodicals, or pamphlets.”  This rule does require the proponent to present expert witness testimony to qualify the source, or to seek judicial notice of “learnedness,” which has been interpreted to be a proxy for trustworthiness and knowledge.  As such, the rule represents a major gap in the requirement that the proponent of scientific testimony show its epistemic warrant.  Statements in treatises or periodicals are often made in conclusory fashion, without a complete explication of their bases. See Schachtman, “Further Unraveling of the Learned Treatise Exception” (Sept. 29, 2010); “The New Wigmore on Learned Treatises” (Sept. , 2011); and “Unlearning The Learned Treatise Exception” (Aug. 21, 2010).

Even within the current framework of judicial decisions interpreting Rule 702, courts still struggle when faced with appeals to authority, especially in the field of clinical medicine.  Courts have a difficult time getting past: “Trust me, I am a physician.”  See, e.g., Mueller v. Auker, No. 11-35351, ___ F.3d ___, 2012 WL 3892960 at *8 (9th Cir. Sept. 10, 2012) (noting that “clinical instinct” is a generally accepted method of decision making by physicians).  The evidence-based worldview continues to challenge, confound, and confuse judges.

Hop on Pop Redux – Watson Case

October 3rd, 2012

Last month, Maxwell Kennerly of the Beasley Firm in Philadelphia posted about the Watson case in his blog.  See Max Kennerly, “The Science And Law Behind The $7 Million Microwave Popcorn Lung Jury Verdict” (Sept. 20, 2012).  This case has attracted a lot of attention, as it well should.  SeeIt’s Alimentary, My Dear Watson” (Sept. 20, 2012); and “Good’s Expert Witness Opinion Not Good Enough in Tenth Circuit” (Sept. 8, 2012).

Kennerly is correct that we should not lump the Watson case with other frivolous cases, such as the infamous McDonald’s hot-coffee spill case.  I suppose people can debate whether McDonald’s sold their coffee at too-high a temperature, but most civilized people can agree that McDonald’s makes bad coffee, and that everyone should be careful what they put between their legs, regardless of temperature.

Watson represents a paradigmatic tort case, involving exposure and diagnostic issues common to many toxic tort cases.  Mr. Watson was a mega-consumer of microwavable popcorn, flavored with diacetyl.  We can assume for discussion that diacetyl can cause bronchiolitis obliterans in factory workers who are exposed at relatively high levels.  There are, however, other causes, as well as idiopathic cases. Two uncertainties overlapped in the Watson case:  diagnosis and exposure assessment.  A treating physician pondered a differential diagnosis between hypersensitivity pneumonitis (HP) and bronchiolitis obliterans (BO).  As a carpet cleaner, Watson had occupational exposures that might well have caused HP.  Indeed, in August 2006, an open lung biopsy requested by his treating physicians, by pathologists at University Hospital, at the University of Colorado, interpreted Watson’s lung pathology as HP.  In 2010, Professor Eugene Mark, a well-known pulmonary pathologist at Harvard Medical School, interpreted the pathology as “in keeping with hypersensitivity pneumonitis.”  Although Dr. Mark was consulting for the defense in this case, he is not a frequent testifier, and his few forays have been almost always for plaintiffs in asbestos cancer cases.  To my understanding, none of the pathologists testified at the trial.

Despite the pathology report, Watson’s treating physician, Dr. Cecile Rose, advocated that the correct diagnosis was BO.  She wrote a letter to NIOSH, and other federal agencies, in which advanced her diagnosis, although she did not mention the hospital pathology.  Regulators and lawyers became involved.  NIOSH measurements of diacetyl in Watson’s home were below the level of detection.  Another set of diacetyl measurements taken by Watson’s legal team reported levels close to that of the industrial workers who sustained BO from workplace exposure to diacetyl.  The plaintiffs’ expert witnesses relied upon these measurements suggesting high exposure.  Just before trial, the defense renewed its Rule 702 motion, challenging the plaintiffs’ exposure level evidence.  The defendant’s motion sought preclusion of the plaintiffs’ expert witnesses’ reliance upon data generated by an Innova Model 1312 Photoacoustic Multi-Gas Monitor.  The court denied this motion, with leave to raise it at trial, and also precluded mention of the testing in front of the jury until the evidentiary matter is resolved. Order of June 22, 2012. I do not know how the court handled this important evidentiary issue at trial, and no analysis of the case is possible until this part of the story is told.

What can be said now, hypothetically, is that if the plaintiffs had no reliable evidence of high exposure, there was precious little in the exposure data to support Watson’s treating physician’s argument for BO, over HP.  The treating clinician did not settle on the BO diagnosis until she had the dubious exposure data. The pathology reports consistently favored the HP diagnosis.

Watson is the third consumer diacetyl case litigated to date.  The Newkirk case resulted in the 702 exclusion of plaintiffs’ expert witness, Dr. Egilman. Newkirk v. ConAgra Foods, Inc., 727 F. Supp. 2d 1006 (E.D.Wash. 2010), aff’d, 438 Fed.Appx. 607 (9th Cir. 2011).  See also Egilman v. ConAgra Foods, Inc., No. 10-35667, U.S. Court of Appeals for the Ninth Circuit (Sept. 5, 2012; unpublished memorandum) (refusing personal appeal of expert witness who claimed defamation and “wrongful exclusion” by district court).  A second case was tried to a jury verdict for the defense, and the appellate court upheld the judgment for the defense.  Khoury v. Conagra Foods, Inc., 368 S.W.3d 189 (Mo. Ct. App. 2012).

Kennerly argues that Watson had proof!  Referring to “evidence” as “proof” is a hyperbolic conceit of lawyers; I am sure have used the expression, as well.  Outside the legal world, proofs and demonstrations are the work of geometers and mathematicians; factual propositions are usually more modestly shown or suggested by evidence.  The “proof” that Kennerly cites is the testimony of Watson’s treating physician, Dr. Cecile Rose, MD, MPH, “a published expert and researcher of occupational pulmonary diseases,” who testified that the basis for her opinion:

“relates mainly to the fact that his lung disease has stabilized with the cessation of use of the product and exposure to the inhalants related with that product. The fact that there was no other causal explanation for his lung condition and the fact that the clinical findings in his lung disease were similar to those that occurred in workers who were exposed to butter flavoring also support that opinion.”

This is the same Dr. Rose who wrote to several federal regulatory agencies, to present a tendentiously abridged clinical case report of a patient with BO, who consumed thousands of bags of microwave diacetyl-flavored popcorn.  Even with the serious omissions of information, and the problematic exposure measurements, Dr. Rose hedged in her attribution:

“It is difficult to make a causal connection based on a single case report. We cannot be sure that this patient’s exposure to butter flavored microwave popcorn from daily heavy preparation has caused his lung disease. However, we have no other plausible explanation. Given the public health implications of this possibility, we wanted to alert you to our concerns.”

To be sure, this is nothing like the McDonald’s coffee-spill case.  This is a case of questioned and questionable science. Kennerly is correct; there is nothing frivolous about the Watson case.  If the diagnosis were correct, and the exposure measurements were accurate, this case would raise very serious public concerns for consumer exposure to diacetyl.  If the antecedents of the BO diagnosis are incorrect, then the judicial system has been snookered, again. The view from over 2,600 kilometers away suggests that the antecedent conditions were unlikely.

Siracusano Dicta Infects Daubert Decisions

September 22nd, 2012

Gatekeeping is sometimes  intellectually challenging, but the challenge does not excuse sloppy thinking.  Understandably, judges will sometimes misunderstand the relevant science.  The process, however, allows the public and the scientific community to see what is happening in court cases, rather than allowing the critical scientific reasoning to be hidden in the black box of jury determinations.  This transparency can and should invite criticism, commentary, corrections, and consensus, when possible.

Bad legal reasoning is much harder to excuse.  The Supreme Court, in Matrixx Initiatives, Inc. v. Siracusano, 131 S. Ct. 1309 (2011), unanimously affirmed the reversal of a trial court’s Rule 12(b)(6) dismissal of a securities fraud class action.  The corporate defendant objected that the plaintiffs failed to plead statistical significance in alleging causation between Zicam and the loss of the sense of smell.  The Supreme Court, however, made clear that causation was not required to make out a claim of securities fraud.  It was, and would be, sufficient for the company’s product to have raised sufficient regulatory concerns, which in turn would bring regulatory scrutiny and action that would affect the product’s marketability.

The Supreme Court could have disposed of the essential issue in a two page per curiam opinion.  Instead the Court issued an opinion signed by Justice Sotomayor, who waxed carelessly about causation and statistical significance, which discussion was not necessary to the holding.  Not only was Justice Sotomayor’s discussion obiter dicta, but the dicta were demonstrably incorrect. Matrixx Unloaded (Mar. 29, 2011).

The errant dicta in Siracusano has already led one MDL court astray:

“While the defendant repeatedly harps on the importance of statistically significant data, the United States Supreme Court recently stated that ‘[a] lack of statistically significant data does not mean that medical experts have no reliable basis for inferring a causal link between a drug and adverse events …. medical experts rely on other evidence to establish an inference of causation.’ Matrixx Initiatives, Inc. v. Siracsano, 131 S.Ct. 1309, 1319 (2011).”

Memorandum Opinion and Order at 22, In re Chantix (Varenicline) Products Liability Litigation, MDL No. 2092, Case 2:09-cv-02039-IPJ Document 642 (N.D. Ala. Aug. 21, 2012)[hereafter cited as Chantix].  See Open Admissions for Expert Witnesses in Chantix Litigation.

It was only a matter of time before the Supreme Court’s dictum would be put to this predictably erroneous interpretation.  SeeThe Matrixx Oversold” (April 4, 2011).  Within two weeks, the error in Chantix propagated itself in another MDL case, with another trial court succumbing to the misleading dicta in Justice Sotomayor’s opinion.  See Memorandum in Support of Separate Pretrial Order No. 8933, Cheek v. Wyeth Pharm. Inc. (E.D.Pa. Aug. 30, 2012)(Bartle, J.).

In Cheek, Judge Harvey Bartle rejected a Rule 702 challenge to plaintiffs’ expert witness’s opinion.  I confess that I do not know enough about the expert witness’s opinion or the challenge to assess Judge Bartle’s conclusion.  Judge Bartle, however, invoked the Matrixx decision for the dubious proposition that:

Daubert does not require that an expert opinion regarding causation be based on statistical evidence in order to be reliable. Matrixx Initiatives, Inc. v. Siracusano, 131 S. Ct. 1309, 1319 (2011). In fact, many courts have recognized that medical professionals often base their opinions on data other than statistical evidence from controlled clinical trials or epidemiological studies. Id. at 1320.”

Cheek at 16.  The Cheek decision is a welter of non-sequiturs.  The fact that in some instances statistical evidence is not necessary is hardly a warrant to excuse the lack of statistical evidence in every case. The truly disturbing gaps in reasoning, however, are not scientific, but legal. Siracusano was not a “Daubert” opinion; and Siracusano does not, and cannot, support the refusal to inquire whether statistical evidence was necessary in a causation opinion, in main part because causation was not at issue in Siracusano.

 

 

 

 

 

 

 

David Egilman’s Methodology for Divining Causation

September 6th, 2012

If the Method Yields An Erroneous Conclusion, then the Method is Wrong

David Stephen Egilman wanted very much to testify in a diacetyl case.  One judge, however, did not think that this was such a good idea, and excluded Dr. Egilman’s testimony. Newkirk v. Conagra Foods, Inc.  727  F.Supp. 2d 1006 (E.D. Wash. 2010).

Egilman was so distraught by being excluded that he sought to file a personal appeal to the United States Court of Appeal. See “Declaration of David Egilman, M.D., M.P.H., in Support of Opposition to Motion for Order to Show Cause Why Appeal Should Not Be Dismissed for Lack of Standing.”  (Attached: Egilman Motion Appeal Diacetyl Exclusion 2011 and Egilman Declaration Newkirk Diacetyl Appeal 2011.)

Egilman improvidently, if not scurrulously, attacked the district judge for having excluded Egilman’s proffered testimony.  If Egilman’s attack on the trial judge were not sufficiently odd, Egilman also claimed a right to intervene in the appeal by advancing the claim that the Rule 702 exclusion hurt his livelihood.  Here is how Egilman put the matter:

“The Daubert ruling eliminates my ability to testify in this case and in others. I will lose the opportunity to bill for services in this case and in others (although I generally donate most fees related to courtroom testimony to charitable organizations, the lack of opportunity to do so is an injury to me). Based on my experience, it is virtually certain that some lawyers will choose not to attempt to retain me as a result of this ruling. Some lawyers will be dissuaded from retaining my services because the ruling is replete with unsubstantiated pejorative attacks on my qualifications as a scientist and expert. The judge’s rejection of my opinion is primarily an ad hominem attack and not based on an actual analysis of what I said – in an effort to deflect the ad hominem nature of the attack the judge creates ‘straw man’ arguments and then knocks the straw men down, without ever addressing the substance of my positions.”

Egilman Declaration at ¶ 11.

The Ninth Circuit, unmoved by the prospect of an impoverished Dr. Egilman, denied his personal appeal, and affirmed the district court’s exclusion. Newkirk v. Conagra Foods, Inc., 438 Fed. Appx. 607 (9th Cir. 2011).

In his appellate papers, Egilman did not stop at simply citing his pecuniary interest.  With no sense of false shame or modesty, Egilman recited what a wonderful expert witness he has been.  Egilman suggested that courts have been duly impressed by his views on the scientific assessment of causation:

“My views on the scientific standards for the determination of cause-effect relationships (medical epistemology) have been cited by the Massachusetts Supreme Court (Vassallo v. Baxter Healthcare Corporation, 428 Mass. 1 (1998)):

‘Although there was conflicting testimony at the Oregon hearing as to the necessity of epidemiological data to establish causation of a disease, the judge appears to have accepted the testimony of an expert epidemiologist that, in the absence of epidemiology, it is “sound science…. to rely on case reports, clinical studies, in vivo tests and animal tests.” The judge may also have relied on the affidavit of the plaintiff’s epidemiological expert, Dr. David S. Egilman, who identified several examples in which disease causation has been established based on animal and clinical case studies alone to demonstrate that “doctors utilize epidemiological data as one tool among many”.’”

Egilman Declaration at p.5-6.

We may excuse Dr. Egilman, a non-lawyer, for incorrectly referring to a non-existent court.  Massachusetts does not have a “Supreme Court,” but the quoted language did indeed come from the Supreme Judicial Court of Massachusetts, in Vassallo v. Baxter Healthcare Corporation, 428 Mass. 1, 12, 696 N.E.2d 909, 917 (1998).

The Massachusetts court’s suggestion that there was conflicting testimony at the “Oregon hearing,” about the need for epidemiologic evidence is itself rather bizarre.  The Oregon hearing was the Rule 702 hearing before Judge Jones, of the District of Oregon.  Judge Jones appointed four technical advisors to assist him in ruling on the defendants’ motions to exclude plaintiffs’ causation opinions.  One of the appointed advisors was an epidemiologist.  More important, the plaintiffs’ counsel presented the testimony of an epidemiologist, Dr. David Goldsmith.  The Massachusetts court did not, and indeed, could not cite the Oregon District Court’s opinion, or the underlying record, for any suggestion that epidemiologic testimony was not needed to show a causal relationship between silicone breast implants and the development of autoimmune disease.  See Hall v. Baxter Healthcare Corp., 947 F. Supp. 1387 (D. Or. 1996). Judge Jones made his views very clear:  epidemiology was needed, but lacking, in the plaintiffs’ case.  The argument that epidemiology was unnecessary came from Dr. Egilman’s report, and the plaintiffs’ counsel’s briefs.

There is more, however, to the disingenuousness of Dr. Egilman’s citation to the Vassallo case.  The Newkirk court, in receiving his curious affidavit, would not likely know that Vassallo was a silicone gel breast implant case, and one may suspect that Dr. Egilman wanted to keep the Ninth Circuit uninformed of his role in the silicone litigation.  If Dr. Egilman submitted an affidavit in connection with the so-called Oregon hearings, which took place during the summer of 1996, it was not a particularly important piece of evidence.  Egilman is not mentioned by name in the Hall decision, even though the district court clearly rejected the plaintiffs’ witnesses and affiants, in their efforts to make a case for silicone as a cause of autoimmune disease.

A few months after the Oregon hearings, Judge Weinstein, in the fall of 1996, along with other federal and state judges, held a “Daubert” hearing on the admissibility of expert witness opinion testimony in breast implant cases, pending in New York state and federal courts.  Plaintiffs’ counsel suggested that Egilman might testify, but ultimately he was a no show.  After the New York hearings, Judge Weinstein granted, sua sponte, partial summary judgment against all plaintiffs’ claims of systemic immune-system injury.  In re Breast Implant Cases, 942 F. Supp. 958 (E.&S.D.N.Y. 1996).

At the New York hearings, plaintiffs’ counsel again attempted to make an epidemiologic case, and once again called Dr. David Goldsmith.  Marshaling the evidentiary display that Egilman would have presented had he shown up in New York, Dr. Goldsmith’s testimony did not go well. At one point, Judge Weinstein interrupted and offered his interim assessment of Dr. Goldsmith and the plaintiffs causation case:

THE COURT: Why are you presenting this witness, for epidemiological purposes?

MR. GORDON: That’s correct.

THE COURT: And I can tell you for epidemiological purposes, based on the only testimony I have seen, he doesn’t meet my standard of anybody who can be helpful to a jury, not because he isn’t a great epidemiologist, I’m sure he is, but because the data he is relying on admittedly is almost useless. I’m not going to go forward with a trial on this kind of haphazard abstract without any basic definition or explication.

Transcript at p.159:7-18, from Nyitray v. Baxter Healthcare Corp., CV 93-159 (E.D.N.Y. Oct. 9, 1996)(pre-trial hearing before Judge Jack Weinstein, Justice Lobis, and Magistrate Cheryl Pollak).  In his semi-autobiographical writings, Judge Jack B. Weinstein elaborated upon his published breast-implant decision, with a bit more detail about how he viewed the plaintiffs’ expert witnesses.  Judge Jack B. Weinstein, “Preliminary Reflections on Administration of Complex Litigation” 2009 Cardozo L. Rev. de novo 1, 14 (2009) (describing plaintiffs’ expert witnesses in silicone litigation as “charlatans”; “[t]he breast implant litigation was largely based on a litigation fraud. … Claims—supported by medical charlatans—that enormous damages to women’s systems resulted could not be supported.”)

When Judge Weinstein began to create a process for the selection of Rule 706 court-appointed expert witnesses, plaintiffs’ counsel rushed to have Judge Pointer take control over the process.  Because Judge Pointer believed that there must be some germ of validity in the plaintiffs’ case, the plaintiffs were hoping that his courtroom, the center of MDL 926, would be a more favorable forum than Judge Weinstein’s withering skepticism.  Ultimately, Judge Pointer, through a select nominating committee, appointed appointed expert witnesses, in the fields of toxicology, immunology, rheumology, and epidemiology.  MDL 926 Order No. 31 (Appointment of Rule 706 Expert Witnesses).

Each of the four witnesses prepared, presented, and defended his or her own report, but all the reports soundly rejected plaintiffs’ causation theories.  Laural L. Hooper, Joe S. Cecil, and Thomas E. Willging, Neutral Science Panels: Two Examples of Panels of Court-Appointed Experts in the Breast Implants Product Liability Litigation (Fed. Jud. Ctr. 2001).

In the United Kingdom, the British Minister of Health ordered an independent review of the breast implant controversy, which led to the formation of the Independent Review Group (IRG) to evaluate the causal claims that were being made by claimants and advocates. The IRG concluded that there was no demonstrable risk of connective tissue disease from silicone breast implants. Independent Review Group, Silicone Breast Implants: The Report of the Independent Review Group 8, 22-23 (July 1998).

In 1999, The Institute of Medicine delivered its assessment of the safety of silicone breast implants.  Again, the plaintiffs’ theories were rejected.  Stuart Bondurant, Virginia Ernster, and Roger Herdman, eds., Safety of Silicone Breast Implants (1999).

Still, Egilman persisted.  As late as 2000, Egilman was posting his breast-implant litigation report at his Brown University website.  His conclusion, however awkwardly worded, was clear enough:

“Although a prospective, large epidemiological study investigating atypical symptoms and disease would clearly contribute to underestimating of the strength of association between silicone breast implants and disease, the available epidemiologic evidence is suggestive of a causal association for silicone breast implants and atypical connective tissue diseases and scleroderma.”

David S. Egilman, “Breast Implants and Disease” (2000) (“For purposes of this report SBI induced disease is considered an iatrogenic environmental disease.”) (<http://209.67.232.40/brown/implants/sbi.html> lasted visited on Mar. 28, 2000).

Sometime after 2000, Egilman developed a sensitivity to being associated with the plaintiffs’ side of the silicone litigation.  In 2009, Dr. Laurence Hirsch, published an article critical of Egilman’s disclosures of conflicts of interest, in some of his published articles.  Hirsch struck a sensitive nerve in mentioning Egilman’s involvement in the breast implant litigation:

“Egilman reports having testified for plaintiffs in legal cases involving asbestosis, occupational lung disease, beryllium poisoning, silicone breast implants and connective tissue disease (characterized as the epitome of junk science91), selective serotonin reuptake inhibitor and suicide risk, atypical antipsychotics and metabolic changes, and selective COX-2 inhibitors and cardiovascular disease, an amazing breadth of medical expertise.”

Laurence J. Hirsch, “Conflicts of Interest, Authorship, and Disclosures in Industry-Related Scientific Publications: The Tort Bar and Editorial Oversight of Medical Journals,” 84 Mayo Clin. Proc. 811, 815 (2009).

Egilman apparently besieged Dr. Hirsch and the Mayo Clinic Proceedings with his protests, and it seems that he was able to induce the author or the journal into a “correction”:

“Dr Egilman has not testified in court in breast implant and connective tissue disease, or in antidepressant or antipsychotic drug cases.”

Laurence J. Hirsch, “Corrections,” 85 Mayo Clin. Proc. 99 (2010).  But this correction is itself incorrect because Dr. Egilman testified over the course of three days, in court, in the same Vassallo v. Baxter Healthcare case he holds up as having embraced his causal “principles.”  The Vassallo case involved allegations that silicone had caused systemic autoimmune disease, an allegation that was ultimately shown to be meritless by the MDL court’s neutral expert witnesses, as well as the Institute of Medicine.

Perhaps this history helps explain Dr. Egilman’s coyness in what he told the Newkirk appellate court about his involvement in the Vassallo case.  More likely is that Dr. Egilman understands, all too well, the logical implications of his being wrong in the breast implant litigation.  If his vaunted method leads to an erroneous conclusion, then the method must be wrong.  It is a simple matter of modus tollens.

 

 

 

 

Open Admissions for Expert Witnesses in Chantix Litigation

September 1st, 2012

Chantix is medication that helps people stop smoking.  Smoking kills people, but make a licensed drug and the lawsuits will come.

Earlier this month, Judge Inge Prytz Johnson, the MDL trial judge in the Chantix litigation, filed an opinion that rejected Pfizer’s challenges to plaintiffs’ general causation expert witnesses.  Memorandum Opinion and Order, In re Chantix (Varenicline) Products Liability Litigation, MDL No. 2092, Case 2:09-cv-02039-IPJ Document 642 (N.D. Ala. Aug. 21, 2012)[hereafter cited as Chantix].

Plaintiffs claimed that Chantix causes depression and suicidality, sometimes severe enough to result in suicide, attempted or completed.  Chantix at 3-4.  Others have written about Judge Johnson’s decision.  See Lacayo, “Win Some, Lose Some: Recent Federal Court Rulings on Daubert Challenges to Plaintiffs’ Experts,” (Aug. 30, 2012).

The breadth and depth of error of the trial court’s analysis, or lack thereof, remains, however, to be explored.

 

STATISTICAL SIGNIFICANCE

The Chantix MDL court notes several times that the defendant “harped” on this or that issue; the reader might think the defendant was a music label rather than a pharmaceutical manufacturer.  One of the defendant’s chords that failed to resonate with the trial judge was the point that the plaintiffs’ expert witnesses relied upon statistically non-significant results.  Here is how the trial court reported the issue:

“While the defendant repeatedly harps on the importance of statistically significant data, the United States Supreme Court recently stated that ‘[a] lack of statistically significant data does not mean that medical experts have no reliable basis for inferring a causal link between a drug and adverse events …. medical experts rely on other evidence to establish an inference of causation.’ Matrixx Initiatives, Inc. v. Siracsano, 131 S.Ct. 1309, 1319 (2011).”

Chantix at 22.

Well, it was only a matter of time before the Supreme Court’s dictum would be put to this predictably erroneous interpretation.  SeeThe Matrixx Oversold” (April 4, 2011).

Matrixx involved a motion to dismiss the complaint, which the trial court granted, but the Ninth Circuit reversed.  No evidence was offered; nor was any ruling that evidence was unreliable or insufficient at issue. The Supreme Court affirmed the Circuit on the issue whether pleading statistical significance was necessary.  Matrixx Initiatives took this position in the hopes of avoiding the merits, and so the issue of causation was never before the Supreme Court.  A unanimous Supreme Court held that because FDA regulatory action does not require reliable evidence to support a causal conclusion, pleading materiality for a securities fraud suit does not require an allegation of causation, and thus does not require an allegation of statistically significant evidence. Everything that the Court said about statistical significance and causation was obiter dictum, and rather ill-considered dictum at that.

The Supreme Court thus wandered far beyond its holding to suggest that courts “frequently permit expert testimony on causation based on evidence other than statistical significance.” Matrixx Initiatives, Inc. v. Siracsano, 131 S.Ct. 1309, 1319 (2011) (citing Wells v. Ortho Pharm. Corp., 788 F.2d 741, 744-745 (11th Cir.1986)).  But the Supreme Court’s citation to Wells, in Justice Sotomayor’s opinion, failed to support the point she was trying to make, or the decision that the trial court announced in Chantix.

Wells involved a claim of birth defects caused by the use of spermicidal jelly contraceptive.  At least one study reported a statistically significant increase in detected birth defects over the expected rate.  Wells v. Ortho Pharmaceutical Corp., 615 F. Supp. 262 (N.D.Ga. 1985), aff’d, and rev’d in part on other grounds, 788 F.2d 741 (11th Cir.), cert. denied, 479 U.S.950 (1986).  Wells is not an example of a case in which an expert witness opined about causation in the absence of a scientific study with statistical significance. Of course, finding statistical significance is just the beginning of assessing the causality of an association; the Wells case was and remains notorious for the expert witness’s poor assessment of all the determinants of scientific causation, including the validity of the studies relied upon.

The Wells decision was met with severe criticism in the 1980s.  The decision was widely criticized for its failure to evaluate the entire evidentiary display, as well as for its failure to rule out bias and confounding in the studies relied upon by the plaintiff.  See, e.g., James L. Mills and Duane Alexander, “Teratogens and ‘Litogens’,” 15 New Engl. J. Med. 1234 (1986); Samuel R. Gross, “Expert Evidence,” 1991 Wis. L. Rev. 1113, 1121-24 (1991) (“Unfortunately, Judge Shoob’s decision is absolutely wrong. There is no scientifically credible evidence that Ortho-Gynol Contraceptive Jelly ever causes birth defects.”). See also Editorial, “Federal Judges v. Science,” N.Y. Times, December 27, 1986, at A22 (unsigned editorial);  David E. Bernstein, “Junk Science in the Courtroom,” Wall St. J. at A 15 (Mar. 24,1993) (pointing to Wells as a prominent example of how the federal judiciary had embarrassed the American judicial system with its careless, non-evidence based approach to scientific evidence). A few years later, another case in the same judicial district, against the same defendant, for the same product, resulted in the grant of summary judgment.  Smith v. Ortho Pharmaceutical Corp., 770 F. Supp. 1561 (N.D. Ga. 1991) (supposedly distinguishing Wells on the basis of more recent studies).

Neither the Justices in Matrixx Initiatives nor the trial court in Chantix can be excused for their poor scholarship, or their failure to note that Wells was overruled sub silentio by the Supreme Court’s own subsequent decisions in Daubert, Joiner, Kumho Tire, and Weisgram.  And if the weight of precedent did not kill the concept, then there is the simple matter of a supervening statute:  the 2000 amendment of Rule 702, of Federal Rules of Evidence.

 

CONFUSING REGULATORY ACTION WITH CAUSAL ASSESSMENTS

The Supreme Court in Matrixx Initiatives was careful to distinguish causal judgments from regulatory action, but then went on in dictum to conflate the two.  The trial judge in Chantix showed no similar analytical care.  Judge Johnson held that the asserted absence of statistical significance was not a basis for excluding plaintiffs’ expert witnesses’ opinions on general causation.  Her Honor adverted to the Matrixx Initiatives dictum that the FDA “does not apply any single metric for determining when additional inquiry or action is necessary.” Matrixx, 131 S.Ct. at 1320.  Chantix at 22.  Judge Johnson noted

“that ‘[n]ot only does the FDA rely on a wide range of evidence of causation, it sometimes acts on the basis of evidence that suggests, but does not prove, causation…. the FDA may make regulatory decisions against drugs based on postmarketing evidence that gives rise to only a suspicion of causation’.  Matrixx, id. The court declines to hold the plaintiffs’ experts to a more exacting standard as the defendant requests.”

Chantix at 23.

In the trial court’s analysis, the difference between regulatory action and civil litigation fact adjudication is obliterated.  This, however, is not the law of the United States, which has consistently acknowledged the difference. See, e.g., IUD v. API, 448 U.S. 607, 656 (1980)(“agency is free to use conservative assumptions in interpreting the data on the side of overprotection rather than underprotection.”)

As the Second Edition of the Reference Manual on Scientific Evidence (which was the out-dated edition cited by the court in Chantix) explains:

“[p]roof of risk and proof of causation entail somewhat different questions because risk assessment frequently calls for a cost-benefit analysis. The agency assessing risk may decide to bar a substance or product if the potential benefits are outweighed by the possibility of risks that are largely unquantifiable because of presently unknown contingencies. Consequently, risk assessors may pay heed to any evidence that points to a need for caution, rather than assess the likelihood that a causal relationship in a specific case is more likely than not.”

Margaret A. Berger, “The Supreme Court’s Trilogy on the Admissibility of Expert Testimony,” in Reference Manual On Scientific Evidence at 33 (Fed. Jud. Ctr. 2d. ed. 2000).

 

CONCLUSIONS VS. METHODOLOGY

Judge Johnson insisted that the “court’s focus was solely on the principles and methodology, not on the conclusions they generate.” Chantix at 9.  This insistence, however, is contrary to the established law of Rule 702.

Although the United States Supreme Court attempted, in Daubert, to draw a distinction between the reliability of an expert witness’s methodology and conclusion, that Court soon realized that the distinction was flawed. If an expert witness’s proffered testimony is discordant from regulatory and scientific conclusions, a reasonable, disinterested scientists would be led to question the reliability of the testimony’s methodology and its inferences from facts and data, to its conclusion.  The Supreme Court recognized this connection in General Electric v. Joiner, and the connection between methodology and conclusions was ultimately incorporated into a statute, the revised Federal Rule of Evidence 702:

“[I]f scientific, technical or other specialized knowledge will assist the trier of fact to understand the evidence or to determine a fact in issue, a witness qualified as an expert by knowledge, skill, experience, training or education, may testify thereto in the form of an opinion or otherwise, if

  1. the testimony is based upon sufficient fact or data,
  2. the testimony is the product of reliable principles and methods; and
  3. the witness has applied the principles and methods reliably to the facts.”

When the testimony is a conclusion about causation, the Rule 702 directs an inquiry into whether that conclusion is based upon sufficient fact or data, and whether that conclusion is the product of reliable principles and methods.  The court’s focus should indeed be on the conclusion as well the methodology claimed to generate the conclusion.  The Chantix MDL court thus ignored the clear mandate of a statute, Rule 702(1), and applied dictum from Daubert, superseded by Joiner, and an Act of Congress.  The ruling is thus legally invalid to the extent it departs from the statute.

 

EPIDEMIOLOGY

For obscure reasons, Judge Johnson sought to deprecate the need to rely upon epidemiologic studies, whether placebo-controlled clinical trials or observational studies.  See Chantix at 25 (citing Rider v. Sandoz Pharm. Corp., 295 F.3d 1194, 1198-99 (11 Cir.2002)). Of course, the language cited in Rider came from a pre-Daubert, pre-Joiner, case, Wells v. Ortho Pharm. Corp., 788 F.2d 741, 745 (11th Cir.1986) (holding that “a cause-effect relationship need not be clearly established by animal or epidemiological studies”).  This dubious legal lineage cannot support the glib dismissal of the need for epidemiologic evidence.

 

WEIGHT OF THE EVIDENCE (WOE)

According to Judge Johnson, plaintiffs’ expert witness Shira Kramer considered all the evidence relevant to Chantix and neuropsychiatric side effects, in what Kramer described as a “weight of the evidence” analysis.  Chantix at 26.  In her report, Kramer had written that determinations about the weight of evidence are “subjective interpretations” based upon “various lines of scientific evidence. Id. (citing and quoting Kramer’s report). Kramer also claimed that every scientist “brings a unique set of experiences, training and expertise …. Philosophical differences exist between experts…. Therefore, it is not surprising that differences of opinion exist among scientists. Such differences of opinion are not necessarily evidence of flawed scientific reasoning or methodology, but rather differences in judgment between scientists.” Id.

Without any support from scientific literature, or the Reference Manual on Scientific Evidence, Judge Johnson accepted Kramer’s explanation of a totally subjective, unprincipled approach as a scientific methodology.  Not surprisingly, Judge Johnson cited the First Circuit’s embrace of a similar vacuous embrace of a WOE analysis in Milward v. Acuity Specialty Products Group, Inc. 639 F.3d 11, 22 (1st Cir. 2011).  Chantix at 51.

 

CHERRY PICKING

Judge Johnson noted, contrary to her earlier suggestion that Shira Kramer had considered all the studies, that Kramer had excluded data from her analysis.  Kramer’s basis for excluding data may have been based upon pre-specified exclusionary principles, or they may have been completely ad hoc, as were the lack of weighting principles in her WOE analysis.  In its gatekeeping role, however, the trial court expressed complete indifference to Kramer’s selectivity in excluding data.  “Why Dr. Kramer chose to include or exclude data from specific clinical trials is a matter for cross-examination.”  Chantix at 27.  This indifference is an abdication of the court’s gatekeeping responsibility.

 

POWER

The trial court attempted to justify its willingness to mute defendant’s harping on statistical significance by adverting to the concept of statistical power:

“Oftentimes, epidemiological studies lack the statistical power needed for definitive conclusions, either because they are small or the suspected adverse effect is particularly rare. Id. [Michael D. Green et al., “Reference Guide on Epidemiology,” in Reference Manual on Scientific Evidence 333, 335 (Fed. Judicial Ctr. 2d ed. 2000)… .

Chantix at 29 n.16.

To be fair to the trial court, the Reference Manual invited this illegitimate use of statistical power because it, at times, omits the specification that statistical power requires not only a level of statistical significance to be attained, but also a specified alternative hypothesis to assess power.  See Power in the Courts — Part One; Power in the Courts — Part Two.  The trial court offered no alternative hypothesis against which any measure of power was to be assessed.

Judge Johnson did not report any power analyses, and she certainly did not report any quantification of power or lack thereof against some specific alternative hypothesis.  Judge Johnson’s invocation of power was just that – power used arbitrarily, without data, evidence, or reason.

 

CONFIDENCE INTERVALS

As with the invocation of statistical power, the trial also invoked the concept of confidence intervals to suggest that such intervals provide a more refined approach to assessing statistical significance:

“A study found to have ‘results that are unlikely to be the result of random error’ is ‘statistically significant’. Reference Guide on Epidemiology, supra, at 354. Statistical significance, however, does not indicate the strength of an association found in a study. Id. at 359. ‘A study may be statistically significant but may find only a very weak association; conversely, a study with small sample sizes may find a high relative risk but still not be statistically significant.’ Id. To reach a ‘more refined assessment of appropriate inferences about the association found in an epidemiologic study’, researchers rely on another statistical technique known as a confidence interval’. Id. at 360.”

Chantix at 30 n.17.  True, true, but immaterial.  The trial court, again, never carries through with the direction given by the Reference Manual.  Not a single confidence interval is presented.  No confidence intervals are subjected to this more refined assessment.  Why have more refined assessments when even the cruder assessments are not done?

 

OPEN ADMISSIONS IN SCHOOL OF EXPERT WITNESSING

The trial court somehow had the notion that all it had to do was state that every disputed fact and opinion went to the weight not the admissibility, and then pass to a presumably more scientifically literate jury.  To be sure, the court engaged in a good deal of hand waving, going through the motions of deciding a contested issues.  Not only did the Judge Johnson smash poor Pfizer’s harp, Her Honor unhinged the gate that federal judges are supposed to keep.  Chantix declares that it is now open admissions for expert witnesses testifying to causation in federal cases.  This is a judgment in search of an appeal.