For your delectation and delight, desultory dicta on the law of delicts.

WOE — Zoloft Escapes a MDL While Third Circuit Creates a Conceptual Muddle

July 31st, 2017

Multidistrict Litigations (MDLs) can be “muddles” that are easy to get in, but hard to get out of. Pfizer and subsidiary Greenstone fabulously escaped a muddle through persistent lawyering and the astute gatekeeping of a district judge, in the Eastern District of Pennsylvania. That judge, the Hon. Cynthia Rufe, sustained objections to the admissibility of plaintiffs’ epidemiologic expert witness Anick Bérard. When the MDL’s plaintiffs’ steering committee (PSC) demanded, requested, and begged for a do over, Judge Rufe granted them one more chance. The PSC put their litigation industry eggs in a single basket, carried by statistician Nicholas Jewell. Unfortunately for the PSC, Judge Rufe found Jewell’s basket to be as methodologically defective as Bérard’s, and Her Honor excluded Jewell’s proffered testimony. Motions, paper, and appeals followed, but on June 2, 2017, the Third Circuit declared that the PSC and its clients had had enough opportunities to get through the gate. Their baskets of methodological deplorables were not up to snuff. In re Zoloft Prod. Liab. Litig., No. 16-2247 , __ F.3d __, 2017 WL 2385279, 2017 U.S. App. LEXIS 9832 (3d Cir. June 2, 2017) (affirming exclusion of Jewell’s dodgy opinions, which involved multiple methodological flaws and failures to follow any methodology faithfully) [Slip op. cited below as Zoloft].

Plaintiffs Attempt to Substitute WOE for Depressingly Bad Expert Witness Opinion

The ruse of conflating “weight of the evidence,” as used to describe the appellate standard of review for sustaining or reversing a trial court’s factual finding with a purported scientific methodology for inferring causation, was on full display by the PSC in their attack on Judge Rufe’s gatekeeping. In their appellate brief in the Court of Appeals for the Third Circuit, the PSC asserted that Jewell had used a “weight of the evidence method,” even though that phrase, “weight of the evidence” (WOE) was never used in Jewell’s litigation reports. The full context of the PSC’s argument and citations to Milward make clear a deliberate attempt to conflate WOE as an appellate judicial standard for reviewing jury fact finding and a purported scientific methodology. See Appellants’ Opening Brief at 54 (Aug. 10, 2016) [cited as PSC] (asserting that “[a]t all times, the ultimate evaluation of the weight of the evidence is a jury question”; citing Milward v. Acuity Specialty Products Group, Inc., 639 F.3d 11, 20 (1st Cir. 2011), cert. denied, 133 S. Ct. 63 (2012).

Having staked the ground that WOE is akin to a jury’s factual finding, and thus immune to any but the most extraordinary trial court action or appellate intervention, the PSC then pivoted to claim that Jewell’s WOE-ful method was nothing much more than an assessment of “the totality of the available scientific evidence, guided by the well-accepted Bradford-Hill criteria.” PSC at 3, 4, 7. This maneuver allowed the PSC to argue, apparently with a straight face, that WOE methodology as used by Jewell, had been generally accepted in the scientific community, as well as by the Third Circuit, in previous cases in which the court accepted the use of Bradford Hill’s considerations as a reliable method for establishing general causation. See PSC at 4 (citing Gannon v. United States, 292 F. App’x 170, 173 n.1 (3d Cir. 2008)). Jewell then simply plugged in his expertise and “40 years of experience,” and the desired conclusion of causation popped out. Id. Quod erat demonstrandum.

In pressing its point, the PSC took full advantage of loose, inaccurate language from the American Law Institute’s Restatement’s notorious comment C:

No algorithm exists for applying the Hill guidelines to determine whether an association truly reflects a causal relationship or is spurious.”

PSC at 33-34, citing Restatement (Third) of Torts: Physical and Emotional Harm § 28 cmt. c(3) (2010). Well true, but the absence of a mathematical algorithm hardly means that causal judgments are devoid of principles and standards. The PSC was undeterred, by text or by shame, from equating an unarticulated use of WOE methodology with some vague invocation of Bradford Hill’s considerations for evaluating associations for causality. See PSC at 43 (citing cases that never mentioned WOE but only Bradford Hill’s 50-plus year old heuristic as somehow supporting the claimed identity of the two approaches)1.

Pfizer Rebuffs WOE

Pfizer filed a comprehensive brief that unraveled the PSC’s duplicity. For unknown reasons, tactical or otherwise, however, Pfizer did not challenge the specifics of PSC’s equation of WOE with an abridged, distorted application of Bradford Hill’s considerations. See generally Opposition Brief of Defendants-Appellees Pfizer Inc., Pfizer International LLC, and Greenstone LLC [cited as Pfizer]. Perhaps given page limits and limited judicial attention spans, and just how woefully bad Jewell’s opinions were, Pfizer may well have decided that a more directed approach of assuming arguendo WOE’s methodological appropriateness was a more economical, pragmatic approach. A close reading of Pfizer’s brief, however, makes clear that it never conceded the validity of WOE as a scientific methodology.

Pfizer did point to the recasting of Jewell’s aborted attempt to apply Bradford Hill considerations as an employment of WOE methodology. Pfizer at 46-47. The argument reminded me of Abraham Lincoln’s famous argument:

How many legs does a dog have if you call his tail a leg?


Saying that a tail is a leg doesn’t make it a leg.”

Allen Thorndike Rice, Reminiscences of Abraham Lincoln by Distinguished Men of His Time at 242 (1909). Calling Jewell’s supposed method WOE or Bradford Hill or WOE/Bradford Hill did not cure the “fatal methodological flaws in his opinions.” Pfizer at 47.

Pfizer understandably and properly objected to the PSC’s attempt to cast Jewell’s “methodology” at such a high level of generality that any consideration of the many instances of methodological infidelity would be relegated to mere jury questions. Acquiescence in the PSC’s rhetorical move would constitute a complete abandonment of the inquiry whether Jewell had used a proper method. Pfizer at 15-16.

Interestingly, none of the amici curiae addressed the slippery WOE arguments advanced by the PSC. See generally Brief of Amici Curiae American Tort Reform Ass’n & Pharmaceutical Research and Manufacturers of America (Oct. 18, 2016); Brief of Washington Legal Fdtn. as Amicus Curiae (Oct. 18, 2016). There was no meaningful discussion of WOE as a supposedly scientific methodology at oral argument. See Transcript of Oral Argument in In re Zoloft Prod. Liab. Litig., No. 16-2247 (Jan. 25, 2017).

The Third Circuit Acknowledges that Some Methodological Infelicities, Flaws, and Fallacies Are Properly the Subject of Judicial Gatekeeping

Fortunately, Jewell’s methodological infidelities were easily recognized by the Circuit judges. Jewell treated multiple studies, which were nested within one another, and thus involved overlapping and included populations, as though they were independent verifications of the same hypothesis. When the population at issue (from the Danish cohort) was included in a more inclusive pan-Scandivanian study, the relied-upon association dissipated, and Jewell utterly failed to explain or account for these data. Zoloft at 5-6.

Jewell relied upon a study by Anick Bérard, even though he later had to concede that the study had serious flaws that invalidated its conclusions, and which flaws caused him to have a lack of confidence in the paper’s findings.2 In another instance, Jewell relied innocently upon a study that purported to report a statistically significant association, but the authors of this paper were later required by the journal, The New England Journal of Medicine, to correct the very calculated confidence interval upon which Jewell had relied. Despite his substantial mathematical prowess, Jewell missed the miscalculation and relied (uncritically) upon a finding as statistically significant when in fact it was not.

Jewell rejected a meta-analysis of Zoloft studies for questionable methodological quibbles, even though he had relied upon the very same meta-analysis, with the same methodology, in his litigation efforts involving Prozac and birth defects. Not to be corralled by methodological punctilio, Jewell conducted his own meta-analysis with two studies Huybrechts (2014) and Jimenez-Solem (2012), but failed to explain why he excluded other studies, the inclusion of which would have undone his claimed result. Zoloft at 9. Jewell purported to reanalyze and recalculate point estimates in two studies, Jimenez-Solem (2012) and Huybrechts (2014), without any clear protocol or consistency in his approach to other studies. Zoloft at 9. The list goes on, but in sum, Jewell’s handling of these technical issues did not inspire confidence, either in the district or in the appellate court.

WOE to the Third Circuit

The Circuit gave the PSC every conceivable break. Because Pfizer had not engaged specifically on whether WOE was a proper, or any kind of, scientific method, the Circuit treated the issue as virtually conceded:

Pfizer does not seem to contest the reliability of the Bradford Hill criteria or weight of the evidence analysis generally; the dispute centers on whether the specific methodology implemented by Dr. Jewell is reliable. Flexible methodologies, such as the “weight of the evidence,” can be implemented in multiple ways; despite the fact that the methodology is generally reliable, each application is distinct and should be analyzed for reliability.”

Zoloft at 18. The Court acknowledged that WOE arose only in the PSC’s appellate brief, which would have made the entire dubious argument waived under general appellate jurisdictional principles, but the Court, in a footnote, indulged the assumption, “for the sake of argument,” that WOE was Jewell’s purported method from the inception. Zoloft at 18 n. 39. Without any real evidentiary support or analysis or concession from Pfizer, the Circuit accepted that WOE analyses were “generally reliable.” Zoloft at 21.

The Circuit accepted, rather uncritically, that Jewell used a combination of WOE analysis and Bradford Hill considerations. Zoloft at 17. Although Jewell had never described WOE in his litigation report, and WOE was not a feature of his hearing testimony, the Circuit impermissibly engrafted Carl Cranor’s description of WOE as involving inference to the best explanation. Zoloft at 17 & n.37, citing Milward v. Acuity Specialty Prods. Grp., Inc., 639 F.3d 11, 17 (1st Cir. 2011) (internal quotation marks and citation omitted).

There was, however, a limit to the Circuit’s credulousness and empathy. As the Court noted, there must be some assurance that the purported Bradford Hill/WOE method is something more than a “mere conclusion-oriented selection process.” Zoloft at 20. Ultimately, the Court put its markers down for Jewell’s putative WOE methodology:

there must be a scientific method of weighting that is used and explained.”

Zoloft at 20. Calling the method WOE did not, in the final analysis, exclude Jewell from Rule 702 gatekeeping. Try as the PSC might, there was just no mistaking Jewell’s approach as anything other than a crazy patchwork quilt of numerical wizardry in aid of subjective, result-oriented conclusion mongering.

In the Court’s words:

we find that Dr. Jewell did not 1) reliably apply the ‘techniques’ to the body of evidence or 2) adequately explain how this analysis supports specified Bradford Hill criteria. Because ‘any step that renders the analysis unreliable under the Daubert factors renders the expert’s testimony inadmissible’, this is sufficient to show that the District Court did not abuse its discretion in excluding Dr. Jewell’s testimony.”

Zoloft at 28. As heartening as the Circuit’s conclusion is, the Court’s couching its observation as a finding (“we find”) is disheartening with respect to the Third Circuit’s apparent inability to distinguish abuse-of-discretion review from de novo appellate findings. Equally distressing is the Court’s invocation of Daubert factors, which were dicta in a Supreme Court case that was superseded by an amended statute over 17 years ago, in Federal Rule of Evidence 702.

On the crucial question whether Jewell had engaged in an unreliable application of methods or techniques that superficially, at a very high level of generality, claim to be generally accepted, the Court stayed on course. The Court “found” that Jewell had applied techniques, analyses, and critiques so obviously inconsistently that no amount of judicial indulgence, assumptions arguendo, or careless glosses could save Jewell and his fatuous opinions from judicial banishment. Zoloft 28-29. Returning to the correct standard of review (abuse of discretion), but the wrong governing law (Daubert instead of Rule 702), the Court announced that:

[b]ecause ‘any step that renders the analysis unreliable under the Daubert factors renders the expert’s testimony inadmissible’, this is sufficient to show that the District Court did not abuse its discretion in excluding Dr. Jewell’s testimony.”

Zoloft at 21 n.50 (citation omitted). The Court found itself unable to say simply and directly that “the MDL trial court decided the case well within its discretion.”

The Zoloft case was not the Third Circuit’s first WOE rodeo. WOE had raised its unruly head in Magistrini v. One Hour Martinizing Dry Cleaning, 180 F. Supp. 2d 584, 602 (D.N.J. 2002), aff’d, 68 F. App’x 356 (3d Cir. 2003), where an expert witness, David Ozonoff, offered what purported to be a WOE opinion. The Magistrini trial court did not fuss with the assertion that WOE was generally reliable, but took issue with how Ozonoff tried to pass off his analysis as a comprehensive treatment of the totality of the evidence. In Magistrini, Judge Hochberg noted that regardless of the rubric of the methodology, the witness must show that in conducting a WOE analysis:

all of the relevant evidence must be gathered, and the assessment or weighing of that evidence must not be arbitrary, but must itself be based on methods of science.”

Magistrini, 180 F. Supp. 2d at 602. The witness must show that the methodology is more than a “mere conclusion-oriented selection process,” and that it has a “a scientific method of weighting that is used and explained.” Id. at 607. Asserting the use of WOE was not an excuse or escape from judicial gatekeeping as specified by Rule 702.

Although the Third Circuit gave the Zoloft MDL trial court’s findings a searching review (certainly much tougher than the prescribed abuse-of-discretion review), the MDL court’s finding that Jewell “failed to consistently apply the scientific methods he articulates, has deviated from or downplayed certain well-established principles of his field, and has inconsistently applied methods and standards to the data so as to support his a priori opinion” were ultimately vindicated by the Court of Appeals. Zoloft at 10.

All’s well that ends well. Perhaps. It remains unfortunate, however, that a hypothetical method, WOE — which was never actually advocated by the challenged expert witnesses, which lacks serious support in the scientific community, and which was merely assumed arguendo to be valid — will be taken by careless readers to have been endorsed the Third Circuit.

1 Among the cases cited without any support for the PSC’s dubious contention were Gannon v. United States, 292 F. App’x 170, 173 n.1 (3d Cir. 2008); Bitler v. A.O. Smith Corp., 391 F.3d 1114, 1124-25 (10th Cir. 2004); In re Joint E. & S. Dist. Asbestos Litig., 52 F.3d 1124, 1128 (2d Cir. 1995); In re Avandia Mktg., Sales Practices & Prods. Liab. Litig., No. 2007-MD-1871, 2011 WL 13576, at *3 (E.D. Pa. Jan. 4, 2011) (“Bradford-Hill criteria are used to assess whether an established association between two variables actually reflects a causal relationship.”).

2 Anick Bérard, Sertraline Use During Pregnancy and the Risk of Major Malformations, 212 Am. J. Obstet. Gynecol. 795 (2015).

Weight of the Evidence in Science and in Law

July 29th, 2017

woe to that man by whom the offense cometh”

         Matthew 18:7

Weight of the evidence (WOE) has cropped up again in recent trial and appellate court proceedings involving the admissibility of scientific expert witness opinion testimony. With some consistency, the WOE approach advocated is vacuous. The proponents of WOE do not specify what type of evidence is considered, whether all evidence was considered, or how competing and conflicting evidence was weighed.

Interpreted sympathetically, WOE might be taken to mean that “scientific judgment” was exercised with respect to causal inference, without describing exactly what was done. Although sympathetic, this interpretation renders the purported methodology meaningless. WOE-ful scientists might just as well say that they used scientific method. Not surprisingly, WOE is absent from virtually all major epidemiology textbooks

Despite the vacuity of WOE, or because of it, some lawyers, who constitute the lawsuit industry, are particularly fond of WOE.1 Expert witnesses who support the lawsuit industry have defended their “right” to inflict WOE on the litigation system, tooth and nail.2

Carl Cranor, a philosophy professor and a hired expert witness in litigation for plaintiffs’ counsel, has written about WOE and attempted to defend WOE as a scientific methodology. Cranor has caricaturized criticisms of WOE, including mine, by suggesting that the International Agency for Research on Cancer’s use of WOE rebuts my suggestion that WOE is no method at all.3 Cranor’s defense fails, however, because IARC’s method, for all its deficiencies, never invokes a method mired in WOE.

Perhaps the Lawsuit Industry likes WOE as much as it likes the equally vague term, “link.” WOE frees them from the requirement of any meaningful methodology, which means that any conclusion is possible. Under WOE, any conclusion can survive gatekeeping as an opinion. WOE frees the putative expert witness from the need to consider the quality of research. WOE-ful authors such as Carl Cranor invoke WOE or seek to inflict WOE without mentioning the crucial “nuts and bolts” of scientific inference, such as concepts of

  • Internal and external validity
  • Assessment of random error
  • Assessment of known and residual confounding
  • Known and potential threats to validity in
  • Appropriate methods of systematic review
  • Appropriate synthesis across studies, such as systematic review and meta-analysis

These important concepts are lost in the miasma of WOE.

In the published scientific literature, it is a commonplace that WOE is either poorly or not defined and specified. The phrase is vague and ambiguous; its use, inconsistent.4  Even authors sympathetic to the WOE mission have reluctantly concluded that the term is most often used in a way that “does not lend itself to transparency or repeatability except in simple cases.”5

Another reason that WOE resonates so strongly with the Lawsuit Industry is that having expert witnesses proclaim WOE as their methodology permits trial counsel to claim that the proffered opinions are immune to gatekeeping because, after all, weight-of-the-evidence questions are for the jury. Lawyers learn early on about WOE factual issues in appellate review of a wide variety of evidentiary and sufficiency issues in criminal and civil cases.6 Unless against the great WOE, WOE questions are for the jury.

Even venerable judges fall for this semantic confusion. In 1995, the Second Circuit, before the major revision of Rule 702, in 2000, noted that in discharging their gatekeeping role, trial judges do not assume:

“‘the role of St. Peter at the gates of heaven, performing a searching inquiry into the depth of an expert witness’s soul’ that would ‘inexorably lead to evaluating witness credibility and weight of the evidence, the ageless role of the jury’.”

McCullock v. H.B. Fuller Co., 61 F.3d 1038, 1045 (2d Cir.1995) (internal citations omitted).

Of course, the expert witness’s soul is not at issue, but his methodology is. More important, however, note how the appellate court adverted to “weight of the evidence” as something that the jury must evaluate, along with witness credibility. The expert witness WOE litigation strategy deliberately trades upon the confusion between WOE in the allocation between judge and jury, and valid scientific methodology in causal inference. McCullock is proof that judges can be, and are, bamboozled by the litigation strategy.

Twenty years after McCullock, federal appellate judges are still falling for the deliberate confusion between legal and scientific WOE. The Ninth Circuit recently held that the reliability test of Federal Rule of Evidence 702 is:

“‘is not the correctness of the expert’s conclusions but the soundness of his methodology’, and when an expert meets the threshold established by Rule 702, the expert may testify and the fact finder decides how much weight to give that testimony. Challenges that go to the weight of the evidence are within the province of a fact finder, not a trial court judge. A district court should not make credibility determinations that are reserved for the jury.”

City of Pomona v. SQM North America Corp., 750 F.3d 1036, 1044 (9th Cir. 2014) (internal citation omitted), cert. denied, 135 S. Ct. 870 (2014). Characterizing a methodological dispute as one that “merely” concerns the “weight of the evidence” is a strategy to remove the dispute from judicial gatekeeping altogether.

Recently, the Third Circuit displayed this confusion of WOE with methodological impropriety by mischaracterizing failure to correct for multiple testing as merely an improper calculation that ordinarily goes to the weight of the evidence, not its admissibility. Karlo v. Pittsburgh Glass Works, LLC, 849 F.3d 61, 83 (3d Cir. 2017).

The Third Circuit, in Karlo, cited to a Supreme Court case that predated Daubert v. Merrell Dow Pharmaceuticals, 509 U.S. 579 (1993), and which did involve any Rule 702 challenge to the use of a flawed statistical analysis. In Bazemore v. Friday, 478 U.S. 385, 400 (1986), plaintiffs sued as a class for employment discrimination, and sought to show the discrimination through the use of a regression analysis. The defense challenged the plaintiffs’ regression on grounds that key variables were omitted. The Court rejected a sufficiency challenge to a finding of discrimination in plaintiffs’ class action, and noted:

Normally, failure to include variables will affect the analysis’ probativeness, not its admissibility.”

The lesson of the last two decades of judicial gatekeeping is that methodological infirmity will affect both probitiveness and admissibility7. Courts cannot escape their important gatekeeping duties by shifting their responsibility to juries under the guise of WOE.

2 See Schachtman, “Desultory Thoughts on Milward v. Acuity Specialty Products,” (Oct. 2015).

3 Carl F. Cranor, Toxic Torts: Science, Law, and the Possibility of Justice 146 (2d ed. 2016) (citing and selectively quoting from Schachtman, WOE-fully Inadequate Methodology – An Ipse Dixit By Another Name” (May 1, 2012)).

4 See Charles Menzie, Miranda Hope Henning, Jerome Cura, Kenneth Finkelstein, Jack Gentile, James Maughan, David Mitchell, Stephen Petron, Bonnie Potocki, Susan Svirsky & Patti Tyler, “A weight-of-evidence approach for evaluating ecological risks; report of the Massachusetts Weight-of-Evidence Work Group,” 2 Human Ecological Risk Assessment 277, 279 (1996) (“although the term ‘weight of evidence’ is used frequently in ecological risk assessment, there is no consensus on its definition or how it should be applied”); Sheldon Krimsky, “The weight of scientific evidence in policy and law,” 95 Am. J. Pub. Health S129 (2005) (“However, the term [WOE] is applied quite liberally in the regulatory literature, the methodology behind it is rarely explicated.”); V. H. Dale, G.R. Biddinger, M.C. Newman, J.T. Oris, G.W. Suter II, T. Thompson, et al., “Enhancing the ecological risk assessment process,” 4 Integrated Envt’l Assess. Management 306 (2008) (“An approach to interpreting lines of evidence and weight of evidence is critically needed for complex assessments, and it would be useful to develop case studies and/or standards of practice for interpreting lines of evidence.”);  Douglas L. Weed, “Weight of Evidence: A Review of Concept and Methods,” 25 Risk Analysis 1545 (2005) (noting the “lack of definition of the term weight of evidence, multiple uses of the term and a lack of consensus about its meaning, and the many different kinds of weights, both qualitative and quantitative which can be used in risk assessment”); R.G. Stahl Jr., “Issues addressed and unaddressed in EPA’s ecological risk guidelines,” 17 Risk Policy Report 35 (1998) (noting that U.S. Environmental Protection Agency’s guidelines for ecological weight-of-evidence approaches to risk assessment fail to provide guidance); Glenn W. Suter, Susan M. Cormier, “Why and how to combine evidence in environmental assessments:  Weighing evidence and building cases,” 409 Sci. Total Env’t 1406, 1406 (2011) (noting arbitrariness and subjectivity of WOE “methodology”).

5 See Igor Linkov, Drew Loney, Susan Cormier, F. Kyle Satterstrom, and Todd Bridges, “Weight-of-evidence evaluation in environmental assessment: review of qualitative and quantitative approaches,” 407 Sci. Total Env’t 5199, 5203 (2009).

6 See, e.g., People v. Collier, 146 A.D.3d 1146, 1147-48, 2017 NY Slip Op 00342 (N.Y. App. Div. 3d Dep’t, Jan. 19, 2017) (rejecting appeal based upon defendant’s claim that conviction was against “weight of the evidence”); Venson v. Altamirano, 749 F.3d 641, 656 (7th Cir. 2014) (noting “new trial is appropriate if the jury’s verdict is against the manifest weight of the evidence”).

7 David L. Faigman, Christopher Slobogin & John Monahan, “Gatekeeping Science: Using the Structure of Scientific Research to Distinguish Between Admissibility and Weight in Expert Testimony,” 110 Northwestern L. Rev. 859, 865 (2016) (“An expert economist in an employment discrimination case who admittedly fails to control for a key variable such as seniority or wage structure in a regression analysis has committed a general error that should lead to exclusion by a judge… .”).

Slemp Trial Part 5 – Daniel W. Cramer

July 24th, 2017

The case of talc and ovarian cancer is a difficult and close case on general causation. Although I do not believe that the plaintiffs have made their case, their causal claims do not have the usual earmarks of “junk science,” so readily visible in many other litigations, such as the Zoloft birth defects cases.

Dr. Daniel Cramer is a physician and an epidemiology. He holds the title of professor of epidemiology at the Harvard University Chan School Of Public Health, as well as a professor of obstetrics, gynecology, and reproductive biology, at the Harvard Medical School. The plaintiffs called Cramer to testify on causation issues.

Cramer could have been purely duplicative as a witness, but he was used primarily on specific causation with a big boost on general causation because of his many publications on talc and ovarian cancer (a subject generally missing from Graham Colditz’s C.V.). The planned testimony for Cramer was to try to present the causal attribution of Slemp’s tumor to talc, with the understanding that since specific implied general causation, the plaintiff would obtain corroborating testimony on general causation as well.

With respect to Slemp’s known risk factors, such as her massive obesity and heavy smoking history, Cramer attempted to quantify her ex ante risks based upon her medical chart and from using risk ratios from available epidemiologic studies. Predictably, Cramer tried to diminish these ex ante risks by a highly selective reading of Slemp’s charts, but he ably deflected cross-examination criticisms by characterizing questions as quibbles and volunteering that he was not trying to ascribe plaintiff’s ovarian cancer exclusively to talc. Similarly, Cramer attempted to present the highest ex ante risk ratio for Slemp’s talc exposure, through his characterizations of her case as involving bilateral tumors and other features. Cramer tried to diminish the risk factor of obesity by claiming that fat women use talc more and that there was “synergy” between obesity and talc use. Cramer never described the evidentiary basis for this claimed synergy, or whether it was multiplicative or something less dramatic.

Interestingly, risk ratios from groups (epidemiologic studies) were used to describe her individual risks. The defense did not actively challenge this procedure. The premise of Cramer’s approach was that if an individual patient had a previous exposure or lifestyle variable that has been causally associated with ovarian cancer, then those exposures and lifestyle variables all participating in actually causing the patient’s cancer. As noted in the summary of Graham Colditz’s testimony, this assumption by Cramer is disputed. Cramer never attempted to justify the assumption by reference to any body of scientific evidence, or text. For Mrs. Slemp, Cramer opined that talc (as well as obesity and smoking) caused her serous borderline ovarian tumors. This conclusion was driven by his assumption that if Slemp had an exposure to a known cause of ovarian cancer, then it must have played a “substantial” role in causing the cancer.


The defense vigorously challenged Cramer for having failed to discuss causation in his publications. Most of these publications were epidemiologic studies, which did not necessarily provide an opportunity for full-ranging discussions of causal conclusions. Cramer effectively parried by noting that causation is not established by a single study, and single-study reports were not an appropriate vehicle for a full review and analysis of causation. As for his reviews and opinion pieces, Cramer defended his failure to state a clear causal conclusion on grounds that he had urged warning labels for personal talc products, and that a causal conclusion was not needed to justify such a warning because even a potential risk of ovarian cancer outweighed the negligible benefit of using talc in personal hygiene.

The defense plowed on with its claim that many studies lacked statistical significance, but Cramer generally lost defense counsel in technical details. For Cramer’s estimation of Slemp’s ex ante risk ratio from talc exposure, the defense challenged Cramer’s use of a one-tailed test of significance1. Cramer offered a half-hearted defense of a one-sided test in this context, and used the questions as an opportunity to repeat how low the p-value was with respect to the general association between talc and ovarian cancer. Cramer muddied the water by claiming that this calculation was superseded by further refinement of his estimate, which took into account the bilaterality of Slemp’s tumors, which obviated his one-sided confidence interval calculation. Although the details were not entirely forthcoming, the jury would not likely have seen this exchange as anything other than a quibble. The defense’s claim that Cramer had violated the “rules of epidemiology” never got off the ground, and given that the defense never presented an epidemiologist, the claim of counsel never was grounded in actual evidence.

Counterfactual Causation

The most important cross-examination of Dr. Cramer came from both J & J’s and Imerys’ counsel on the issue of counterfactual causation. Defense counsel asked Cramer, in several different ways, whether Ms. Slemp would have avoided having ovarian cancer if she had not used talc. Cramer stridently and belligerently refused to answer the question. The trial judge showed no interest in obtaining an answer to these questions. In the last effort to obtain a response from Cramer on “but for” causation, Cramer simply refused:

“I am not going to opine on the topic because it is not the task I was charged with.”

In other words, plaintiffs’ counsel and Cramer had discussed his inability to answer the counterfactual question, and decided it was simply better not respond to the question altogether. Since Mr. Smith, plaintiffs’ counsel, did not “task” him with counterfactual causation, Cramer was not going to answer it. Cramer’s intransigence was remarkable because the counterfactual question is an important component to causal inference in epidemiologic science. See, e.g., Michael Höfler, “Causal inference based on counterfactuals,” 5 BMC Med. Research Methodology 28 (2005).

In law, as in science, the counterfactual questions put to Cramer, are essential. Conduct or a product cannot be a legal cause of harm unless that cause alone, or acting in concert with other causes, was enough to result in the injury. Although legal treatises speak of “substantial factor,” the American Law Institute (ALI) defined that phrase (outside the context of overdetermined effects) negatively to make clear that “the actor’s negligent conduct is not a substantial factor in bringing about harm to another if the harm would have been sustained even if the actor had not been negligent.” Restatement (Second) of Torts § 432 (1965).

Given the mischief generated by some courts and commentators2 with respect to “substantial factor,” the ALI abandoned the phrase altogether in its most recent Restatement of the law of torts. In the current Restatement, the ALI has emphasized that the imposition of liability require that the harm claimed is one that would not have occurred in the absence of (“but for”) the defendant’s negligent conduct. Restatement (Third) of Torts: Physical and Emotional Harm § 26 cmt. J (2010); see also June v. Union Carbide Corp., 577 F.3d 1234, 1244 (10th Cir. 2009) (no material difference between Second and Third Restatements; holding that ‘‘a defendant cannot be liable to the plaintiff unless its conduct is either (a) a but-for cause of the plaintiff’s injury or (b) a necessary component of a causal set that (probably) would have caused the injury in the absence of other causes.’’).

Dr. Cramer’s refusal to answer the key counterfactual question about talc and Ms. Slemp’s ovarian cancer points to a lawlessness, both scientific and legal, in the proceedings in St. Louis, Missouri.

1 SeeFAQ: What are the differences between one-tailed and two-tailed tests?” Institute for Digital Research and Education.

2 See David A. Fischer, “Insufficient Causes,” 94 Kent. L. J. 277, 277 (2005-06) (criticizing judicial obtuseness in misinterpreting the earlier Restatement’s use of “substantial factor”).

David Rosner’s Document Repository

July 23rd, 2017

David Rosner and Gerald Markowitz are leftist labor and social historians in Columbia University and City University of New York, respectively. Both are frequently disclosed by plaintiffs’ counsel as expert witnesses on historical issues, and both often testify at asbestos and other personal injury trials1. Markowitz has been excluded in at least one reliability challenge2.

The two historians, who appear so often together on plaintiffs’ designations that they are sometime referred to as a unified persona, Rosnowitz, have create a website, “Project Toxicdocs,” supposedly in an alpha version3.

The Toxic Docs website does not identify Rosner and Markowitz by name as authors or sponsors, but the website’s content and goals bear their indelible stamp, as well as the concordance of their institutional affiliations of Columbia and CUNY. The website promises “[b]lazingly fast” searches and access to previously confidential, classified industry documents on “industrial poisons”:

This dataset and website contain millions of pages of previously secret documents about toxic substances. They include secret internal memoranda, emails, slides, board minutes, unpublished scientific studies, and expert witness reports — among other kinds of documents — that emerged in recent toxic tort litigation.

Over the next couple years, we’ll be constantly adding material from lawsuits involving lead, asbestos, silica, and PCBs, among other dangerous substances. Innovations in parallel and cloud computing have made conversion of these documents into machine-readable, searchable text a far faster process than would have been the case just a decade ago.”

Similar efforts have been put into place for documents collected in tobacco and other litigations4. David Egilman, another regular testifier for the Lawsuit Industry once maintained a website with a large library of documents he relied upon for his ethics and state-of-the-art opinion testimony in various litigations.

A trial run through the “dataset” for the search term “silicosis” turned up 44 documents, most of which had nothing to do with silica or silicosis, and many of which were duplicates. Remarkably, there were no documents from government or labor unions.

We are sure that these historian expert witnesses will improve their efforts to be comprehensive and balanced, with practice.

1 See, e.g., Garcia v. Lone Star Indus., Case No. D-149, 527, 1997 WL 34904089 (Dist. Ct. Tex., Jefferson Cty., 1997) (identifying Rosner and Markowitz as testifying expert witnesses for plaintiff); City of Milwaukee v NL Industries, Inc., Circuit Ct., Milwaukee Cty., Wisc., 2007 WL 4676349 (Jan. 16, 2007) (referencing litigation report of Rosner and Markowitz); Gibson v. American Cyanamid Co., 719 F. Supp. 2d 1031, 1048 (E.D. Wis. 2010) (noting Rosner and Markowitz’s declaration for plaintiffs); Rhode Island v. Lead Industries Ass’n, C.A. No. PC 99-5226, Rhode Island Superior Court, Providence (Feb. 26, 2007) (discussing Rosner and Markowitz’s testimony on post-verdict motions); Altria Group, Inc. v. Good, No. 07-562, U.S. Sup. Ct., Amicus Brief of Allan M. Brandt, Robert N. Proctor, David M. Burns, Jonathan M. Samet, and David Rosner (June 18, 2008) (all amici except Rosner disclosed their litigation activities); Burton v. American Cyanamid Co., 775 F. Supp. 2d 1093 (E.D. Wis. 2011) (noting Rosner and Markowitz’s testimony in lead pigment case); California v. Atlantic Richfield Co., Santa Clara Super. Ct., Calif., No. 1-00-CV-788657, 2013 WL 4425657 (July 15, 2013) (noting Rosner’s testimony); Ostenrieder v. Rohm & Haas Co., Phila. Ct. C.P. Case No. 150602485, Motion in Limine to Exclude Testimony of Gerald Markowitz and David Rosner (filed by Rohm & Haas Co., subsidiary of Dow Chemical Co., June 18, 2015); Dumas v. ABB Group, Inc., civ. action no. 13-229-SLR-SRF (D. Del. Sept. 30, 2015) (referencing Rosner’s report for plaintiffs); Assenzio v. A.O. Smith Water Prods. Co., docket nos. 190008/12, 190026/12, 190200/12, 190183/12, 190184/12, NY Sup. Ct., NY Cty. (Feb. 5, 2015) (noting that Rosner testified for plaintiffs); Noll v American Biltrite, Inc., 188 Wash. App. 572, 355 P.3d 279 (Wash. Ct. App. June 29, 2015), aff’d, 355 P.3d 279 (Wash. 2015) (deposition of Gerald Markowitz given on behalf of plaintiff); Schwartz v. Honeywell Internat’l, Inc., 66 N.E.3d 118 (Ohio Ct. App. 2016) (same), app. granted, 148 Ohio St. 3d 1442, 72 N.E.3d 656 (2017); Clair v. Monsanto Co., 412 S.W.3d 295 (Mo. App. 2013) (noting Rosner as plaintiff’s expert witness); New v. Borg-Warner Corp., No. 13-cv-00675, 2015 WL 5166946 (W.D. Mo., Sept. 3, 2015) (identifying Rosner and Markowitz as plaintiff’s expert witnesses); Begin v. Air & Liquid Corp., Case No. 3:15-cv-830-SMY-DGW (S.D. Ill. May 10, 2016) (striking designation of plaintiff’s expert witness David Rosner as untimely in asbestos case); Rost v. Ford Motor Co., 151 A.3d 1032 (Pa. 2016) (noting Rosner and Markowitz as amici authors; no disclosure of litigation income); Dominick v. A.O. Smith Water Products, CA2014-000232, NY Sup. Ct., Oneida Cty., Notes of Testimony of David Rosner, Mar. 18, 2017 (Press Release from Plaintiffs’ law firm).

2 Quester v. B.F. Goodrich Co., Cuyahoga Cty., Ohio, C.P. Case No. 30-509539 (Jan. 12, 2008) (excluding Markowitz’s testimony as impermissible attempt to introduce expert witness opinion on defendants’ intent and motive).

3 Presumably an alpha version is one that has not made it to beta.