TORTINI

For your delectation and delight, desultory dicta on the law of delicts.

Woodside on Access to Underlying Research Data

October 10th, 2015

Access to underlying data and materials, source codes, and other research materials is a two-edged sword. Many scientists who hold forth on the issue, including some prominent plaintiffs’ expert witnesses, have been extremely critical of the pharmaceutical and other industries for not sharing underlying data of their research. On the other hand, some of the same people have resisted sharing data and information when the litigants have sought access to these materials to understand or to challenge the published conclusions and analyses.[1]

Dr. Frank Woodside, of Dinsmore & Shohl, kindly sent me a copy of his recent law review article, written with a colleague, which advocates for full disclosure of underlying research data when research becomes material to the outcome of litigation.[2] Frank C. Woodside & Michael J. Gray, “Researchers’ Privilege: Full Disclosure,” 32 West. Mich. Univ. Cooley L. Rev. 1 (2015). The authors make the case that the so-called researcher’s privilege has little or no support in federal or state law. My previous posts have largely supported this view, at least for research that has been published, and especially for research that is being relied upon by testifying expert witnesses in pending litigation. As Lord Chancellor Hardwicke put the matter, “the public has a right to every man’s evidence,”[3] and scientists should not be immune to the requirement of giving and sharing their evidence.

Woodside and Gray have updated the scholarship in this area, and their article should be consulted in any ongoing discovery, subpoena, or Freedom of Information Act (FOIA) battle. Their discussion of the evolving case law under FOIA is especially timely. Despite the strong presumption in favor of disclosure under FOIA,[4] and President Obama’s pronouncements[5] about a new era in FOIA openness and transparency, the government’s compliance is at an all-time low. See Ted Bridis, “Obama administration sets new record for withholding FOIA requests,” PBS News Hour (Mar. 18, 2015). Court decisions have made clear that researchers cannot refuse to produce underlying data simply “because disclosure would diminish the researchers’ ability to publish their results in prestigious journals.”[6] And yet the National Institute of Environmental Health and Safety continues in its aggressive resistance to disclosure of underlying data, often by invoking FOIA exemption number four. In my cases, I have seen the NIEHS resort to this exemption that protects documents that reveal “[t]rade secrets and commercial or financial information obtained from a person and privileged or confidential,”[7] even when the research in question was conducted by academic researchers funded by the NIEHS.


[1] See, e.g., Enoch v. Forest Research Institute, Inc., N.J. Law Div. Hudson Cty., Civ. Div. L-3896-14, Order Granting Defendants’ Motion to Compel Production of Documents Necessary to Verify the Validity and Accuracy of a Study by Plaintiffs’ Expert, Anick Berard, Ph.D. (Oct. 9, 2015) (Jablonski, J.) (ordering plaintiffs to “produce the documents sought by the Forest defendants to verify the validity and accuracy of the study known as “Berard et al., Sertraline Use During Pregnancy and the Risk of Major Malformations, Am. J. Obstet. Gynecol. (2015), doi 10.1016/j.ajog.2015.01.034, namely the study’s SAS source codes and the specific generalized estimating equation models that were used to generate Table 2 of the study”).

[2] And I should thank Dr. Woodside and Mr. Gray for their generous citations to your humble blogger’s posts on this subject.

[3] Debate in the House of Lords on the Bill to Indemnify Evidence, 12 Hansard’s Parliamentary History of England, 675, 693, May 25, 1742, quoted in 8 Wigmore on Evidence at 64, § 2192 (3d ed. 1940).

[4] See S. REP. No. 89-813, at 3 (1965) (the purpose of FOIA is to “establish a general philosophy of full agency disclosure . . . and to provide a court procedure by which citizens and the press may obtain information wrongfully withheld”).

[5] See Executive Order, Memorandum, 74 Fed. Reg. 4685 (Jan. 21, 2009).

[6] See Burka v. U.S. Dep’t of Health and Human Serv., 87 F.3d 508, 515 (D.C. Cir. 1996).

[7] See 5 U.S.C. § 552(b)(4).

The C-8 (Perfluorooctanoic Acid) Litigation Against DuPont, part 1

September 27th, 2015

The first plaintiff has begun her trial against E.I. Du Pont De Nemours & Company (DuPont), for alleged harm from environmental exposure to perfluorooctanoic acid or its salts (PFOA). Ms. Carla Bartlett is claiming that she developed kidney cancer as a result of drinking water allegedly contaminated with PFOA by DuPont. Nicole Hong, “Chemical-Discharge Case Against DuPont Goes to Trial: Outcome could affect thousands of claims filed by other U.S. residents,” Wall St. J. (Sept. 13, 2015). The case is pending before Chief Judge Edmund A. Sargus, Jr., in the Southern District of Ohio.

PFOA is not classified as a carcinogen in the Integrated Risk Information System (IRIS), of the U.S. Environmental Protection Agency (EPA). In 2005, the EPA Office of Pollution Prevention and Toxics submitted a “Draft Risk Assessment of the Potential Human Health Effects Associated With Exposure to Perfluorooctanoic Acid and Its Salts (PFOA),” which is available at the EPA’s website. The draft report, which is based upon some epidemiology and mostly animal toxicology studies, stated that there was “suggestive evidence of carcinogenicity, but not sufficient to assess human carcinogenic potential.”

In 2013, The Health Council of the Netherlands evaluated the PFOA cancer issue, and found the data unsupportive of a causal conclusions. The Health Council of the Netherlands, “Perfluorooctanoic acid and its salts: Evaluation of the carcinogenicity and genotoxicity” (2013) (“The Committee is of the opinion that the available data on perfluorooctanoic acid and its salts are insufficient to evaluate the carcinogenic properties (category 3)”).

Last year, the World Health Organization (WHO) through its International Agency for Research on Cancer (IARC) reviewed the evidence on the alleged carcinogenicity of PFOA. The IARC, which has fostered much inflation with respect to carcinogenicity evaluations, classified as PFOA as only possibly carcinogenic. See News, “Carcinogenicity of perfluorooctanoic acid, tetrafl uoroethylene, dichloromethane, 1,2-dichloropropane, and 1,3-propane sultone,” 15 The Lancet Oncology 924 (2014).

Most independent reviews also find the animal and epidemiologic unsupportive of a causal conclusion between PFOA and any human cancer. See, e.g., Thorsten Stahl, Daniela Mattern, and Hubertus Brunn, “Toxicology of perfluorinated compounds,” 23 Environmental Sciences Europe 38 (2011).

So you might wonder how DuPont lost its Rule 702 challenges in such a case, which it surely did. In re E. I. du Pont de Nemours & Co. C-8 Pers. Injury Litig., Civil Action 2:13-md-2433, 2015 U.S. Dist. LEXIS 98788 (S.D. Ohio July 21, 2015). That is a story for another day.

David Faigman’s Critique of G2i Inferences at Weinstein Symposium

September 25th, 2015

The DePaul Law Review’s 20th Annual Clifford Symposium on Tort Law and Social Policy is an 800-plus page tribute in honor of Judge Jack Weinstein. 64 DePaul L. Rev. (Winter 2015). There are many notable, thought-provoking articles, but my attention was commanded by the contribution on Judge Weinstein’s approach to expert witness opinion evidence. David L. Faigman & Claire Lesikar, “Organized Common Sense: Some Lessons from Judge Jack Weinstein’s Uncommonly Sensible Approach to Expert Evidence,” 64 DePaul L. Rev. 421 (2015) [cited as Faigman].

Professor Faigman praises Judge Jack Weinstein for his substantial contributions to expert witness jurisprudence, while acknowledging that Judge Weinstein has been a sometimes reluctant participant and supporter of judicial gatekeeping of expert witness testimony. Professor Faigman also uses the occasion to restate his own views about the so-called “G2i” problem, the problem of translating general knowledge that pertains to groups to individual cases. In the law of torts, the G2i problem arises from the law’s requirement that plaintiffs show that they were harmed by defendants’ products or environmental exposures. In the context of modern biological “sufficient” causal set principles, this “proof” requirement entails that the product or exposure can cause the specified harms in human beings generally (“general causation”) and that the product or exposure actually played a causal role in bringing about plaintiffs’ specific harms.

Faigman makes the helpful point that courts initially and incorrectly invoked “differential diagnosis,” as the generally accepted methodology for attributing causation. In doing so, the courts extrapolated from the general acceptance of differential diagnosis in the medical community to the courtroom testimony about etiology. The extrapolation often glossed over the methodological weaknesses of the differential approach to etiology. Not until 1995 did a court wake to the realization that what was being proffered was a “differential etiology,” and not a differential diagnosis. McCullock v. H.B. Fuller Co., 61 F.3d 1038, 1043 (2d Cir. 1995). This realization, however, did not necessarily stimulate the courts’ analytical faculties, and for the most part, they treated the methodology of specific causal attribution as general acceptance and uncontroversial. Faigman’s point that the courts need to pay attention to the methodological challenges to differential etiological analysis is well taken.

Faigman also claims, however, that in advancing “differential etiologies, expert witnesses were inventing wholesale an approach that had no foundation or acceptance in their scientific disciplines:

 “Differential etiology is ostensibly a scientific methodology, but one not developed by, or even recognized by, physicians or scientists. As described, it is entirely logical, but has no scientific methods or principles underlying it. It is a legal invention and, as such, has analytical heft, but it is entirely bereft of empirical grounding. Courts and commentators have so far merely described the logic of differential etiology; they have yet to define what that methodology is.”

Faigman at 444.[1] Faigman is correct that courts often have left unarticulated exactly what the methodology is, but he does not quite make sense when he writes that the method of differential etiology is “entirely logical,” but has no “scientific methods or principles underlying it.” Afterall, Faigman starts off his essay with a quotation from Thomas Huxley that “science is nothing but trained and organized common sense.”[2] As I have written elsewhere, the form of reasoning involved in differential diagnosis is nothing other than the iterative disjunctive syllogism.[3] Either-or reasoning occurs throughout the physical and biological sciences; it is not clear why Faigman declares it un- or extra-scientific.

The strength of Faigman’s claim about the made-up nature of differential etiology appears to be undermined and contradicted by an example that he provides from clinical allergy and immunology:

“Allergists, for example, attempt to identify the etiology of allergic reactions in order to treat them (or to advise the patient to avoid what caused them), though it might still be possible to treat the allergic reactions without knowing their etiology.”

Faigman at 437. Of course, not only allergists try to determine the cause of an individual patient’s disease. Psychiatrists, in the psychoanalytic tradition, certain do so as well. Physicians who use predictive regression models use group data, in multivariate analyses, to predict outcomes, risk, and mortality in individual patients. Faigman’s claim is similarly undermined by the existence of a few diseases (other than infectious diseases) that are defined by the causative exposure. Silicosis and manganism have played a large role in often bogus litigation, but they represent instances in which a differential diagnosis and puzzle may also be an etiological diagnosis and puzzle. Of course, to the extent that a disease is defined in terms of causative exposures, there may be serious and even intractable problems caused by the lack of specificity and accuracy in the diagnostic criteria for the supposedly pathognomonic disease.

As for whether the concept of “differential etiology” is ever used in the sciences themselves, a few citations for consideration follow.

Kløve & D. Doehring, “MMPI in epileptic groups with differential etiology,” 18 J. Clin. Psychol. 149 (1962)

Kløve & C. Matthews, “Psychometric and adaptive abilities in epilepsy with differential etiology,” 7 Epilepsia 330 (1966)

Teuber & K. Usadel, “Immunosuppression in juvenile diabetes mellitus? Critical viewpoint on the treatment with cyclosporin A with consideration of the differential etiology,” 103 Fortschr. Med. 707 (1985)

G.May & W. May, “Detection of serum IgA antibodies to varicella zoster virus (VZV)–differential etiology of peripheral facial paralysis. A case report,” 74 Laryngorhinootologie 553 (1995)

Alan Roberts, “Psychiatric Comorbidity in White and African-American Illicity Substance Abusers” Evidence for Differential Etiology,” 20 Clinical Psych. Rev. 667 (2000)

Mark E. Mullinsa, Michael H. Leva, Dawid Schellingerhout, Gilberto Gonzalez, and Pamela W. Schaefera, “Intracranial Hemorrhage Complicating Acute Stroke: How Common Is Hemorrhagic Stroke on Initial Head CT Scan and How Often Is Initial Clinical Diagnosis of Acute Stroke Eventually Confirmed?” 26 Am. J. Neuroradiology 2207 (2005)

Qiang Fua, et al., “Differential Etiology of Posttraumatic Stress Disorder with Conduct Disorder and Major Depression in Male Veterans,” 62 Biological Psychiatry 1088 (2007)

Jesse L. Hawke, et al., “Etiology of reading difficulties as a function of gender and severity,” 20 Reading and Writing 13 (2007)

Mastrangelo, “A rare occupation causing mesothelioma: mechanisms and differential etiology,” 105 Med. Lav. 337 (2014)


[1] See also Faigman at 448 (“courts have invented a methodology – differential etiology – that purports to resolve the G2i problem. Unfortunately, this method has only so far been described; it has not been defined with any precision. For now, it remains a highly ambiguous idea, sound in principle, but profoundly underdefined.”).

[2] Thomas H. Huxley, “On the Education Value of the Natural History Sciences” (1854), in Lay Sermons, Addresses and Reviews 77 (1915).

[3] See, e.g.,Differential Etiology and Other Courtroom Magic” (June 23, 2014) (collecting cases); “Differential Diagnosis in Milward v. Acuity Specialty Products Group” (Sept. 26, 2013).

Let Me Not Be Frank With You – Frank Subpoena Quashed

August 19th, 2015

In June 2015, Honeywell International Inc. subpoenaed non-party witness Dr. Arthur Frank, to produce documents and to testify, in Yates v. Ford Motor Co., et al., No. 5:12-cv-752-FL (E.D.N.C.). Although Dr. Frank is a “prolific plaintiffs’ expert” witness, he was not retained in Yates. Dr. Frank thus moved to quash the subpoena in the district where he was served, and the matter ended up on the docket of Judge Gerald J. Pappert. Frank v. Honeywell Int’l, Inc., No. 15-mc-00172, 2015 U.S. Dist. LEXIS 106453, 2015 BL 260668 (E.D. Pa. Aug. 12, 2015) [cited below as Yates]. See also Steven M. Sellers, “Asbestos Expert Tops Honeywell in Subpoena Battle,” BNA Bloomberg Law (Aug. 18, 2015).

Back in 2009, Dr. Frank lobbied the National Cancer Institute (“NCI”), and succeeded in having the NCI change its website and “Fact Sheets” about the supposed cancer risks among auto mechanics from exposure to asbestos in repairing brakes. The NCI had proposed describing any increased risk of mesothelioma or lung cancer among brake repairman as “controversial,” and not supported by the available evidence. Dr. Frank, who routinely testifies for the litigation industry that the risk is certain, known, and substantial, believed the NCI statement would be “misleading, erroneous, and contrary to the public health.” Frank believed that the NCI was basing its evaluation upon studies that were “unreliable,” and so set out to lobby the NCI. As a result of his telephoning and letter writing campaign, the NCI eliminated citations to two studies deemed unreliable (or inconvenient) to Dr. Frank, and adopted the following Frank-approved language:

“Studies into the cancer risk experienced by automobile mechanics exposed to asbestos through brake repair are limited, but the overall evidence suggests that there is no safe level for asbestos exposure.”

Yates at *4.

Operating in cahoots with, and under the guidance of asbestos plaintiffs’ counsel, Frank wrote to the NCI, of course mindful to run a draft of his correspondence past his litigation industry members. Plaintiffs’ counsel made various suggestions that Frank adopted. Yates at *5-7.

Frank objected to the subpoena on grounds that it:

(1) was too broad and unduly burdensome, as well as intended to harass;

(2) sought communications protected by attorney-client privilege; and

(3) sought the opinion of an unretained expert witness, contrary to Federal Rule of Civil Procedure 45(d)(3)(B)(ii).

The court quashed Honeywell’s subpoena only on grounds of burden, Rule 45(d)(3)(A), and did not reach Frank’s other arguments. Yates at *8.

Citing local Eastern District of Pennsylvania precedent, Judge Pappert noted that a claim of undue burden is resolved by considering several factors:

“(1) relevance of the requested materials,

(2) the party’s need for the documents,

(3) the breadth of the request,

(4) the time period covered by the request,

(5) the particularity with which the documents are described,

(6) the burden imposed, and

(7) the recipient’s status as a non-party.”

Yates at *12.

Honeywell was easily able to show the relevance of Frank’s lobbying shenanigans. Plaintiffs’ counsel have used the Frank-approved NCI website language to cross-examine defense expert witnesses, in asbestos personal injury cases.

Judge Pappert was not persuaded that Honeywell needed the requested discovery because Frank had given much of the material before, and he had previously acknowledged his working in concert with plaintiffs’ lawyers to change the NCI statement.

Honeywell thus had the evidence it needed to rehabilitate defense expert witnesses challenged with the Frank-approved NCI language. The court thus left the discovery into Frank’s ex parte lobbying activities for a case in which Frank was actually a retained expert witness, which surely will be soon. Judge Pappert exercised restraint by not addressing Frank’s improvident claim of attorney-client privilege and involuntarily servitude as an expert witness.

Frank’s lawyer, John O’Riordan, was quoted by the BNA as chastizing Honeywell:

“What the auto industry, Honeywell and others are trying to do is attack Dr. Frank personally, and what they tried to do was improper. … If they think he was wrong as a matter of science, the answer is to come back with good science.”

Steven M. Sellers, “Asbestos Expert Tops Honeywell in Subpoena Battle,” BNA Bloomberg Law (Aug. 18, 2015).

O’Riordan’s response is rather disingenuous, given that plaintiffs’ counsel in asbestos cases exploit the imprimatur of the NCI in its Frank-approved statement to challenge defense expert witnesses. This game is not about science, it is about name dropping and authority-based decision making, the antithesis of science.

Publication of Two Symposia on Scientific Evidence in the Law

August 2nd, 2015

The Journal of Philosophy, Science & Law bills itself as an on-line journal for the interdisciplinary exploration of philsophy, science, and law. This journal has just made its “Daubert Special” issue available at its website:

Jason Borenstein and Carol Henderson, “Reflections on Daubert: A Look Back at the Supreme Court’s Decision,” 15 J. Philos., Sci. & Law 1 (2015)

Mark Amadeus Notturno, “Falsifiability Revisited: Popper, Daubert, and Kuhn,” 15 J. Philos., Sci. & Law 5 (2015)

Tony Ward, “An English Daubert? Law, Forensic Science and Epistemic Deference,” 15 J. Philos., Sci. & Law 26 (2015)

Daniella McCahey & Simon A. Cole, “Human(e) Science? Demarcation, Law, and ‘Scientific Whaling’ in Whaling in the Antarctic” 15 J. Philos., Sci. & Law 37 (2015)

Back in January 30 – 31, 2015, the Texas Law Review called for a Conference on Science Challenges for Law and Policy, to focus on issues arising at intersection of science and law, with particular focus on issues arising in criminal justice, bioethics, and the environment. The Conference schedule is still available here. Conference papers addressed the nature of scientific disputes, the role of expertise in resolving such disputes, and the legal implementation and management of scientific knowledge. Some of the Conference papers are now available in the symposium issue of the 2015 Texas Law Review:

Rebecca Dresser, “The ‘Right to Try’ Investigational Drugs: Science and Stories in the Access Debate,” 93 Tex. L. Rev. 1631

David L. Faigman, “Where Law and Science (and Religion?) Meet,” 93 Tex. L. Rev. 1659 (2015)

Jennifer E. Laurin, “Criminal Law’s Science Lag: How Criminal Justice Meets Changed Scientific Understanding,” 93 Tex. L. Rev. 1751 (2015)

Elizabeth Fisher, Pasky Pascual & Wendy Wagner, “Rethinking Judicial Review of Expert Agencies,” 93 Tex. L. Rev. 1681 (2015)

Sheila Jasanoff, “Serviceable Truths: Science for Action in Law and Policy,” 93 Tex. L. Rev. 1723 (2015)

Thomas O. McGarity, “Science and Policy in Setting National Ambient Air Quality Standards: Resolving the Ozone Enigma,” 93 Tex. L. Rev. 1783 (2015)

Jennifer L. Mnookin, “Constructing Evidence and Educating Juries: The Case for Modular, Made-In-Advance Expert Evidence About Eyewitness Identifications and False Confessions,” 93 Tex. L. Rev. 1811 (2015)

California Actos Decision Embraces Relative-Risk-Greater-Than-Two Argument

July 28th, 2015

A recent decision of the California Court of Appeal, Second District, Division Three, continues the dubious state and federal practice of deciding important issues under cover of unpublished opinions. Cooper v. Takeda Pharms. America, Inc., No. B250163, 2015 Cal. App. Unpub. LEXIS 4965 (Calif. App., 2nd Dist., Div. 3; July 16, 2015). In Cooper, plaintiff claimed that her late husband’s bladder cancer was caused by defendant’s anti-diabetic medication, Actos (pioglitazone). The defendant moved to strike the expert witness testimony in support of specific causation. The trial judge expressed serious concerns about the admissibility of plaintiff’s expert witnesses on specific causation, but permitted the trial to go forward. After a jury returned its verdict in favor of plaintiff, the trial court entered judgment for the defendants, on grounds that the plaintiff lacked admissible expert witness testimony.

Although a recent, large, well-conducted study[1] failed to find any meaningful association between pioglitazone and bladder cancer, there were, at the time of trial, several studies that suggested an association. Plaintiff’s expert witnesses, epidemiologist Dr. Alfred Neugut and bladder oncologist Dr. Norm Smith interpreted the evidence to claim a causal association, but both conceded that there were no biomarkers that allowed them to attribute Cooper’s cancer to pioglitazone. The plaintiff also properly conceded that identifying a cause of the bladder cancer was irrelevant to treating the disease. Cooper, 2015 Cal. App. Unpub. LEXIS 4965, at *13. Specific causation was thus determined by the so-called process of differential etiology, with the ex ante existence of risk substituting for cause, and using risk exposure in the differential analysis.

The trial court was apparently soured on Dr. Smith’s specific causation assessment because of his poor performance at deposition, in which he demonstrated a lack of understanding of Cooper’s other potential exposures. Smith’s spotty understanding of Cooper’s actual and potential exposures and other risks made any specific causation assessment less than guesswork. By the time of trial, Dr. Smith and plaintiff’s counsel had backfilled the gaps, and Smith presented a more confident analysis of Cooper’s exposures and potentially competing risks.

Cooper had no family history of bladder cancer, no alcohol consumption, and no obvious exposure to occupational bladder carcinogens. His smoking history would account for exposure to a known bladder carcinogen, cigarette smoke, but Cooper’s documented history was of minor tobacco use, and remote in time. Factually, Cooper’s history was suspect and at odds with his known emphysema. Based upon this history, along with their causal interpretation of the Actos bladder cancer association, and their quantitative assessment that the risk ratio for bladder cancer from Actos was 7.0 or higher for Mr. Cooper (controlled for covariate, potential confounders), the plaintiff’s expert witnesses opined that Actos was probably a substantial factor in causing Mr. Cooper’s bladder cancer. The court did not examine the reasonableness of Dr. Smith’s risk ratios, which seem exorbitant in view of several available meta-analyses.[2]

The court stated that under the applicable California law of “substantial factor,” the plaintiff’s expert witness, in conducting a differential diagnosis, need not exclude every other possible cause of plaintiff’s disease “with absolute certainty.” Cooper, at *41-42. This statement leaves unclear and ambiguous whether the plaintiff’s expert witness must (and did in this case) rule out other possible causes with some level of certitude less than “absolute certainty,” such as reasonable medical certainty, or perhaps reasonable probability. Dr. Smith’s testimony, as described, did not attempt to go so far as to rule out smoking as “a cause” of Cooper’s bladder cancer; only that the risk from smoking was a lower order of magnitude than that for Actos. In Dr. Smith’s opinion, the discrepancy in magnitude between the risk ratios for smoking and Actos allowed him to state confidently that Actos was the most substantial risk.

Having estimated the smoking-related increased risk to somewhere between 0 and 100%, with the Actos increased risk at 600% or greater, Dr. Smith was able to present an admissible opinion that Actos was a substantial factor. Of course, this all turns on the appellate court’s acceptance of risk, of some sufficiently large magnitude, as evidence of specific causation. In the Cooper court’s words:

“The epidemiological studies relied on by Dr. Smith indicated exposure to Actos® resulted in hazard ratios for developing bladder cancer ranging from 2.54 to 6.97.18 By demonstrating a relative risk greater than 2.0 that a product causes a disease, epidemiological studies thereby become admissible to prove that the product at issue was more likely than not responsible for causing a particular person’s disease. “When statistical analyses or probabilistic results of epidemiological studies are offered to prove specific causation . . . under California law those analyses must show a relative risk greater than 2.0 to be ‘useful’ to the jury. Daubert v. Merrell Dow Pharmaceuticals Inc., 43 F.3d 1311, 1320 (9th Cir.), cert. denied 516 U.S. 869 (1995) [Daubert II]. This is so, because a relative risk greater than 2.0 is needed to extrapolate from generic population-based studies to conclusions about what caused a specific person’s disease. When the relative risk is 2.0, the alleged cause is responsible for an equal number of cases of the disease as all other background causes present in the control group. Thus, a relative risk of 2.0 implies a 50% probability that the agent at issue was responsible for a particular individual’s disease. This means that a relative risk that is greater than 2.0 permits the conclusion that the agent was more likely than not responsible for a particular individuals disease. [Reference Manual on Scientific Evidence (Federal Judicial Center 2d ed. 2000) (“Ref. Manual”),] Ref. Manual at 384, n. 140 (citing Daubert II).” (In re Silicone Gel Breast Implant Prod. Liab. Lit. (C.D. Cal. 2004) 318 F.Supp.2d 879, 893; italics added.) Thus, having considered and ruled out other background causes of bladder cancer based on his medical records, Dr. Smith could conclude based on the studies that it was more likely than not that Cooper’s exposure to Actos® caused his bladder cancer. In other words, because the studies, to varying degrees, adjusted for race, age, sex, and smoking, as well as other known causes of bladder cancer, Dr. Smith could rely upon those studies to make his differential diagnosis ruling in Actos®—as well as smoking—and concluding that Actos® was the most probable cause of Cooper’s disease.”

Cooper, at *78-80 (emphasis in the original).

Of course, the epidemiologic studies themselves are not admissible, regardless of the size of the relative risk, but the court was, no doubt, speaking loosely about the expert witness opinion testimony that was based upon the studies with risk ratios greater than two. Although the Cooper case does not change California law’s facile acceptance of risk as a substitute for cause, the case does base its approval of plaintiff’s expert witness’s attribution as turning on the magnitude of the risk ratio, adjusted for confounders, as having exceeded two. The Cooper case leaves open what happens when the risk that is being substituted for cause is a ratio ≤ 2.0. Some critics of the risk ratio > 2.0 inference have suggested that risk ratios greater than two would lead to directed verdicts for plaintiffs in all cases, but this suggestion requires demonstrations of both the internal and external validity of the studies that measure the risk ratio, which in many cases is in doubt. In Cooper, the plaintiff’s expert witnesses’ embrace of a high, outlier risk ratio for Actos, while simultaneously downplaying competing risks, allowed them to make out their specific causation case.


[1] James D. Lewis, Laurel A. Habel, Charles P. Quesenberry, Brian L. Strom, Tiffany Peng, Monique M. Hedderson, Samantha F. Ehrlich, Ronac Mamtani, Warren Bilker, David J. Vaughn, Lisa Nessel, Stephen K. Van Den Eeden, and Assiamira Ferrara, “Pioglitazone Use and Risk of Bladder Cancer and Other Common Cancers in Persons With Diabetes,” 314 J. Am. Med. Ass’n 265 (2015) (adjusted hazard ratio 1.06, 95% CI, 0.89-1.26).

[2] See, e.g., R.M. Turner, et al., “Thiazolidinediones and associated risk of bladder cancer: a systematic review and meta-analysis,” 78 Brit. J. Clin. Pharmacol. 258 (2014) (OR = 1.51, 95% CI 1.26-1.81, for longest cumulative duration of pioglitazone use); M. Ferwana, et al., “Pioglitazone and risk of bladder cancer: a meta-analysis of controlled studies,” 30 Diabet. Med. 1026 (2013) (based upon 6 studies, with median follow-up of 44 months, risk ratio = 1.23; 95% CI 1.09-1.39); Cristina Bosetti, “Cancer Risk for Patients Using Thiazolidinediones for Type 2 Diabetes: A Meta-Analysis,” 18 The Oncologist 148 (2013) (RR = 1.64 for longest exposure); Shiyao He, et al., “Pioglitazone prescription increases risk of bladder cancer in patients with type 2 diabetes: an updated meta-analysis,” 35 Tumor Biology 2095 (2014) (pooled hazard ratio = 1.67 (95% C.I., 1.31 – 2.12).

Ramazzini Serves Courtroom Silica Science Al Dente

July 25th, 2015

Collegium Ramazzini styles itself as an “independent, international academy.” The Collegium Ramazzini was founded in 1982, by the late Irving Selikoff and others to serve as an advocacy forum for their pro-compensation and aggressive regulation views on social and political issues involving occupational and environmental health.

The Collegium is a friendly place where plaintiffs’ expert witnesses, consultants, and advocates never have to declare their conflicts of interest.[1] Last year, in October 2014, the Collegium conducted a conference on silica health issues, entitled “Silica Three Hundred Years Later: Occupational Exposure, Medical Monitoring, and Regulation.”

The silica session was chaired by Christine Oliver, one of plaintiff’s key expert witnesses in Allen v. Martin Surfacing, 263 F.R.D. 47 (D. Mass. 2009). SeeBad Gatekeeping or Missed Opportunity – Allen v. Martin Surfacing” (Nov. 30, 2012). The purported goal of the session was

“to shine a light on silica as a persistent and dangerous threat to the health of exposed workers worldwide,” focusing on the following issues:

“1) Occupational silica exposures, new and old;

2) silica as a recognized human lung carcinogen and its interaction with other lung carcinogens such as tobacco smoke;

3) the role of silica and silicosis in tuberculosis;

4) issues relevant to medical surveillance of silica-exposed workers as set forth in OSHA’s proposed silica standard;

5) the role of the US Government in protecting the health of silica-exposed workers; and

6) international variability in addressing the threat to worker health posed by silicosis.”

Recently, the Collegium updated its website to provide PDF files of some of the conference presentations:

Carol H. Rice, “Silica – old, new and emerging uses result in worker exposure

Arthur L. Frank, “Silica as a lung carcinogen

Rodney Ehrlich, “Silica in the head of the snake. Silica, gold mining, and tuberculosis in southern Africa

Christine Oliver, “Medical surveillance for silica-related disease: the Collegium responds to OSHA’s proposed rulemaking,”

Gregory R. Wagner, “US Government role in recognizing, reducing, and regulating silica risk: 80 years and counting

Sverre Langard, “Silicosis 300 years after Ramazzini: Eradication in some countries, increased incidence in others

A poster session chaired by Melissa McDiarmid and Carol Rice, revealingly titled “Sustainable Work 2020 – an advocacy platform for Horizon 2020,” followed. Casey Bartrem asked whether “Asbestos-induced lung cancer in Germany: is the compensation practice in accordance with the epidemiological findings?” Odds are that this presentation was a brief for greater compensation. Xaver Baur of Germany, presented on the “Ethics in the applied sciences: The challenge of preventing corporate influence over public health regulation,” but remarkably no one presented on the challenge of preventing the litigation and compensation industry’s influence over public health regulation.

You won’t find any cutting-edge science in the linked slides, but you will find some interesting revelations. Sverre Langard’s presentation makes the dramatic point that silicosis has been declining, despite the hand waving of OSHA Administrator David Michaels, and the histortions of Rosner and Markowitz. Consider Langard’s slide, based upon CDC data:

CDC Siicosis vs Asbestosis Mortality Over Time

And consider the admissions of Arthur Frank, veteran plaintiffs’ expert witness, who acknowledged that:

“until very recently it [silica] was not recognized as a carcinogen.”

True to form, Dr. Frank blamed Selikoff and his other teachers at Mt. Sinai Hospital in New York City, where he trained:

“At Mount Sinai I did not get trained that silica was a carcinogen”

Well, even a scurry of blind squirrels sometimes find their nuts!


[1][1] Some of the names on the list of Fellows and Emeritus Fellows reads like a “Who’s Who” of testifying expert witnesses, consultants, and advocates for the litigation industry:

Henry A. Anderson, Barry Castleman, David C. Christiani, Carl F. Cranor, Devra Lee Davis , John M. Dement, Arthur Frank, Bernard D. Goldstein, Howard Frumkin, Lennart Hardell, Peter F. Infante, Joseph LaDou, Philip Landrigan, Richard A. Lemen, Barry S. Levy, Roberto G. Lucchini, Steven B. Markowitz, Myron A. Mehlman, Ronald L. Melnick, Donna Mergler, Albert Miller, Franklin E. Mirer, Herbert L. Needleman, L. Christine Oliver, David M. Ozonoff, Carol H. Rice, Kenneth D. Rosenman, Sheldon W. Samuels, Ellen K. Silbergeld, Peter D. Sly, Martyn Thomas Smith, Colin L. Soskolne, Leslie Thomas Stayner, Daniel T. Teitelbaum, Laura Welch

Canadian Judges’ Reference Manual on Scientific Evidence

July 24th, 2015

I had some notion that there was a Canadian version of the Reference Manual on Scientific Evidence in the works, but Professor Greenland’s comments in a discussion over at Deborah Mayo’s blog drew my attention to the publication of the Science Manual for Canadian Judges [Manual]. See “‘Statistical Significance’ According to the U.S. Dept. of Health and Human Services (ii),Error Statistics Philosophy (July 17, 2015).

The Manual is the product of the Canadian National Judicial Institute (NJI), which is an independent, not-for-profit group that is committed to educating Canadian judges. The NJI’s website describes the Manual:

“Without the proper tools, the justice system can be vulnerable to unreliable expert scientific evidence.

* * *

The goal of the Science Manual is to provide judges with tools to better understand expert evidence and to assess the validity of purportedly scientific evidence presented to them. …”

The Chief Justice of Canada, Hon. Beverley M. McLachlin, contributed an introduction to the Manual, which was notable for its frank admission that:

[w]ithout the proper tools, the justice system is vulnerable to unreliable expert scientific evidence.

****

Within the increasingly science-rich culture of the courtroom, the judiciary needs to discern ‘good’ science from ‘bad’ science, in order to assess expert evidence effectively and establish a proper threshold for admissibility. Judicial education in science, the scientific method, and technology is essential to ensure that judges are capable of dealing with scientific evidence, and to counterbalance the discomfort of jurists confronted with this specific subject matter.”

Manual at 14. These are laudable goals, indeed.

The first chapter of the Manual is an overview of Canadian law of scientific evidence, “The Legal Framework for Scientific Evidence,” by Canadian law professors Hamish Stewart (University of Toronto), and Catherine Piché (University of Montreal). Several judges served as peer reviewers.

The second chapter, “Science and the Scientific Method,” contains the heart of what judges supposedly should know about scientific and statistical matters to serve as effective “gatekeepers.” Like the chapters in the Reference Manual on Scientific Evidence, this chapter was prepared by a scientist author (Scott Findlay, Ph.D., Associate Professor of Biology, University of Ottawa) and a lawyer author (Nathalie Chalifour, Associate Professor of Law, University of Ottawa). Several judges, and Professor Brian Baigrie (University of Toronto, Victoria College, and the Institute for the History and Philosophy of Science and Technology) provided peer review. The chapter attempts to cover the demarcation between science and non-science, and between scientific and other expert witness opinion. The authors describe “the” scientific method, hypotheses, experiments, predictions, inference, probability, statistics and statistical hypothesis testing, data reliability, and related topics. A subsection of chapter two is entitled “Normative Issues in Science – The Myth of Scientific Objectivity,” which suggests a Feyerabend, post-modernist influence at odds with the Chief Justice’s aspirational statement of goals in her introduction to the Manual.

Greenland noted some rather cavalier statements in Chapter two that suggest that the conventional alpha of 5% corresponds to a “scientific attitude that unless we are 95% sure the null hypothesis is false, we provisionally accept it.” And he pointed elsewhere where the chapter seems to suggest that the coefficient of confidence that corresponds to an alpha of 5% “constitutes a rather high standard of proof,” thus confusing and conflating probability of random error with posterior probabilities. Some have argued that these errors are simply an effort to make statistical concepts easier to grasp for lay people, but the statistics chapter in the FJC’s Reference Manual shows that accurate exposition of statistical concepts can be made understandable. The Canadian Manual seems in need of some trimming with Einstein’s razor, usually paraphrased as “Everything should be made as simple as possible, but no simpler.[1] The razor should certainly applied to statistical concepts, with the understanding that pushing to simplify too aggressively can sometimes result in simplistic, and simply wrong, exposition.

Chapter 3 returns to more lawyerly matters, “Managing and Evaluating Expert Evidence in the Courtroom,” prepared and peer-reviewed by prominent Canadian lawyers and judges. The final chapter, “Ethics of the Expert Witness,” should be of interest to lawyers and judges in the United States, where the topic is largely ignored. The chapter was prepared by Professor Adam Dodek (University of Ottawa), along with several writers from the National Judicial Institute, the Canadian Judicial Council, American College of Trial Lawyers, Environment Canada, and notably, Joe Cecil & the Federal Judicial Center.

Weighing in at 228 pages, the Science Manual for Canadian Judges is much shorter than the Federal Judicial Center’s Reference Manual on Scientific Evidence. Unlike the FJC’s Reference Manual, which is now in its third edition, the Canadian Manual has no separate chapters on regression, DNA testing and forensic evidence, clinical medicine and epidemiology. The coverage of statistical inference is concentrated in chapter two, but that chapter has no discussion of meta-analysis, systematic review, evidence-based medicine, confounding, and the like. Perhaps there will soon be a second edition of the Science Manual for Canadian Judges.


[1] See Albert Einstein, “On the Method of Theoretical Physics; The Herbert Spencer Lecture,” delivered at Oxford (10 June 1933), published in 1 Philosophy of Science 163 (1934) (“It can scarcely be denied that the supreme goal of all theory is to make the irreducible basic elements as simple and as few as possible without having to surrender the adequate representation of a single datum of experience.”).

Stanford Professor Smokes Out Tobacco Defense Expert Witnesses

July 18th, 2015

“Bullshit is unavoidable whenever circumstances require someone to talk without knowing what he is talking about.  Thus the production of bullshit is stimulated whenever a person’s obligations or opportunities to speak about some topic exceed his knowledge of the facts that are relevant to that topic.”

Harry Frankfurt, On Bullshit 63 (Princeton 2005)

*****************************************************

An in-press paper that attacks the ethics and motives of tobacco defense expert witnesses is making some ripples in the science and legal popular media. See, e.g., Tracie White, “Physicians testified for tobacco companies against plaintiffs with head, neck cancers, study finds,” ScienceDaily (July 17, 2015); Joyce E. Cutler, “Motives of Tobacco’s Experts Questioned by Study,” BNA Snapshot -Product Safety & Liability Reporter (July 20, 2015) [cited as Cutler]. The paper is now available in an in-press version. Robert K. Jackler, “Testimony by Otolaryngologists in Defense of Tobacco Companies 2009-2014,” The Laryngoscope (July 17, 2015) (in press) (doi: 10.1002/lary.25432). The paper is worth close study.

Dr. Robert Jackler, the Edward C. and Amy H. Sewall Professor in Otorhinolaryngology, at the Standford Medical School, has previously published his views of the tobacco industry’s role in obscuring medical research on the causal role of tobacco in human cancer.[1] In his most recent contribution, Jackler has reviewed tobacco companies’ expert witnesses’ testimonies to assess their consistency with what Jackler takes to be well-warranted scientific conclusions of known human cancer risks. From his one-sided review (of only defense witnesses) of a limited number of cases, Jackler concludes that tobacco defense expert witnesses were systematically biased in their under-estimation of the magnitude of tobacco-related risks, and their consistent inflation of non-tobacco risks, both in terms of their magnitude, prevalence, and scientific warrant of causality. Although one-sided in his review, Jackler does cite to transcripts that are available on-line from repositories at the University of California San Francisco Legacy Tobacco Documents Library. Disinterested observers can explore further the allegations and their merits by reading the primary documents.

The cases reviewed by Jackler included nine cases of upper aerodigestive-tract cancers (mostly larynx and esophagus), in which six defense otolaryngologists testified that tobacco played no role, or that there was no scientific basis for attributing individual cancers to tobacco. Jackler’s review interestingly identifies a tobacco defense strategy of “leveling” known causes with suspected causes and risk factors, to create a laundry list of differentials in a differential etiology for specific causation. Some of the risk factors that defense expert witnesses postulated included human papillomavirus (HPV), alcohol, mouthwash, heredity, asbestos, diesel fumes, gasoline fumes, salted fish, mouthwash, and urban living.

This epistemic dilution is indeed objectionable, but of course, it is the same epistemic bootstrapping that plaintiffs’ expert witnesses routinely use to place questionable, weakly supported differentials in their specific causation assessments. Consider the recent Tennessee appellate decision in Russell v. Illinois Central RR, in which the court rejected a defense challenge to the dodgy testimony of plaintiffs’ expert witness, Dr. Arthur Frank, that plaintiff’s throat cancer was caused by a etiological soup of asbestos, diesel fume, and environmental tobacco smoke. Russell v. Illinois Central RR, No. W2013-02453-COA-R3-CV, 2015 Tenn. App. LEXIS 520 (Tenn. App. June 30, 2015) (affirming judment for plaintiff in excess of $3 million).

Jackler notes that tobacco witnesses frequently raised the specter of “etiological soup.” Jackler at 3. For instance, some tobacco defense expert witnesses raised even possible asbestos exposure as a cause of laryngeal cancer, but Jackler is appropriately skeptical: “Although some studies suggest an additive effect with smoking, a meta-analysis concluded that the weight of the evidence does not support a causal association.” Jackler at 6 (citing H. Griffiths & N.C. Molony, “Does asbestos cause laryngeal cancer?” 28 Clin. Otolaryngol. & Allied Sci. 177 (2003); and Kevin Browne & J. Bernard L. Gee, “Asbestos exposure and laryngeal cancer,” 44 Ann. Occup. Hyg. 239 (2000). Jackler might be surprised by the stridency and the overreaching of a large segment of the occupational medicine community’s disagreement with his assessment.

Tobacco defense expert witnesses frequently raised diesel fume exposure as an alternative cause, but Jackler finds this testimony disingenuous. “The relationship of diesel fume exposure to laryngeal cancer has been discounted.” Jackler at 6 (citing J.E. Muscat & Ernst L. Wynder, “Diesel exhaust, diesel fumes, and laryngeal cancer,” 112 Otolaryngol. Head Neck Surg. 437 (1995)). So where is Jackler’s outrage against plaintiffs’ expert witness excesses, and the judicial acquiescence in accepting testimony such as that given by Dr. Arthur Frank in the Russell case.

Some of the risks, risk factors, and alternative causes invoked by the tobacco defense expert witnesses, as related by Dr. Jackler, did appear fantastical or false. Jackler, however, does not explore how the plaintiffs’ counsel addressed such over-reaching, or how the court responded to objections and challenges to the defense expert witness testimony. Plaintiffs’ counsel may have strategically allowed tobacco defense expert witnesses to overreach, in order to have a “harder” target on cross-examination.

Improper to Criticize Expert Witnesses

A spokesperson for Philip Morris, Bill Phelps, responded to Jackler’s critique by telling the BNA reporter that:

“We believe that out-of-court attempts to criticize experts for testifying on behalf of defendants in these cases have no place in our judicial system.”

Cutler. Phelps’ criticism is ambiguous between suggesting that any criticism of expert witnesses outside court is improper and suggesting that criticizing expert witnesses simply on the basis for testifying for the tobacco companies is improper.

If Phelps’s point was the latter, then it seems unexceptionable. Surely, the companies have a right to defend themselves, as long as they sponsor expert witness testimony in a responsible way. And certainly, any number of anti-tobacco scientists and physicians have resorted to bullying and name calling in efforts to chill scientists from speaking or testifying for tobacco companies, not by criticizing the substantive merits of testimony, but by asserting a contagious moral leprosy from merely having associated with tobacco companies.

Jackler comes very close to saying that physicians and scientists should not testify on behalf of tobacco companies. He casts aspersion on all tobacco defense expert witnesses by quoting others who state that “[t]he tobacco industry pays generously and gets its money worth.” Jackler at 7 (quoting L. Maggi, “Bearing Witness for Tobacco,” 21 J. Pub. Health Pol. 296 (2000). Jackler notes that “[u]nethical experts bias their testimony to bolster the position of the side who hired them.” Jackler at 7. But Jackler’s review is itself biased by his failure to examine the contentions and degrees of warrant of plaintiffs’ expert witnesses on any issues. Jackler does not articulate a view in his own voice, but states that “[s]ome medical ethicists question whether it could ever be ethical for a physician to testify on behalf of the tobacco industry.” Jackler at 7. Jackler’s implication begs the question whether plaintiffs, and their expert witnesses, are correct on all their medical claims, in every case.

The former point — that any out-of-court criticism of courtroom testimony — is wrong. Trenchant criticism of expert witness testimony is very much needed, and it is hard to see how it would not be helpful to public debate and to improvement of the judicial process. (Again, assuming that the critical discussions are fair and evidence-based.)

In an interview with the BNA, Jackler speculates:

“I think that these [tobacco defense] physicians testifying did so with the belief that their behavior would not become public. And this is an area where shedding light and creating dialogue will help to encourage people to behave ethically when giving their testimony.”

Cutler (quoting Jackler). If expert witnesses on either side think that they can escape critical scrutiny by advocating fabulous fictions in the courtroom, then we would all be better off if we could disabuse them of their notions. In his article, Jackler notes that his professional organization, the American Academy of Otolaryngology – Head and Neck Surgery (AAO–HNS) has, since 2003, had a policy that states:

“Physician expert witnesses should not adopt a position as an advocate or partisan in the legal proceedings”; and that

“the physician expert witness should be aware that transcripts of their deposition and courtroom testimony are public records, subject to independent peer review.”

Jackler at 7 (citing American Academy of Otolaryngology–Head and Neck Surgery official policy on expert witnesses (revised October, 2012)). So the tobacco defense expert witnesses should certainly have been prepared for the post-trial “peer review” that Jackler provides. What is curious about Jackler’s article, and his obvious sense of outrage, is that he does state whether he has filed an ethics complaint with the American Academy or with any other reviewing organization.

Philip Morris Claims that Jackler Has Undisclosed Conflicts of Interests

The Philip Morris spokes person also noted “[Dr. Jackler had] failed to disclose that he has previously worked with counsel for plaintiffs in the Engle cases.” Cutler.  Jackler responded to the BNA, stating “[c]ategorically, I have never testified in tobacco litigation. Specifically, I have never worked for lawyers on either side in any capacity in Engle cases.” What about other cases, outside Florida? Jackler’s in-press article states that it was “[s]upported by Stanford Research into the Impact of Tobacco Advertising, Stanford University School of Medicine, Stanford, CA. The authors have no other funding, financial relationships, or conflicts of interest to disclose.”

One Defense Expert Witness Responds

One defense expert witness, otolaryngologist Dr. Michael Bertino, responded to Cutler in an interview. Dr. Bertino noted that Jackler was out of touch with the risk factor epidemiology of laryngeal cancer, and that strong evidence had emerged that tobacco is not the only strong risk for this cancer. Many older studies, for instance, did not look at the role of human papilloma virus (HPV), which has been identified as a prevalent cause of oral and esophageal cancers. Cutler (citing oral interview with Dr. Bertino). Jackler’s article acknowledges that HPV has been identified in substantial percentages of oral pharyngeal cancers, but disputes that the virus is a substantial independent cause of these cancers. I will leave to others to determine whether Jackler’s review of the HPV studies is fair and balanced, and to what extent it “falsifies” Dr. Bertino’s testimony.


[1] Robert K. Jackler & H. Samji, “The price paid: Manipulation of otolaryngologists by the tobacco industry to obfuscate the emerging truth that smoking causes cancer,” 122 The Laryngoscope 75 (2011).

Discovery of Retained, Testifying Statistician Expert Witnesses (Part 2)

July 1st, 2015

Discovery Beyond the Report and the Deposition

The lesson of the cases interpreting Rule 26 is that counsel cannot count exclusively upon the report and automatic disclosure requirements to obtain the materials necessary or helpful for cross-examination of statisticians who have created their own analyses. Sometimes just asking nicely suffices[1]. Other avenues of discovery are available, however, for reluctant disclosers. In particular, Rule 26(b) authorizes discovery substantially broader than what is required for inclusion in an expert witness’s report.

Occasionally, counsel cite caselaw that has been superseded by the steady expansion of Rule 26[2]. The 1993 amendments made clear, however, that Rule 26 sets out mandatory minimum requirements that do not define or exhaust the available discovery tools to obtain information from expert witnesses[3]. Some courts continue to insist that a party make a showing of necessity to go beyond the minimal requirements of Rule 26[4], although the better reasoned cases take a more expansive view of the proper scope of expert witness discovery[5].

Although the federal rules may not require the expert witness report to include, or to attach, all “working notes or recordings,” or calculations, alternative analyses, and data output files, these materials may be the subject of proper document requests to the adverse party or perhaps subpoenas to the expert witness.  The Advisory Committee Notes explain that the various techniques of discovery kick in by virtue of Rule 26(b), where automatic disclosure and report requirements of Rule 26(a) leave off:

“Rules 26(b)(4)(B) and (C) do not impede discovery about the opinions to be offered by the expert or the development, foundation, or basis of those opinions. For example, the expert’s testing of material involved in litigation, and notes of any such testing, would not be exempted from discovery by this rule. Similarly, inquiry about communications the expert had with anyone other than the party’s counsel about the opinions expressed is unaffected by the rule. Counsel are also free to question expert witnesses about alternative analyses, testing methods, or approaches to the issues on which they are testifying, whether or not the expert considered them in forming the opinions expressed. These discovery changes therefore do not affect the gatekeeping functions called for by Daubert v. Merrell Dow Pharmaceuticals, Inc., 509 U.S. 579 (1993), and related cases.[6]

The court in Ladd Furniture v. Ernst & Young explained the structure of Rule 26 with respect to underlying documents, calculations, and data[7].  In particular, the requirements of the Rule 26(a) report do not create a limitation on Rule 26(b) discovery:

“As a basis for withholding the above information, Ladd argues that Ernst & Young is not entitled to discover any expert witness information which is not specifically mentioned in Rule 26(a)(2)(B). However, as explained below, Ladd’s position on this point is not supported by the text of Rule 26 or by the Advisory Committee’s commentary to Rule 26(a). In the text, Rule 26(a)(2)(B) provides for the mandatory disclosure of certain expert witness information, even without a request from the opposing party. However, there is no indication on the face of the rule to suggest that a party is absolutely prohibited from seeking any additional information about an opponent’s expert witnesses. In fact, Rule 26(b)(1) describes the scope of allowable discovery as follows: ‛Parties may obtain discovery regarding any matter, not privileged, which is relevant to the subject matter involved in the pending action… .’ Fed. R. Civ. P. 26(b)(1).[8]

Expert witness discovery for materials that go beyond what is required in an adequate Rule 26(a) report can have serious consequences for the expert witness who fails to produce the requested materials. Opinion exclusion is an appropriate remedy against an expert witness who failed to keep data samples and statistical packages because the adversary party “could not attempt to validate [the expert witness’s] methods even if [the witness] could specifically say what he considered.[9]

No doubt expert witnesses and parties will attempt to resist the call for working notes and underlying materials on the theory that the requested documents and materials are “draft reports,” which are now protected by the revisions to Rule 26.  For the most part, these evasions have been rejected[10].  In one case, for instance, in which an expert witness’s assistants compiled and summarized information from individual case files, the court rejected the characterization of the information as part of a “draft report,” and ordered their production.[11]

Choice of Discovery Method Beyond Rule 26 Automatic Disclosure

In addition to the mandatory expert report and disclosure of data and facts, and the optional deposition by oral examination, parties have other avenues to pursue discovery of information, facts, and data, from expert witnesses. Under Rule 33(a)(2), parties may propound contention interrogatories that address expert witnesses’ opinions and conclusions. As for methods of discovery beyond what is discussed specifically in Rule 26, courts are confronted with a threshold question whether Rule 34 requests to produce, Rule 30(b)(2) depositions by oral examination, or Rule 45 subpoenas are the appropriate discovery method for obtaining documents from a retained, testifying expert witness. In the view of some courts, the resolution to this threshold question turns on whether expert witnesses are within the control of parties such that parties must respond to discovery for information, documents, and things within the custody, possession, and control of their expert witnesses.

Subpoenas Are Improper

Some federal district courts view Rule 45 subpoenas as inappropriate discovery tools for parties[12] and persons under the control of parties. In Alper v. United States[13], the district court refused to enforce plaintiff’s Rule 45 subpoena that sought documents from defendant’s expert witness. Although acknowledging that Rule 45’s language was unclear, the Alper court insisted that since a party proffers an expert witness, that witness should be considered under the party’s control[14]. And because the expert witness was “within defendant’s control,” the court noted that Rule 34 rather than Rule 45 governed the requested discovery[15]. Alper seems to be a minority view, but its approach is attractive in streamlining discovery, eliminating subpoena service issues for expert witnesses who may live outside the district, and forcing the sponsoring party to respond and to obtain compliance with its retained expert witness.

Subpoenas Are Proper

The “control” rationale of the Alper case is questionable. Rule 45 contains no statement of limitation to non-parties[16]. Parties “proffer” fact witnesses, but their proffers do not restrict the availability of Rule 45 subpoenas. More important, expert witnesses are not truly under the control of the retaining parties. Expert witnesses have independent duties to the court, and under their own professional standards, to give their own independent opinions[17].

Many courts allow discovery of expert witness documents and information by Rule 45 subpoena on either the theory that Rule 45 subpoenas are available for both parties and non-parties or the theory that expert witnesses are sufficiently independent of the sponsoring party that they are non-parties who are clearly subject to Rule 45. If expert witnesses are not parties, and Rule 26’s confidentiality provisions do not constrain the available discovery tools for expert witnesses, then expert witness subpoenas would appear to a proper discovery tool to discover documents in the witnesses’ possession, control, and custody[18]. When used as a discovery tool in this way, subpoenas used are subject to discovery deadlines[19].

Particular Concerns for Discovery of Statistician Expert Witnesses

Statistician expert witnesses require additional care and discovery investigation in complex products liability cases[20].  The caselaw sometimes takes a crabbed approach that refuses to provide parties access to their adversaries’ statistical analyses, calculations, data input  and output files, and graphical files.

Statistician expert testimony will usually involve complex statistical evidence, models, assumptions, and calculations. These materials will in turn create a difficulty in discerning the statistician’s choices from available statistical tests, and whether the statistician exploited the opportunity for multiple tests to be conducted serially with varying assumptions until a propitious result was obtained. Given these typical circumstances, statistical expert witness testimony will almost always require full disclosure to allow the adversary a fair opportunity to cross-examine at trial, or to challenge the validity of the proffered analyses under Rules 702 and 703[21].

Statisticians create and use a variety of materials that are clearly relevant to the their opinion:

  • programs and programming code run to generate all specified analyses on specified data,
  • statistical packages,
  • all data available,
  • all data “cleaning” or data selection processes,
  • selection of variables from those available,
  • data frames that show what data were included (and excluded) in the analyses,
  • data input files,
  • all specified tests run on all data,
  • all data and analysis output files that show all analyses generated,
  • all statistical test diagnostics and tests of underlying assumptions, and
  • graphical output files.

The statistician may have made any number of decisions or judgments in selecting which statistical test results to incorporate into his or her final report.  The report will in all likelihood not include important materials that would allow another statistician to fully understand, test, replicate, and criticize the more conclusory analysis and statements in the report.  In addition, lurking in the witnesses files, or in the electronic “trash bin” may be alternative analyses that were run and discarded, and not included in the final report.  Why and how those alternative analyses were run but discarded, may raise important credibility or validity questions, as well as provide insight into the statistician’s analytical process, all important considerations in preparing for cross-examination and rebuttal.  The lesson of Rule 26, and the caselaw interpreting its provisions, is that lawyers must make specific request for the materials described above.  Only with these materials firmly in hand, can a deposition fully explore the results obtained, the methods used, the assumptions made, the assumptions violated, the alternative methods rejected, the data used, the data available, data not used, the data-dredging and manipulation potential, analytical problems, and the potential failure to reconcile inconsistent results. Waiting for trial, or even for the deposition, may well be too late[22].

The warrant for examining the integrity of data relied upon by expert witnesses appears to be securely embedded in the Federal Rules of Civil Procedure, and in the Federal Rules of Evidence. Evidence Rule 703 has particular relevance to statistical or epidemiologic testimony. Lawyers facing studies of dubious quality may need to press for discovery of underlying data and materials. In the Viagra vision loss multi-district litigation (MDL), the defendant sought and obtained discovery of underlying data from plaintiffs’ expert witness’s epidemiologic study of vision loss among patients using Viagra and similar medications[23]. Although the Viagra MDL court had struggled with inferential statistics in its first approach to defendant’s Rule 702 motion, the court understood the challenge based upon lack of data integrity, and reconsidered and granted defendant’s motion to exclude the challenged expert witness[24].

The lawyering implications for discovery of statistician expert witnesses are important. Statistical evidence requires counsel’s special scrutiny to ensure compliance with the disclosure requirements of Federal Rule of Civil Procedure 26. Given the restrictive reading of Rule 26 by some courts, counsel will need to anticipate the use of other discovery tools. Lawyers should request by Rule 34 or Rule 45, all computer runs, programming routines, and outputs, and they should zealously pursue witnesses’ failure to maintain and produce data. Given the uncertainty in some districts whether expert witnesses are subject to subpoenas, counsel may consider propounding both Rule 34 requests and serving Rule 45 subpoenas.

Lawyers in data-intensive cases should give early consideration to appropriate discovery plans that contemplate data production in advance of depositions, to allow full exploration of analyses at deposition[25]. Lawyers should also be alert to the potential need to show particularized need for the requested data and analyses. In instructing expert witnesses on their preparation of their reports, lawyers should consider directing their expert witnesses to express whether they need further access to the adversary’s expert witnesses’ underlying data and materials to fully evaluate the proffered opinions. Discovery of statisticians and their data and their analyses requires careful planning, as well as patient efforts to educate the court about the need for full exploration of all data and all analyses conducted, whether or not incorporated into the Rule 26 report.


[1] Randall v. Rolls-Royce Corp., 2010 U.S. Dist. LEXIS 23421, *4-5 (S.D. Ind. March 12, 2010) (“Dr. Harnett who began his evaluation of the analysis contained in the report … soon concluded that he needed the underlying studies and statistical programs created or used by Dr. Drogin. In response to the Defendants’ request for such materials, Plaintiffs produced four discs containing more than 1,000 separate electronic files”).

[2] Marsh v. Jackson, 141 F.R.D. 431, 432–33 (W.D. Va. 1992) (holding that Rule 45 could not be used to obtain an opposing expert’s files because Rule 26(b)(4) limits expert discovery to depositions and interrogatories as a policy matter)

[3] See Advisory Comm. Notes for 1993 Amendments, to Fed. R. Civ. P. 26(a) (“The enumeration in Rule 26(a) of items to be disclosed does not prevent a court from requiring by order or local rule that the parties disclose additional information without a discovery request. Nor are parties precluded from using traditional discovery methods to obtain further information regarding these matters, … .”); United States v. Bazaarvoice, Inc., C 13-00133 WHO (LB), 2013 WL 3784240 (N.D. Cal. July 18, 2013) (“Rule 26(a)(2)(B) . . . does not preclude parties from obtaining further information through ordinary discovery tools”) (internal citations omitted).

[4] Morriss v. BNSF Ry. Co., No. 8:13CV24, 2014 WL 128393, at *4–6, 2014 U.S. Dist. LEXIS 3757, at *17 (D.Neb. Jan. 13, 2014) (holding that “absent some threshold showing of “compelling reason,” the broad discovery provisions of Rules 34 and 45 cannot be used to undermine the specific expert witness discovery rules in Rule 26(a)(2)”).

[5] Modjeska v. United Parcel Service Inc., No. 12–C–1020, 2014 WL 2807531 (E.D. Wis. June 19, 2014) (holding that Rule 26(a)(2)(B) governs only disclosure in expert witness reports and does not limit or preclude further discovery using ordinary discovery such as requests to produce); Expeditors Int’l of Wash., Inc. v. Vastera, Inc., No. 04 C 0321, 2004 WL 406999, at *3 (N.D. Ill. Feb.26, 2004). See also Wright & Miller, 9A Federal Practice & Procedure Civ. § 2452 (3d ed. 2013).

[6] Adv. Comm. Note for Rule 26(b)(4)(B)(2010).  See, e.g., Ladd Furniture v. Ernst & Young, 1998 U.S. Dist. LEXIS 17345, at *34-37 (M.D.N.C. Aug. 27, 1998).

[7] Id.

[8] Id. at *36-37.

[9] Innis Arden Golf Club v. Pitney Bowes, Inc., 629 F. Supp. 2d 175, 190 (D. Conn. 2009) (excluding expert opinion because his samples and data packages no longer existed and thus “[d]efendants could not attempt to validate [his] methods even if he could specifically say what he considered”). See also Jung v. Neschis, No. 01–Civ. 6993(RMB)(THK), 2007 WL 5256966, at *8–15 (S.D.N.Y. Oct. 23, 2007) (finding that a party’s failure to produce tape recordings that its medical expert witness relied upon for his opinion was ‘‘disturbing’’; precluding expert witness’s testimony).

[10] See, e.g., Dongguk Univ. v. Yale Univ., No. 3:08-CV-00441, 2011 WL 1935865, at *1 (D. Conn. May 19, 2011) (holding that “an expert’s handwritten notes are not protected from disclosure because they are neither drafts of an expert report nor communications between the party’s attorney and the expert witness”).

[11] D.G. ex rel. G. v. Henry, No. 08-CV-74-GKF-FHM, 2011 WL 1344200, at *1 (N.D. Okla. Apr. 8, 2011) (ordering production of the assistants’ notes because the expert witness had relied upon them in forming his opinion, which brought them within the scope of “facts or data” under the rule).

[12] Mortgage Info. Servs, Inc. v. Kitchens, 210 F.R.D. 562, 564-68 (W.D.N.C. 2002) (holding that nothing in Rule 45 precludes its use on a party); See also Mezu v. Morgan State Univ., 269 F.R.D. 565, 581 (D. Md. 2010) (“courts are divided as to whether Rule 45 subpoenas should be served on parties”); Peyton v. Burdick, 2008 U.S. Dist. LEXIS 106910 (E.D. Cal. 2008) (discussing the split among courts on the issue).

[13] 190 F.R.D. 281 (D. Mass. 2000).

[14] Id. at 283.

[15] Id. See Ambrose v. Southworth Products Corp., No. CIV.A. 95–0048–H, 1997 WL 470359, 1 (W.D. Va. June 24, 1997) (holding a “naked” subpoena duces tecum directed to a non-party expert retained by a party is not within the ambit of a Rule 45 document production subpoena, and not permitted by Fed. R. Civ. Pro. 26(b)(4)); see also Hartford Fire Ins. v. Pure Air on the Lake Ltd., 154 F.R.D. 202, 208 (N.D. Ind. 1993) (holding a party cannot use Rule 45 to circumvent Rule 26(b)(4) as a method to obtain an expert witness’s files); Marsh v. Jackson, 141 F.R.D. 431, 432 (W.D. Va. 1992) (noting that subpoena for production of documents directed to non-party expert retained by a party is not within ambit of Fed. Rule 45(c)(3)(8)(ii)).

[16] See James Wm. Moore, 9 Moore’s Federal Practice § 45.03[1] (noting that “[s]ubpoenas under Rule 45 may be issued to parties or non-parties”).

[17] See Glendale Fed. Bank, FSB v.United States, 39 Fed. Cl. 422, 424 (Fed. Cl. 1997) (“The expert witness, testifying under oath, is expected to give his own honest, independent opinion… He is not the sponsoring party’s agent at any time merely because he is retained as its expert witness”). See also National Justice Compania Naviera S.A. v. Prudential Assurance Co. Ltd., (“The Ikarian Reefer”), [1993] 2 Lloyd’s Rep. 68 at 81-82 (Q.B.D.), rev’d on other grounds [1995] 1 Lloyd’s Rep. 455 at 496 (C.A.) (embracing the enumeration of duties, including a duty to “provide independent assistance to the Court by way of objective unbiased opinion in relation to matters within his expertise,” and a duty to eschew “the role of an advocate”).

[18] Western Res., Inc. v. Union Pac. RR, No. 00-2043-CM, 2002 WL 1822428, at *3 (D. Kan. July 23, 2002) (ordering expert witness to produce prior testimony under Rule 45); All W. Supply Co. v. Hill’s Pet Prods. Div., Colgate-Palmolive Co., 152 F.R.D. 634, 639 (D. Kan. 1993) (“With regard to nonparties such as plaintiff’s expert witness, a request for documents may be made by subpoena duces tecum pursuant to Rule 45”); Smith v. Transducer Technology, Inc., No. Civ. 1995/28, 2000 WL 1717332, 2 (D.V.I. Nov. 16, 2000) (holding that Rule 30(b)(5) deposition notice, served upon opposing party, is not an appropriate discovery tool to compel expert witness to produce documents from at his deposition) (noting that a “Rule 45 subpoena duces tecum in conjunction with a properly noticed deposition may do so (subject however to any Rule 26 limitations)”); Thomas v. Marina Assocs., 202 F.R.D. 433, 434 (E.D. Pa. 2001) (denying motion to quash subpoenas issued to party’s expert witness); Quaile v. Carol Cable Co., Civ. A. No. 90-7415, 1992 WL 277981, at *2 (E.D. Pa. Oct. 5, 1992) (granting motion to compel discovery concerning expert witness’s opinions pursuant to a Rule 45 subpoena); Lawrence E. Jaffe Pension Plan v. Household Int’l, Inc., No. 02 C 5893, 2008 WL 687220, at *2 (N.D. Ill Mar. 10, 2008) (“It is clear . . . that a subpoena duces tecum . . . is an appropriate discovery mechanism against . . . a party’s expert witness”) (internal citation omitted); Expeditors Internat’l of Wash., Inc. v. Vastera, Inc., No. 04 C 0321, 2004 WL 406999, at *2-3 (N.D. Ill. Feb. 26, 2004) (holding Rule 45, not Rule 34, governs discovery from retained experts) (“Subpoena duces tecum is . . . an appropriate discovery mechanism against nonparties such as a party’s expert witness”); Reit v. Post Prop., Inc., No. 09 Civ. 5455(RMB)(KNF), 2010 WL 4537044, at *9 (S.D.N.Y. Nov. 4, 2010) (“Subpoena duces tecum … is an appropriate discovery mechanism against a nonparty expert”).

[19] See, e.g., Williamson v. Horizon Lines LLC , 248 F.R.D. 79, 83 (D. Me. 2008) (“[C]ontrary to Horizon Lines’ contention, there is a relationship between Rule 26 and Rule 45 and parties should not be allowed to employ a subpoena after a discovery deadline to obtain materials from third parties that could have been produced before discovery.”).

[20] Bartley v. Isuzu Motors Ltd., 151 F.R.D. 659, 660-61 (D. Colo. 1993) (ordering party to create and preserve “the input and output data for each variable in the program, for each iteration, or each simulation,” as well as a record of all simulations performed, even those that do not conform to the plaintiff’s claims and theories in the case).

[21] See City of Cleveland v. Cleveland Elec. Illuminating Co., 538 F. Supp. 1257 (N.D. Ohio 1980) (“Certainly, where, as here, the expert reports are predicated upon complex data, calculations and computer simulations which are neither discernible nor deducible from the written reports themselves, disclosure thereof is essential to the facilitation of effective and efficient examination of these experts at trial.”); Shu-Tao Lin v. McDonnell-Douglas, Corp., 574 F. Supp. 1407, 1412-13 (S.D.N.Y. 1983) (granting new trial, and holding that expert witness’s failure to disclosure the “nature of [the plaintiff’s testifying expert’s] computer program or the underlying data, the inputs and outputs employed in the program” deprived adversary of an “adequate basis on which to cross-examine plaintiff’s experts”), rev’d on other grounds, 742 F.2d 45 (2d Cir. 1984).

[22] Manual for Complex Litigation at 99, § 11.482 (4th ed. 2004) (“Early and full disclosure of expert evidence can help define and narrow issues. Although experts often seem hopelessly at odds, revealing the assumptions and underlying data on which they have relied in reaching their opinions often makes the bases for their differences clearer and enables substantial simplification of the issues. In addition, disclosure can facilitate rulings well in advance of trial on objections to the qualifications of an expert, the relevance and reliability of opinions to be offered, and the reasonableness of reliance on particular data.207”). See also ABA Section of Antitrust Law, Econometrics: Legal, Practical, and Technical Issues at 75-76 (2005) (advising of the necessity to obtain all data, all analyses, and all supporting materials, in advance of deposition to ensure efficient and effective discovery procedures).

[23] In re Viagra Prods. Liab. Litig., 572 F. Supp. 2d 1071, 1090 (D. Minn. 2008).

[24] In re Viagra Prods. Liab. Litig., 658 F. Supp. 2d 936, 945 (D. Minn. 2009).

[25] See Fed. R. Civ. Pro. 16(b); 26(f).