TORTINI

For your delectation and delight, desultory dicta on the law of delicts.

National Academies’ Teaching Modules on Scientific Policy Issues

June 30th, 2016

Today, the National Academies of Sciences, Engineering, and Medicine announced its release of nine teaching modules to help public policy decision makers and students in professional schools understand the role of science in policy decision making.[1] The modules were developed by university faculty members for  the use of other faculty who want to help their students appreciate the complexity and nuances of the evidence for and against scientific claims.

A group within the Academies’ Committee on Science, Technology and the Law supervised the development of the teaching modules, which are now publicly available at the Academies’ website. The Committee was chaired by Paul Brest, former dean and professor emeritus (active), Stanford Law School, and Saul Perlmutter, Franklin W. and Karen Weber Dabby Chair, University of California, Berkeley, and senior scientist, E.O. Lawrence Berkeley National Laboratory. The Gordon and Betty Moore Foundation and the National Biomedical Research Foundation sponsored the development of the modules.

The modules use case studies to illustrate basic scientific and statistical principles involved in contemporary scientific issues that have significant policy implications. The modules are designed to help future policy and decision makers understand and evaluate the scientific evidence that they will doubtlessly encounter. To date, nine modules have been developed and released, in the hope that they will serve as references and examples for future teaching modules.

The nine modules prepared to date are:

Models: Scientific Practice in Context

prepared by:
– Elizabeth Fisher, Professor of Environmental Law, Faculty of Law and Corpus Christi College, Oxford University
– Pasky Pascual, Environmental Protection Agency
– Wendy Wagner, Joe A. Worsham Centennial Professor,  University of Texas at Austin School of Law

The Interpretation of DNA Evidence: A Case Study in Probabilities

prepared by:

– David H. Kaye, Associate Dean for Research and Distinguished Professor, The Pennsylvania State University (Penn State Law)

Translating Science into Policy: The Role of Decision Science

prepared by:

– Paul Brest, Former Dean and Professor Emeritus (active), Stanford Law School

Placing a Bet: A New Therapy for Parkinson’s Disease

prepared by:

– Kevin W. Sharer, Senior Lecturer, Harvard Business School, Harvard University

Shale Gas Development

prepared by:

– John D. Graham, Dean, School of Public and Environmental Affairs, Indiana University
– John A. Rupp, Adjunct Instructor, School of Public and Environmental Affairs, and Senior Research Scientist, Indiana Geological Survey, Indiana University
– Adam V. Maltese, Associate Professor of Science Education, School of Education, and Adjunct Faculty in Department of Geological Sciences, Indiana University

Drug-Induced Birth Defects: Exploring the Intersection of Regulation, Medicine, Science, and Law

prepared by:

– Nathan A. Schachtman, Lecturer in Law, Columbia Law School

Vaccines

prepared by:

– Arturo Casadevall, Professor and Chair, W. Harry Feinstone Department of Molecular Microbiology and Immunology, Johns Hopkins University Bloomberg School of Public Health

Forensic Pattern Recognition Evidence

prepared by:

– Simon A. Cole, Professor, Department of Criminology, Law, and Society, Director, Newkirk Center for Science and Society, University of California, Irvine
– Alyse Berthental, Ph.D. Candidate, Department of Criminology, Law, and Society, University of California, Irvine
– Jaclyn Seelagy, Scholar, PULSE (Program on Understanding Law, Science, and Evidence),  University of California, Los Angeles School of Law

Scientific Evidence of Factual Causation

prepared by:

– Steve C. Gold, Professor of Law, Rutgers School of Law-Newark
– Michael D. Green, Williams Professor of Law, Wake Forest University School of Law
– Joseph Sanders, A.A. White Professor of Law, University of Houston Law Center


[1] SeeAcademies Release Educational Modules to Help Future Policymakers and Other Professional-School Students Understand the Role of Science in Decision Making” (June 30, 2016).

Whether to Conduct Depositions of Expert Witnesses

June 23rd, 2016

In a Litigation magazine article, Gregory Joseph sets out some strong reasons to consider for not conducting depositions of expert witnesses under the revised 2010 Federal Rules of Civil Procedure (FRCP). See Gregory P. Joseph, “The Temptation to Depose Every Expert,” 40 Litigation 35 (Winter 2014) [cited below as Joseph]. Joseph points out that FRCP 26(a)(2)(B) requires parties to disclose, for all retained expert witnesses, “all opinions” and the “full factual basis” of all their opinions, among other things. The rule is exacting. All opinions includes “a complete statement of all opinions the witness will express and the basis and reasons for them.” FRCP 26(a)(2)(B)(i). And a full factual basis includes “the facts or data considered by the witness in forming” all of the opinions disclosed in the report. FRCP 26(a)(2)(B)(ii) (emphasis added).

Joseph argues that the breadth of the required disclosure, combined with sanctions for retained expert witnesses’s attempting to testify beyond the four corners of their reports, should give lawyers sufficient assurances in many instances to forego conducting depositions of expert witnesses.

Joseph notes that the FRCP creates a presumptive mandatory sanction of exclusion for undisclosed expert testimony. FRCP 37(c)(1).[1]  Joseph offers other arguments beyond the supposed comfort given by the “four corners” rule set out in the FRCP. Joseph at 36-37. First, the deposition may “reopen” discovery by giving expert witnesses opportunities to expand upon the four corners of their reports. Although some courts will limit what expert witnesses can throw over the transom at depositions, a supervising magistrate or district judge may not regard the expansion upon the disclosures in the report as “sandbagging,” and thus fail exclude the arguably new opinions or bases. Joseph cites a few cases in which courts condemned the sandbagging of counsel by the offering of new opinions in depositions, but points out that exclusion is this circumstance is highly discretionary. The court is not required to exclude, and it may permit the new material, or allow the new material with an inadequate amount of additional time in deposition. So taking the deposition has risks.

Joseph argues also that depositions may educate expert witnesses about intended trial cross-examination, and help adversary counsel better prepare direct examination and anticipatory rebuttal. Furthermore, the new protections afforded expert witnesses from discovery into drafts of reports and most communications with retaining counsel take away one of the previous reasons to conduct depositions.

To be sure, some additional areas of discovery may be covered by interrogatories, Rule 34 document requests, or Rule 45 subpoenas directly to the expert witnesses. These non-deposition methods of discovery, however, will not reach valuable topics of discovery such as oral communications between retained expert witnesses and professional colleagues, consulting expert witnesses, the retaining lawyers’ clients, and other persons. The suggested alternative discovery methods also suffer in that they will provoke canned answers, written by counsel, and not the ingenuous, unrehearsed responses of expert witnesses required to give answers directly and without resort to  “privileged” consultation with retaining counsel.

The revised FRCP carve out important areas of inquiry from the new protections against discovery into draft reports and with counsel. Counsel still are permitted to inquire into compensation, the retaining attorneys’ provision of “facts or data” considered by the witnesses, and retaining attorneys’ identification of assumptions “relied” upon by the witnesses. Invoices can, of course, be subpoenaed, but often oral examination is required to discover whether the invoices have been paid, whether they are contingent, or whether payment flows to the personal benefit of the expert witnesses. Inquiring into what “facts or data” were provided by retaining counsel can be attempted by written discovery, but the written responses will likely be hedged and unclear, and the responses will not distinguish which lawyer-provided “facts or data” were actually relied upon.

The FRCP clearly allow discovery into retaining attorneys’ provision of assumptions relied upon by expert witnesses, but clear, unrehearsed answers to questions about what was assumed and relied upon, as opposed to merely considered, are not likely to be forthcoming in written discovery. Furthermore, if there will be any fair opportunity to explore the significance of relying upon counsel’s assumptions, only a deposition will likely allow for the extemporaneous, first-person expression of expert witnesses’ opinions. Questions into expert witnesses’ opinions based upon hypothetical questions that contradict the assumptions given, or into opinions about the level of confidence or knowledge witnesses have about the correctness of the assumptions, are likely to be effective only in face-to-face encounters.

There are important additional reasons for taking expert witness depositions, not addressed in Joseph’s article. Litigation-savvy expert witnesses will often glibly assert that they have “considered” all the relevant studies, data, and facts. If written discovery is propounded to inquire whether a study omitted from the “consideration” list in the FRCP report was not considered, the study, if meaningful, will be added to the list in the written response with a feeble excuse that it was inadvertently omitted from the list. And the omission will likely be judged harmless because the party seeking discovery obviously knew about the omitted study already. Written discovery into what studies, data, or facts were considered but not relied upon will also yield highly rehearsed answers, and interrogatories will not permit inquiries into the fine details of key studies.

The pertinent sections of the FRCP do not require expert witness reports to distinguish what the witnesses have considered from what they have actually relied upon. Written discovery could be propounded, but again, it will not likely yield clear answers such as might be had with follow up inquiry into what was considered but not relied upon, and why was reliance rejected. The deposition upon oral examination has the benefit of permitting follow up questions into why some studies were relied upon for some parts but not others, or were considered but completely excluded from actual reliance. The opportunity to field incoherent, inconsistent rationales for inclusions and exclusions that establish expert witness cherry picking will be lost without the face-to-face encounter allowed by oral examination.

With some courts engaged in retrograde refusal to apply Rule 702 as enacted, some expert witnesses have been encouraged to employ vague, invalid, and unreliable methodologies, such as the so-called “weight of the evidence” approach. Oral examination will be necessary to establish expert witnesses’ weighting considerations, their inclusion and exclusion criteria, and to test their consistency in applying these considerations and criteria, across the entire evidentiary base for conclusions.

Concessions to Be Obtained

Written discovery is not well suited to inquire into general principles of interpreting data and studies, data integrity and validity, and validity of inference.  Interrogatories are too difficult to draft in sufficient detail to permit setting up an examination that will lead to the disqualification of the expert witness under Rule 702.  Obtaining concise, clear concessions about basic methodological principles is crucial to structuring persuasive cross-examinations.  Of course, if the deponent balks at accepting generally accepted principles, then this testimony is filed under Rule 702 motion, rather than trial cross-examination.

Furthermore, written discovery is poorly suited to identify whether expert witnesses have subject-matter weaknesses.  Interrogatories are the wrong discovery tool to conduct pop-quizzes on arcane statistical and scientific methodologies. Lawyers rightfully do not want to get into show-game style quizzes to test expert witnesses’ understanding of the esoteric, but important, methodologies used in the studies relied upon, in front of a jury. Rule 26 reports rarely announce that witnesses have had no meaningful training in statistics and that they have no idea what assumptions were made in various statistical analyses or tests in the studies that they have embraced and relied upon for their opinions.

Expert witnesses have social and professional connections not always apparent from their curriculum vitae, their Rule 26 reports, or their websites. Expert witnesses are not likely, for instance, to disclose that they are Marxists, who believe that corporations are evil and mercenary, and cannot be trusted to tell the truth in litigation.[2]

As noted, the FRCP requires disclosure of facts or data considered, which disclosure is usually inadequate to permit distinguishing what was actually relied upon in forming opinions. But what about opinions considered or relied upon? FRCP does not address reliance upon opinions; nor does Rule 703. Expert witnesses may contend that their opinions are not “based upon” others’ opinions, but that their opinions are strengthened and corroborated by the opinions of others. The FRCP do not specifically call for disclosure of opinions relied upon by retained expert witnesses, and adversary counsel can be trusted to argue that there were no obligations to disclose opinions or the identity of “authoritative” treatises and publications. If there is no entitlement to disclosure, there can be no surprise and prejudice.

Interpreting the scope of the report may not be as clear as Joseph suggests.  Rule 26 reports usually contain some opinions with sufficient breadth and generality that foregoing depositions becomes a game of Russian roulette.  Trial judges may not look kindly upon “scope of the report” objections, made at trial, when the objecting counsel had the opportunity to conduct an examination, and the report language is sufficiently broad to intimate the witness’s opinion at trial. Judges seem to have great hindsight vision, and they may well distrust counsel’s objections as a different sort of sandbagging. An entire strategy of restraint may be sunk by a quick, discretionary ruling on “scope of the report,” which often will favor the proponent of the witness.

Joseph is correct that many depositions fail to accomplish much, but such failures are not the result of how wonderful the revised FRCP are.  Failed depositions are more likely to result from the lack of preparation, creativity and knowledge of counsel in carrying out coherent, effective depositions.


[1] See Primus v. United States, 389 F.3d 231, 234 (1st Cir. 2004); Vaughn v. City of Lebanon, 18 F.App’x 252, 263 (6th Cir. 2001); Musser v. Gentiva Health Services, 356 F.3d 751, 758 (7th Cir. 2004). See also Design Strategy, Inc. v. Davis, 469 F.3d 284, 296 (2d Cir. 2006) (characterizing exclusion as discretionary, but upholding district court’s exclusion).

[2] Such as may be seen with expert witnesses who belong to the Committees of Correspondence for Democracy and Socialism, a branch of the Communist Party USA, formed in 1992, after the demise of the Soviet Union.

The IARC Announces Water Causes Cancer

June 18th, 2016

Well, drinking water very hot, or other scalding beverages, probably does cause cancer. Earlier this week, the International Agency for Research on Cancer (IARC) issued a press release that one of its working groups had reviewed the data on the carcinogencity of coffee, maté, and very hot beverages, and concluded that maté, which is often served very hot, “probably” causes esophageal cancer. IARC Press Release N° 244, “IARC Monographs evaluate drinking coffee, maté, and very hot beverages” (June 15, 2016). Very hot beverages were rated 2A, for their probably causing human esophageal cancer.

The good news is that “probably” does not mean “more likely than not” in IARC-speak, and the working group was evaluating hazard not risk.[1] IARC classifications do not attempt to quantify the magnitude of risk that may result from exposure to a classified “hazard.” Id. at Note to the Editor. Because all empirical propositions have a probability of being true, somewhere between 0 and 100%, (with P ≠ 0; P ≠ 100%), the IARC classifications of “probably” causing cancer are probably not particularly meaningful.  Everything “probably” causes cancer in this sense. See Ed Yong, “Beefing With the World Health Organization’s Cancer Warnings,” The Atlantic (Oct 26, 2015).

The IARC group’s evaluation of “very hot drinks” accords with the World Health Organization’s Technical Report Series 916 on Diet, Nutrition and the Prevention of Chronic Diseases, which recommends against consumption of scalding hot temperatures. See Anahad O’Connor, “Coffee May Protect Against Cancer, W.H.O. Concludes,” N.Y. Times (June 15, 2016)[O’Connor]. As though people, other than McDonald’s coffee drinkers, needed such a recommendation. The IARC group found no conclusive evidence to implicate drinking cold maté, or maté at temperatures below scalding levels.

An IARC Decision We Can Like a Latte

The Working Group found no conclusive evidence for a carcinogenic effect of drinking coffee, and placed coffee in its category 3, “not classifiable” with respect to carcinogenicity.[2] The working group’s evaluation included over 1,000 observational and experimental studies, including randomized trials, and found no evidence to support the claims that coffee causes human cancer. The IARC also found a good deal of evidence supporting the claim that drinking coffee reduces the risk of various human cancers.

There is a Group 4, for exposures probably not carcinogenic in humans, but in its 45 years of evaluations, the IARC has found only one substance on Planet Earth, which does not cause cancer:  caprolactam.  Perhaps after another 1,000 studies, coffee will reach this exalted category. For now, coffee is unclassifiable with “inadequate” evidence of human carcinogenicity in the IARC’s view.

The New York Times, not particularly expertly, and without supporting citations, declared that the evidence for coffee’s health benefits could not establish actual causation of benefit because the data came from epidemiologic studies.  See O’Conner. This would not be the first time that the New York Times made up things.

In 1991, the IARC evaluated coffee drinking as a “possible” human carcinogen (Group 2B), based upon limited evidence of an association with urinary bladder cancer in case-control studies, and some evidence in experimental animals.[3] This year’s evaluation of coffee as Group 3 thus represents a rare reversal of opinion, in the face of additional evidence, from the IARC.


[1] The IARC Preamble definition of probable reveals that “probable” does not mean greater than 50%. See alsoThe IARC Process is Broken” (May 4, 2016).

[2] See Dana Loomis, Kathryn Guyton, Yann Grosse, Béatrice Lauby-Secretan, Fatiha El Ghissassi, Véronique Bouvard, Lamia Benbrahim-Tallaa, Neela Guha, Heidi Mattock, Kurt Straifon behalf of the IARC Monograph Working Group, “Carcinogenicity of drinking coffee, mate, and very hot beverages,” Lancet Oncology (2016 in press).

[3] IARC, “Coffee, tea, mate, methylxanthines and methylglyoxal,” 51 IARC Monogr Eval Carcinog Risks Humans 1 (1991).