TORTINI

For your delectation and delight, desultory dicta on the law of delicts.

Systematic Reviews versus Expert Witness Reports

July 2nd, 2025

Back in November 2024, I posted that the fourth edition of the Reference Manual on Scientific Evidence was completed, and that its publication was imminent. I based my prediction upon the National Academies’ website that reported that the project had been completed. Alas, when no Manual was forth coming, I checked back, and the project was, and is as of today, marked as “in progress.” The NASEM website provides no explanation for the retrograde movement. Could the Manual have been DOGE’d? Did Robert F. Kennedy Jr. insist that a chapter on miasma theory be added?

Ever since the third edition of the Manual arrived, I have tried to identify its strengths and weaknesses, and to highlight topics and coverage that should be improved in the next edition. In 2023, knowing that people were working on submissions for the fourth edition, I posted a series of desiderata for the new edition.[1] I might well have extended the desiderata, but I thought that work was close to completion.

One gaping omission in the third edition of the Manual, which I did not address, is the dearth of coverage of the synthesis of data and evidence across studies. To be sure, the chapter on medical testimony does discuss the “hierarchy of medical evidence, and places the systematic review at the apex.[2] The chapter on epidemiology, however, fails to discuss systematic reviews in a meaningful way, and treats meta-analysis, which ideally pre-supposes a systematic review, with some hostility and neglect.[3]

Notwithstanding the glaring omission in the 2011 version of the Reference Manual, the legal academy had been otherwise well aware of the importance of properly conducted systematic reviews. Back in 2006, Professor Margaret Berger organized a symposia on law and science, at which John Ioannidis presented on the importance of systematic reviews.[4] Lisa Bero also presented on systematic reviews and meta-analyses, and identified a significant source of bias in such reviews that results when authors limit their citations to studies that support their pre-selected, preferred conclusion.[5] Bero’s contribution, however, missed the point that a well-conducted systematic review makes cherry picking much more difficult, as well as obvious to the reader.

The high prevalence of biased citation and consideration of, and reliance upon, studies is a major source of methodological error in courtroom proceedings. Even when the studies relied upon are reasonably well done, expert witnesses can manipulate the evidentiary display through biased selection and exclusion of what to present in support of their opinions. Sometimes astute judges recognize and bar expert witnesses who would pass off their opinions, as well considered, when they are propped up only by biased citation. Unfortunately, courts have not always been vigilant and willing to exclude expert witnesses who proffer biased, invalid opinions based upon cherry-picked evidence.[6] Given that cherry picking or “biased citation” is recognized in the professional community as rather serious methodological sins, judges may be astonished to learn that both phrases, “cherry picking” and “biased citation” do not appear in the third edition of the Reference Manual on Scientific Evidence. With the delay in publishing the fourth edition, there is still time to add citations to careful debunking of biased citation, such as the reverse-engineered systematic review and meta-analysis in last year’s decision in the paraquat parkinsonism litigation.[7]

When I began my courtroom career, systematic reviews of the evidence for a causal claim were virtually non-existent. Most reviews and textbook chapters were hipshots that identified a few studies that supported the author’s preferred opinion, with perhaps a few disparaging words about a study that contradicted the author’s preferred outcome. On a controversial issue, lawyers could generally find a textbook or review article on either side of an issue. Cross-examination on a so-called “learned treatise,” however, was limited. In state courts, the learned treatise was not admissible for its truth, but only to show that expert witnesses should not be believed when they disagreed with the statement. It was all too easy for an expert witness to declare, “yes, I disagree with that one sentence, on one page, out of 1,500 pages, in that one book.”

In federal courts, the applicable rule of evidence makes the learned treatise statement admissible for its truth:

“Rule 803. Exceptions to the Rule Against Hearsay

The following are not excluded by the rule against hearsay, regardless of whether the declarant is available as a witness:

(18) Statements in Learned Treatises, Periodicals, or Pamphlets . A statement contained in a treatise, periodical, or pamphlet if:

(A) the statement is called to the attention of an expert witness on cross-examination or relied on by the expert on direct examination; and

(B) the publication is established as a reliable authority by the expert’s admission or testimony, by another expert’s testimony, or by judicial notice.

If admitted, the statement may be read into evidence but not received as an exhibit.”

While this rule historically had some importance in showing the finder of fact that the opinion given in court was not shared with the relevant expert community, the rule was and is problematic. Exactly what counts as “learned” is undefined. Expert witnesses on either side can simply endorse a treatise, a periodical, or a pamphlet as learned to enable a lawyer to use it on direct or cross-examination, and make its contents admissible. The rule was drafted and enacted in 1975, when another rule, Rule 702, was generally interpreted to place no epistemic restraints upon expert witnesses. Allowing Rule 803(18) to be invoked without the epistemic constraints of Rules 702 and 703 raised few concerns in 1975, but in the aftermath of Daubert (1993), the tension within the Federal Rules of Evidence requires that the admissibility of a statement in a learned treatise cannot save an expert witness opinion that is not otherwise sufficiently grounded and valid.[8]

Systematic reviews are a different kettle of fish from the sort of textbook opinions of the 1970s and 1980s, which often lacked comprehensive assessments and consistent application of criteria for validity. The intersection of the evolution of Rule 702 and systematic reviews is remarkable. When Rule 702 was drafted, systematic reviews were non-existent. When the Supreme Court decided the Daubert case in 1993, systematic reviews were just emerging as a different and superior form of evidence synthesis.[9] The lesson for judges, regulators, and lawyers is that the standards for valid synthesis of studies and lines of evidence have changed and become more demanding.

In 2009, several professional groups produced an important guidance for reporting systematic reviews, “the Preferred Reporting Items for Systematic reviews and Meta-Analyses,” or PRISMA.[10] Although the PRISMA guidance ostensibly addresses reporting, if authors have not done something that should be reported, their failure to do it and report about it can be identified as a significant omission from their publication. One of the PRISMA specifications called for the writing of a protocol for any systematic review, and for making this protocol available to the scientific community and the public. The protocol will identify the exact clinical issue under review, the kinds of evidence that bear on the issue, and criteria for including or excluding studies that should be included in the review. The requirement of pre-registration has the ability to damp down data dredging in observational studies and experiments, and to help readers see when authors reverse engineered systematic reviews by declaring their criteria for inclusion and exclusion after reading candidate studies and their conclusions.

In 2011, the Centre for Reviews and Dissemination, at the University of York in England, developed an internet archive, PROSPERO, for prospectively registering systematic reviews. In addition to reducing duplication of systematic reviews, PROSPERO aimed to increase transparency, validity, and integrity of the systematic reviews. Around the same time, the Center for Open Science, also set up a web-based archive for systematic review protocols.[11]

Reviews purporting to be systematic are now commonplace. By 2018, ROSPERO had registered over 30,000 records, but of course, some scientists may have registered systematic reviews which they never completed.[12] Despite the publication of professional guidances, carefully performed systematic reviews can still be hard to find.[13]

In federal court, expert witnesses must proffer their opinions in a specified form. Back in the 1980s, federal court practice on expert witnesses was “loose” not only on admissibility issues, but also on the requirements for pre-trial disclosure of opinions. In some federal districts, such as those within Pennsylvania, federal judges took their cues not from the language of the Federal Rules of Civil Procedure, but from state court practice, which required only cursory disclosure of top-level opinions without identifying all facts and data relied upon by the proposed expert witness. In many state courts, and in some federal judicial districts, lawyers had a difficulty obtaining judicial authorization to conduct examinations before trial to discover all the bases and reasoning (if any) behind an expert witness’s opinion. Under the current version of the Federal Rules of Civil Procedure, trial by ambush has generally given way to full discovery. The current version of Rule 26 provides:

Rule 26. Duty to Disclose; General Provisions Governing Discovery

(a) Required Disclosures.

* * *

(2) Disclosure of Expert Testimony.

(A) In General. In addition to the disclosures required by Rule 26(a)(1) , a party must disclose to the other parties the identity of any witness it may use at trial to present evidence under Federal Rule of Evidence 702 703 , or 705 .

(B) Witnesses Who Must Provide a Written Report. Unless otherwise stipulated or ordered by the court, this disclosure must be accompanied by a written report—prepared and signed by the witness—if the witness is one retained or specially employed to provide expert testimony in the case or one whose duties as the party’s employee regularly involve giving expert testimony. The report must contain:

(i) a complete statement of all opinions the witness will express and the basis and reasons for them;

(ii) the facts or data considered by the witness in forming them;

(iii) any exhibits that will be used to summarize or support them;

(iv) the witness’s qualifications, including a list of all publications authored in the previous 10 years;

(v) a list of all other cases in which, during the previous 4 years, the witness testified as an expert at trial or by deposition; and

(vi) a statement of the compensation to be paid for the study and testimony in the case.

An expert’s report or disclosure under Rule 26 remains a far cry from a systematic review, but the Rule goes a long way towards eliminating trial by ambush and surprise in requiring a complete statement of all opinions, all the bases and reasons for the opinions, and all the facts or data considered in reaching the opinions. The requirements of Rule 26, combined with a mandatory oral deposition, go a long way to help reveal cherry picking and motivated reasoning in an expert witness’s opinions.


[1] Schachtman, “Reference Manual – Desiderata for 4th Edition – Part I – Signature Diseases,” Tortini (Jan. 30, 2023); “Reference Manual – Desiderata for 4th Edition – Part II – Epidemiology & Specific Causation,” Tortini (Jan. 31, 2023); “Reference Manual – Desiderata for 4th Edition – Part III – Differential Etiology,” Tortini (Feb. 1, 2023); “Reference Manual – Desiderata for 4th Edition – Part IV – Confidence Intervals,” Tortini (Feb. 10, 2023); “Reference Manual – Desiderata for 4th Edition – Part V – Specific Tortogens,” Tortini (Feb. 14, 2023); “Reference Manual – Desiderata for 4th Edition – Part VI – Rule 703,” Tortini (Feb. 17, 2023).

[2] See John B. Wong, Lawrence O. Gostin, and Oscar A. Cabrera, “Reference Guide on Medical Testimony,” in Reference Manual on Scientific Evidence 687, 723-24 (3d ed. 2011) (discussing hierarchy of medical evidence, with systematic reviews at the apex).

[3] Schachtman, “The Treatment of Meta-Analysis in the Third Edition of the Reference Manual on Scientific Evidence,” Tortini (Nov. 14, 2011).

[4] John P.A. Ioannidis & Joseph Lau, Systematic Review of Medical Evidence, 12 J.L. & Pol’y 509 (2004).

[5] Lisa Bero, “Evaluating Systematic Reviews and Meta-Analyses,” 14 J. L. & Policy 569, 576 (2006).

[6] See Schachtman, “Cherry Picking; Systematic Reviews; Weight of the Evidence,” Tortini (April 5, 2015); “The Fallacy of Cherry Picking As Seen in American Courtrooms,” Tortini (May 3, 2014);  “The Cherry-Picking Fallacy in Synthesizing Evidence,” Tortini (June 15, 2012).

[7] In re Paraquat Prods. Liab. Litig., 730 F. Supp. 3d 793 (S.D. Ill. 2024); see also Schachtman, “Paraquat Shape-Shifting Expert Witness Quashed,” Tortini (Apr. 24, 2024).

[8] See Schachtman, “Unlearning the Learned Treatise Exception,” Tortini (Aug. 21, 2010).

[9] Iain Chalmers, Larry V. Hedges, Harris Cooper, “A Brief History of Research Synthesis,” 25 Evaluation & the Health Professions 12 (2002); Mark Starr, Iain Chalmers, Mike Clarke, Andrew D. Oxman, “The origins, evolution, and future of The Cochrane Database of Systematic Reviews,” 25 Int J. Technol. Assess. Health Care s182 (2009); Mike Clarke, “History of evidence synthesis to assess treatment effects: personal reflections on something that is very much alive,” 109 J. Roy. Soc. Med. 154 (2016). See also Wen-Lin Lee, R. Barker Bausell & Brian M. Berman, “The growth of health-related meta-analyses published from 1980 to 2000,” 24 Eval. Health Prof. 327 (2001).

[10] Alessandro Liberati, Douglas G. Altman, Jennifer Tetzlaff, Cynthia Mulrow, Peter C. Gøtzsche, John P.A. Ioannidis, Mike Clarke, Devereaux, Jos Kleijnen, and David Moher, “The PRISMA Statement for Reporting Systematic Reviews and Meta-Analyses of Studies That Evaluate Health Care Interventions: Explanation and Elaboration,” 151 Ann Intern Med. W-65 (2009); “The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration,” 6 PLoS Med. e1000100 (2009).

[11] Alison Booth, Mike Clarke, Gordon Dooley, Davina Ghersi, David Moher, Mark Petticrew & Lesley Stewart, “The nuts and bolts of PROSPERO: an international prospective register of systematic reviews,” 1 Systematic Reviews 1 (2012); Alison Booth, Mike Clarke, Davina Ghersi, David Moher, Mark Petticrew, Lesley Stewart, “An international registry of systematic review protocols,” 377 Lancet 108 (2011).

[12] Matthew J. Page, Larissa Shamseer, and Andrea C. Tricco, “Registration of systematic reviews in PROSPERO: 30,000 records and counting,” 7 Systematic Reviews 32 (2018).

[13][13] John P. Ioannidis, “The Mass Production of Redundant, Misleading, and Conflicted Systematic Reviews and Meta-analyses,” 94 Milbank Q. 485 (2016).

The FDA Expert Panel on Talc – More Malarky     

June 18th, 2025

On May 20, 2025, as announced, FDA Commissioner Martin Makary held his panel discussion on talc in food and medications.[1] The discussion lasted just under two hours, and is available on YouTube for your viewing and perhaps your amusement. Makary opened and closed the event with what could have been the plaintiffs’ opening and closing statements from one of the many talc trials that have clouded courtrooms across the land. He asked rhetorically: “Why don’t we talk about at our oncology meetings the 1993 National Toxicology Program results that found clear evidence of carcinogenic activity of talc in animal studies?’” Perhaps because the talc findings were questionable at best, and the asbestos findings with respect to gastrointestinal cancers were exculpatory for talc.

Makary’s introductory remarks were followed by the panelists’ introducing themselves by their training and involvement with talc issues. Other than Makary, the participants were FDA Deputy Commissioner Sara Brenner, George Tidmarsh, John Joseph Godleski, Sandra McDonald, Daniel Cramer, Joellen Schildkraut, Malcolm Sim, Steven Pfeiffer, Nicolas Wentzensen, and Nicole C. Kleinstreuer. Godleski and Cramer have served as plaintiffs’ expert witnesses in ovarian cancer litigation, which was not particularly germane to the panel discussion. In their initial discussions of qualifications and background, neither Godleski nor Cramer disclosed his potential conflicts of interest, or the amount of fees earned. Sandra McDonald described her experience in assisting Godleski, but she did not declare whether she earned any money for consulting services to the lawsuit industry. Later in the panel discussion, when George Tidmarsh stated that no one should be vilified for past practices in using talc, Daniel Cramer jumped in to vilify Johnson & Johnson with the suggestion that somehow that company had surreptitiously arranged for the National Cancer Institute to remove a statement about how talc “may be associated with talc use” from its website just before he was about to testify in his first talc trial for plaintiffs.

None of the panelists had served as a defense expert witness. Steven Pfeiffer works for a pharmaceutical company, but not one that had any experience with the safety or efficacy of talc as an ingredient in medications.

None of the panelists had participated in any toxicologic or epidemiologic study of talc on cancers or diseases of the digestive organs. None of the panelists made it his or her business to become familiar with the extensive studies of the asbestos and talc on gastrointestinal cancers. The lack of experience, or specific citations to any study, did not stop Daniel Cramer from suggesting that talc was responsible for inflammatory bowel disease, autoimmune diseases, and gastrointestinal cancers.  Like Cramer, epidemiologist Joellen Schildkraut, focused on ovarian cancer, and made the false assertion that the relationship between talc and gastrointestinal cancers is understudied. Schildkraut held back from asserting that talc causes ovarian cancer, but she heartily endorsed banning talc on the precautionary principle. All the panelists concurred with the suggestion that talc be eliminated from food and drugs, without waiting for “the epidemiologists to catch up.”

Two issues were grossly misrepresented by the panelists. None of them, however, was well informed enough for the misrepresentations to have been overt lies. The first whopper was that National Toxicology Program (NTP) testing had shown carcinogenicity of talc in its inhalational studies for the lung and other organs. The second whopper was that rice on talc was used prevalently in the United States, and that it was responsible for digestive organ cancers. Nicole C. Kleinstreuer, who has worked at the NTP, and accurately described its activities gave a description of its animal talc studies, perhaps a bit slanted, but not too inaccurate. When George Tidmarsh later misrepresented NTP talc findings, however, Kleinsteuer was silent.

NTP Ingestion Studies

Makary did not identify the NTP studies to which he referred, but Kleinsteuer described a talc inhalation study that has only one referent. The NTP conducted long-term rodent inhalation and ingestion assays for both talc and different kinds of asbestos, in the 1980s and 1990s. For talc, the NTP published, in 1993, only one long-term inhalational study in rats and mice.[2] In mice, exposed to talc by inhalation for up to two years, there was no evidence of any “neoplastic” effects. The results in rats were more difficult to interpret. In male rats, exposed for over two years, there was weak evidence of neoplastic effects based upon an increased incidence of benign or malignant adrenal gland pheochromocytomas. In female rats, the NTP reported “clear evidence” of excess alveolar/bronchiolar (lung) adenomas and carcinomas and benign or malignant adrenal gland pheochromocytomas of the adrenal gland. The meaning of these rodent studies obviously varies depending upon whether you are a rat or a mouse of a certain breed; the meaning for humans is even murkier, even for humans that are rodent-like. The multiple comparisons across exposure levels for dozens if not hundreds of outcomes, and the lumping of benign and malignant effects together, certainly makes the NTP statistical analyses suspect. This report was marked by significant controversy, and some scientists refused to endorse its finding because adrenal gland pheochromocytomas were not treatment-related; the maximum-tolerated dose was exceeded for female rats at the higher exposure level, thus violating the study’s protocol; and talc is thus not expected to cause tumors in rats (and mice) exposed at levels that do not cause “marked chronic lung toxicity.”[3]

One of the lawsuit industry’s, and Makary’s, theories about the harmfulness of ingested talc is based upon the supposition that talc has asbestos contaminants. This theory is as vague as is the term asbestos, which has no mineralogical meaning; instead, the term asbestos was historically used to refer to six different minerals: actinolite, anthophyllite, amosite (cummingtonite-grunerite), chrysotile, crocidolite, and tremolite. All of these minerals, except for chrysotile, are amphibole minerals. Some of the amphibole minerals occur in both fibrous and non-fibrous form, and the ill health effects of the amphibole fibers are generally attributed to their resistance to biological degradation and their high aspect ratio. Things get a bit crazy because the federal government, for purposes of standardizing aerosol measurements, set the aspect ratio for counting “fibers,” at 3:1. The pathogenicity of “federal fibers,” which are not really fibers, is highly disputed.

The NTP never conducted long-term talc ingestion studies; it did something much better. The NTP tested dietary high-dose, long-term ingestion of various asbestos types in multiple species. The NTP did not leave the exposure issue vague with “asbestos” as the dietary source. Instead, the NTP was more precise when testing whether ingesting “asbestos” was harmful to rodents. The NTP ran separate ingestion experiments on chrysotile, amosite, and crocidolite, with the different form of asbestos making up one percent of the animals’ lifetime diet. Overall, these experiments were “null”; that is, they provided no support for the carcinogenicity of ingested asbestos of the types tested.

The NTP conducted lifetime ingestion studies in male and female rats with a diet of one percent crocidolite asbestos, the most toxic and carcinogenic form of asbestos in human beings. The NTP experiments showed that under these conditions, long-term ingestion of crocidolite asbestos was neither overtly toxic nor carcinogenic in male or in female rats.[4] After crocidolite, amosite asbestos, fibrous cummingtonite-grunerite, named for “asbestos mines of South Africa, is the most toxic and carcinogenic of the asbestos fibers. The NTP showed that feeding male and female rats amosite asbestos for one percent of their diet, for their lifetimes, was not overtly toxic, did not affect their survival, and was not carcinogenic.[5] The NTP repeated its life-time one percent amosite diet in Syrian Golden hamsters, again without toxic or carcinogenic response in either the male or female hamsters.[6]

Looking at the least toxic and carcinogenic asbestos mineral, chrysotile, the NTP’s conducted long-term one percent feed studies of both “short range” and “long range” (chrysotile fiber length) in Syrian Golden hamsters. Again the results were “null”; that is, there was no treatment-related toxicity or carcinogenicity.[7] There were no increases in adrenal cortical adenomas (benign growths) when compared with concurrent controls, but there was an increase of these benign tumors when compared with pooled control groups from other experiments. Ultimately, the NTP concluded that the biological importance of these benign adrenal growths in the absence of cancers or tumors of the gastrointestinal tract (which was the target organ) was questionable, at best.

Because of prior research suggesting that carcinogencity was a function of fiber rigidity and length, the NTP tested ingested chrysotile in rats, at two different fiber lengths. For its experiments, the NTP defined “short-range chrysotile (SR)” as short fibers with a median length of 0.66 microns, and a range of 0.088 to 51.1 microns. “Intermediate-range (IR) chrysotile fibers had a median length of 0.82 microns, with a range from 0.104 to 783.4 microns. The NTP did not use long-range chrysotile fibers, which are generally greater than 5 microns in length. Male and female F344/N rats ingested an NTP one percent diet of chrysotile, in the two lengths of chrysotile, SR and IR, for a lifetime. There were no neoplastic or non-neoplastic diseases, overt toxicity, or decrease in survival associated with SR chrysotile ingestion, in either the male or the female rats.[8] In the female rats, there was no effect on fertility or litter, overt toxicity, or carcinogenicity from IR chrysotile ingestion. The male rats also did not show any adverse clinical signs, but they experienced a statistically insignificant increase in benign colonic polyps, which the NTP stretched to characterize as “some” (but not clear) evidence of carcinogenicity.

Rice is Nice, With or Without Talc

The FDA panelists’ inaccurate claims about talc on rice also cry out for rebuttal, which no panelist seemed able or willing to give. Given that the panel was convened with only four days notice, and without public comment, it operated in a fact-free zone, and operated mostly as a propaganda exercise. The history of the ingested asbestos and talc controversy goes back over half a century. Some background is needed to understand exactly how outlandish the rice-on-talc claim is.

The causal association between asbestosis and lung cancer was well established by the early 1960s,[9] as was the causal association between crocidolite asbestos exposure and mesothelioma.[10] Some sources carelessly credit Irving Selikoff with these discoveries, but he was not so much of a discoverer, as he was a zealous spokesman for the safety of asbestos-exposed workers. Selikoff worked hand-in-hand with various labor unions to publicize and politicize asbestos risks that had been shown by other workers. Credit for the lung cancer connection properly goes to earlier work done by Sir Richard Doll and others, and the crocidolite-mesothelioma connection was shown by J. Christopher Wagner, in 1960. Where Selikoff deserves credit is in tireless efforts to expand the scope of asbestos-related diseases beyond lung cancer and mesothelioma, with or without sufficient evidence, and thus to expand the compensability of other diseases of ordinary life in asbestos workers.

In his efforts to extend the scope of compensation, Selikoff did not limit himself to risks that had been scientifically established; he sought to expand the list of asbestos-related diseases. He advanced the unsubstantiated notions that all six kinds of asbestos minerals carried the same risks, that asbestos caused virtually every kind of cancer in humans, that any asbestos in the environment required extreme remedial action, and that asbestos was responsible for a very high percentage of all human cancers.

No doubt Selikoff wanted credit for scientific discoveries, but he also wanted science that would support compensation. Selikoff understood that if the asbestos workers stopped smoking, their risks of lung cancer would fall, and their cancer morbidity and mortality would be more influenced by gastrointestinal cancers, given that colorectal cancer was the leading cause of cancer-related death in non-smoking men, in the 1960s.

By 1950, Selikoff had already become an advocate, who testified and wrote reports as a claimants’ expert witness in many asbestos cases. In the early 1950s, New Jersey lawyer Carl Gelman retained Selikoff to examine 17 workers from the Paterson plant of Union Asbestos and Rubber Company (UNARCO). Gelman filed workers’ compensation claims on behalf of these UNARCO workers, and Selikoff supported Gelman’s claims with reports and testimony. In the early 1950s, Anton Szczesniak, one of the UNARCO claimants, with Selikoff’s support as an expert witness, sought compensation for “intestinal cancer.” In 1965, Selikoff testified to support an asbestos insulator’s claim that asbestos exposure caused his colorectal cancer.[11] In 1974, Selikoff wrote a review article on asbestos exposure and gastrointestinal cancers, without any disclosure of his pro-plaintiff testimonial adventures.[12] Serious epidemiologists such as Sir Richard Doll and Sir Richard Peto pushed back on Selikoff’s exaggerated projections of asbestos-related mortality,[13] and his assertion that asbestos caused digestive system cancers.[14] Forty years after Selikoff testified for the claimant in an asbestos colorectal cancer case, the Institute of Medicine published a systematic review of the evidence available to Selikoff and later evidence, which showed that the evidence was insufficient “to infer a causal relationship between asbestos exposure and pharyngeal, stomach, and colorectal cancers.”[15]

Selikoff’s rent-seeking and fear-mongering spawned many asbestos scares. Some scientists accepted Selikoff’s dogma that a single asbestos fiber, of any variety, could cause any human cancer. The Mt. Sinai jihad against “asbestos” extended to any exposures involving asbestos, or even other minerals that contained “elongated mineral particles,” that nominally met the crude definition of asbestos. This jihad led to a prolonged litigation against the Reserve Mining Company, which had permits to dump taconite tailings in Lake Superior, since the late 1940s. Using Selikoff’s claim that “asbestiform” mineral particles had entered the water supply, the U.S. Environmental Protection Agency was able to obtain an injunction against the mining company.[16]

Regulatory overreach, Selikoff’s exaggerated testimony, and the trial judge’s partiality and bias marred the litigation.[17] After decades of research on asbestos in drinking water, there remains no substantial evidence that supports a conclusion that ingested asbestos in drinking water causes gastrointestinal or any other cancer.[18]

Selikoff was the head of an anti-asbestos lobby that promoted the fiction that asbestos was responsible for all manners of human ailments, regardless of dose or route of administration.[19] One of the panics he helped initiate involved the claim that talc-dusted rice was responsible for the high rate of stomach cancer among Japanese in Japan.

Reuben Merliss published an article in Science, in 1971, in which he attempted to attribute the high rate of stomach cancer in Japan to the Japanese custom of dusting rice with talc. Merliss relied upon overall population rates and trends to draw an ecologic inference that the Japanese rice (with talc and any asbestos contaminants) was responsible for the Japanese higher incidence of stomach cancer.[20]

The Merliss hypothesis, inspired by Selikoff, was sunk by a much more careful analysis (which got less media coverage). Two epidemiologists analyzed data about use of talc-coated rice in Japan and Hawaii, and found no support for the claim that talc-coated rice increased the risk of developing stomach cancer.[21]

Their more careful dietary assessment found high rates of stomach cancer among Japanese in Japan who did not consume talc-coated rice, while Japanese in Hawaii, who consumed considerable quantities of talc-coated rice had intermediate rates of stomach cancer (lower than in Japan). Filipinos in Hawai had very low rates of gastric cancer, even though they consumed the greatest amounts of talc-coated rice of any of the observed groups. The secular incidence trend of stomach cancer decreased more substantially among the talc-exposed Japanese living in Hawaii than among the non-exposed Japanese living in Japan.

Although the asbestos perpetual motion litigation machine continues to churn, the lawsuit industry has been hampered by the bankruptcy of virtually every company that made an asbestos-containing product, and the reduction of asbestos use and exposures over the last 50 years. The lawsuit industry’s shift to demonize and monetize talc as the next mineral target was predictable. What was not predictable was that we would have a Secretary of Health & Human Services whose sole experience in medicine has been in suing pharmaceutical and other manufacturing industries, perpetuating medieval beliefs in the miasma theory of disease causation,[22] and spreading conspiracies, misinformation, and disinformation. FDA Commissioner Makary has shown himself to be a willing accomplice in advancing the Secretary’s agenda. In his closing remarks, Makary made unsupported assertions, then retreated to the dodge that he was just asking questions. Makary strongly suggested that the recent increase in colorectal cancer among young people has been caused by the use of talc in food and medications. He failed to reference any evidence for his suggestion, which is, in any event, hard to square with the history of use of talc in medications for centuries, and the steady overall decline in the incidence of colorectal cancer in men and women.[23]

The Center for Truth in Science has sponsored rigorous systematic reviews of the evidence on cosmetic talc use and female reproductive cancers,[24] and respiratory cancers.[25] The systematic review of talc on reproductive organ cancers integrated evidence across toxicologic and epidemiologic studies, and found suggestive evidence of no association between the use of perineal talc and ovarian and endometrial cancers. The systematic review of talc use and respiratory cancers similarly integrated the available toxicologic and epistemiologic evidence, and rejected a causal association. The review reached a conclusion of suggestive evidence in the opposite direction – of no association between inhaled talc and mesothelioma or lung cancer.

The FDA talc panel was fool’s gold, and not the promised “gold standard” science. Rather than engaging with the systematic reviews sponsored by the Center, or for that matter with any systematic reviews, Commissioner Makary and his panel wallowed in anecdotes, stories, and isolated study results, without trying to identify and synthesize all the available evidence.


[1] FDA Expert Panel on Talc, “Independent Expert Panel to Evaluate Safety and Necessity of Talc in Food, Drug, and Cosmetic Products,” FDA (May 20, 2025).

[2] NTP Technical Report on the Toxicology and Carcinogenesis Studies of Talc (CAS No. 14807-96-6) in F344/N Rats and B6C3F Mice (Sept. 1993).

[3] Jay I. Goodman, “An Analysis of the National Toxicology Program’s (NTP) Technical Report (NTP TR 421) on the Toxicology and Carcinogenesis Studies of Talc,” 21 Regulatory Toxicol. & Pharmacology 244 (1995). See also Robyn L. Prueitt, Nicholas L. Drury, Ross A. Shore, Denali N. Boon & Julie E. Goodman, “Talc and human cancer: a systematic review of the experimental animal and mechanistic evidence,”  54 Critical Reviews in Toxicology  359 (2024).

[4] NTP TR-280 Toxicology and Carcinogenesis Studies of Crocidolite Asbestos (CASRN 12001-28-4) In F344/N Rats (Feed Studies) (1988).

[5] NTP TR-279 Toxicology and Carcinogenesis Studies of Amosite Asbestos (CASRN 12172-73-5) in F344/N Rats (Feed Studies) (1990).

[6] NTP TR-249 Lifetime Carcinogenesis Studies of Amosite Asbestos (CASRN 12172-73-5) in Syrian Golden Hamsters (Feed Studies) (1983).

[7] NTP TR-246 Lifetime Carcinogenesis Studies of Chrysotile Asbestos (CASRN 12001-29-5) in Syrian Golden Hamsters (Feed Studies) (1990).

[8] NTP – TR-295 Toxicology and Carcinogenesis Studies of Chrysotile Asbestos (CASRN 12001-29-5) in F344/N Rats (Feed Studies) (1985).

[9] See Richard Doll, “Mortality from Lung Cancer in Asbestos Workers,”  12 Br. J. Indus. Med. 81 (1955).

[10] See J. Christopher Wagner, C.A. Sleggs, and Paul Marchand, “Diffuse pleural mesothelioma and asbestos exposure in the North Western Cape Province,” 17 Br. J. Indus. Med. 260 (1960); J. Christopher Wagner, “The discovery of the association between blue asbestos and mesotheliomas and the aftermath,” 48 Br. J. Indus. Med. 399 (1991).

[11] See “Health Hazard Progress Notes,”16 The Asbestos Worker 13 (May 1966) (“A recent decision has widened the range of compensable diseases for insulation workers even further. A member of Local No. 12. Unfortunately died of a cancer of the colon. Dr. Selikoff reported to the compensation court that his research showed that these cancers of the intestine were at least three times as common among the insulation workers as in men of the same age in the general population. Based upon Dr. Selikoff’s testimony, the Referee gave the family a compensation award, holding that the exposure to many dusts during employment was responsible for the cancer. The insurance company appealed this decision. A special panel of the Workman’s Compensation Board reviewed the matter and agreed with the Referee’s judgment and affirmed the compensation award. This was the first case in which a cancer of the colon was established as compensable and it is likely that this case will become an historical precedent.”).

[12] Irving J. Selikoff, “Epidemiology of Gastrointestinal Cancer,” 9 Envt’l Health Persp. 299 (1974).

[13] Richard Doll & Richard Peto, “The causes of cancer: quantitative estimates of avoidable risks of cancer in the United States today,” 66 J. Nat’l Cancer Instit. 1191 (1981).

[14] Richard Doll and Julian Peto, Asbestos: Effects on Health of Exposure to Asbestos 8 (1985).

[15] Jonathan M. Samet, et al., Asbestos: Selected Cancers – Institute of Medicine (2006).

[16] See Wendy Wriston Adamson, Saving Lake Superior: A Story of environmental action (1974); Frank D. Schaumburg, Judgment Reserved: A Landmark Environmental Case (1976); Robert V. Bartlett, The Reserve Mining Controversy: Science, Technology, and Environmental Quality (1980); Thomas F. Bastow, This Vast Pollution: United States of America v. Reserve Mining Company (1986); Michael E. Berndt & William C. Brice, “The origins of public concern with taconite and human health: Reserve Mining and the asbestos case,” 52 Regulatory Toxicol. & Pharmacol. S31 (2008).

[17] Reserve Mining Co. v. Lord, 529 F.2d 181 (8th Cir. 1976) (removing Judge Lord from case).

[18] See World Health Organization, Asbestos in Drinking Water (4th ed. 2021) (“no causal association between asbestos exposure via drinking-water and cancer development has been reported for any asbestos fibre type”); Jennifer Go, Nawal Farhat, Karen Leingartner, Elvin Iscan Insel, Franco Momoli, Richard Carrier & Daniel Krewski, “Review of epidemiological and toxicological studies on health effects from ingestion of asbestos in drinking water,” 54 Critical Reviews in Toxicology 856 (2024) (“Based on high-quality animal studies, an increased risk for cancer or non-cancer endpoints was not supported, aligning with findings from human studies. Overall, the currently available body of evidence is insufficient to establish a clear link between asbestos contamination in drinking water and adverse health effects.”); Kenneth D. MacRae, “Asbestos in drinking water and cancer,” 22 J. Royal Coll. Physicians 7 (1988).

[19] Francis Douglas Kelly Liddell, “Magic, Menace, Myth and Malice,” 41 Ann. Occup. Hyg. 3, 3 (1997) (“[A]n anti-asbestos lobby, based in the Mount Sinai School of Medicine of the City University of New York, promoted the fiction that asbestos was an all-pervading menace, and trumped up a number of asbestos myths for widespread dissemination, through media eager for bad news.”).

[20] Rueben R. Merliss, “Talc-Treated Rice and Japanese Stomach Cancer,” 173 Science 1141 (1971). The claim persists in the underworld of medical speculation. See E. Whitin Kiritani, “Asbestos and Stomach Cancer in Japan – A Connection?” 33 Medical Hypotheses 159 (1990).

[21] Grant N. Stemmermann & Lawrence N. Kolonel, “Talc-coated rice as a risk factor for stomach cancer,” 31 Am. J. Clin. Nutrition 2017 (1978).

[22] Paul Offit, “Understanding RFK Jr.,” Beyond the Noise (Feb. 11, 2025).

[23] American Cancer Society, “Key Statistics for Colorectal Cancer” (last revised April 28, 2025).

[24] Heather N. Lynch, Daniel J. Lauer, Olivia Messina Leleck, Rachel D. Freid, Justin Collins, Kathleen Chen, William J. Thompson, A. Michael Ierardi, Ania Urban, Paolo Boffetta & Kenneth A. Mundt, “Systematic review of the association between talc and female reproductive tract cancers,” 5 Front. Toxicol. 1157761 (2023).

[25] Heather N. Lynch, Daniel J. Lauer, William J. Thompson, Olivia Leleck, Rachel D. Freid, Justin Collins, Kathleen Chen, A. Michael Ierardi, Ania M. Urban, Michael A. Cappello, Paolo Boffetta & Kenneth A. Mundt, “Systematic review of the scientific evidence of the pulmonary carcinogenicity of talc,” 10 Front. Public Health 989111 (2022).

FDA Malarky on Ingested Talc

June 6th, 2025

A couple of weeks ago, the Wall Street Journal ran an editorial that complained that FDA Commissioner Makary had touted dodgy evidence about the potential harms of talcum powder in food and medications,[1] and called an improper public meeting to discuss his concerns. The editorial noted the procedural irregularity of convening a meeting to review evidence of the supposed harms of talc in food and drugs, without proper notice and public comment.[2] The panel met just four days after the FDA’s press release.[3]

The FDA’s announcement of the irregular meeting cited last year’s IARC classification of talc in its group 2A, “probably carcinogenic” to humans, and an article in a new journal, the Journal of the Academy of Public Health, on the editorial board of which, Martin Makary sits.

The irregularity of this FDA meeting becomes even more obvious upon closer inspection. Much could be said about the irregularity of IARC classifications. The IARC defines “probably” in its 2A “probably carcinogenic” classification in a distinctly unscientific way when it reveals, in its Preamble, that its use of probably has no quantitative meaning. In attaching a 2A label to talc, the IARC rejected a conclusion that there was sufficient evidence of human carcinogenicity for talc; indeed, it found the human epidemiology on point to be “limited,” in other words, insufficient. Furthermore, the IARC’s limited conclusion was based upon a claimed association between perineal talc exposure and ovarian cancer.[4]

The irregularities abound. The FDA announced that it was convening an “independent panel of scientific experts” to explore the issue of talc in food and in drugs. And yet, one of the panelists, Daniel Cramer, has served as an expert witness for the talc lawsuit industry on multiple occasions, against Johnson & Johnson.[5] How irregular that no defense expert witness was invited to participate in the panel.

The irregularity of Daniel Cramer’s participation may be Trumped by the irregularity of the entire enterprise.  Commissioner Makary works for Secretary Robert F. Kennedy, Jr., who has spent much of his adult life advancing litigations for the lawsuit industry. Kennedy’s son, Conor, is a lawyer at Wisner Baum, a lawsuit industry firm that has cases against Johnson & Johnson.  The day of the FDA meeting, but before the panel convened, Commissioner Makary barged into another Advisory Committee meeting, convened to discuss the licensing of an unrelated anti-cancer therapeutic, and ranted about how talc was causing cancer.

Earlier this week, Commissioner Makary replied to the Wall Street Journal editorial, but failed to make his case on the science.[6] He cited IARC, but failed to disclose the meaning of the IARC classification, and to what it applied. Makary cited a 2019 Taiwanese study (Chang) that he described as having reported an association between the oral intake of talc and gastrointestinal cancer.[7] What was most irregular for a scientist who has responsibility for the FDA, however, was Makary’s failure to describe the Chang study accurately.

Chang set out to study stomach cancer, not all of gastrointestinal cancers, by looking at stomach cancer incidence in users a talc, used as a Chinese herbal, in high, medium, and low levels. The study was a typical insurance claims database study, which is interesting but which can yield only limited information. Chang and colleagues had no information about lifestyle variables such as smoking, diet, or obesity. The authors note that in Taiwan, talc is used as an antipyretic and diuretic agent, but they fail to discuss why study participants would have used an herbal remedy with such an indication for any significant length of time. To their credit, the authors excluded patients with peptic ulcer disease or Helicobacter pylori infection prior to the inclusion date. Gastritis and infection with h. pylori are potent causes of stomach cancer. Unfortunately, the information on participants’ infection status, for exclusion, was made before 1997, and so the authors had no information whether the participants who had stomach cancer actually had h. pylori infections at or near the time that they were diagnosed with stomach cancer. Helicobacter pylori infections have an attributable risk for stomach cancer of about 75%.[8] Similarly, the authors lacked information on other risk factors, such as high salt intake, pernicious anemia, EBV infection, alcohol, family predisposition, and socioeconomic status.

Using the low-exposure group as their control, the Chang study reported an adjusted stomach cancer hazard ratio of 1.58 (95% CI, 0.79 – 3.17; p = 0.19), for participants with high exposure, and an adjusted hazard ratio of 2.30 (95% CI, 1.48 – 3.57; p < 0.001) among persons with medium exposure. The authors claimed these data showed an association, but they acknowledged that the lack of a dose-response relationship made the association less likely to be causal. The association, such as it was, however, came unraveled after they excluded participants whose herbal talc use was less than five years. The exclusion, which is biologically important given that latency and induction periods for carcinogenesis are likely longer than five years, vitiated the statistically significant correlation between talc ingestion and the incidence of stomach cancer. The authors’ conclusion was thus pretty tame: “[d]espite the absence of dose-response effect, there might be a link between stomach cancer and talc.” And then again, there might not be.

Makary was not content to argue from weak and equivocal evidence. He offered a sop to the lawsuit industry and his boss, Robert F. Kennedy, Jr., by asking rhetorically whether the plaintiffs’ bar might be correct on talc. According to Makary, “They [lawsuit industry firm] were [correct] with OxyContin, Vioxx and Makena. Perhaps they will be with talc.” Well, even the blind squirrel sometimes finds a nut. OxyContin litigation turned on a marketing issue, and Makena (hydroxyprogesterone caproate), a progestin injection was withdrawn because of lack of efficacy. Even Vioxx, which had an unlabeled potential harm for a limited subgroup of users, spawn a litigation in which the lawsuit industry tried to make every user, even those who may have licked a pill for one day, a winner in the lawsuit lottery.

[1] Editorial Board, “The FDA Takes a Trial-Lawyer Turn,” Wall St. J. (May 21, 2025).

[2] FDA News Release, “FDA to Host Inaugural, Independent, Scientific Expert Panel Open to Public,” FDA (May 16, 2025).

[3] FDA Expert Panel on Talc, “Independent Expert Panel to Evaluate Safety and Necessity of Talc in Food, Drug, and Cosmetic Products,” FDA (May 20, 2025). The participants were FDA Commissioner Martin A. Makary, FDA Deputy Commissioner Sara Brenner, and a group of scientists, George Tidmarsh, John Joseph Godleski, Sandra McDonald, Daniel Cramer, Joellen Schildkraut, Malcolm Sim, Steven Pfeiffer, Nicolas Wentzensen, and Nicole C. Kleinstreuer.

[4] IARC Press Release no. 352, “IARC Monographs evaluate the carcinogenicity of talc and acrylonitrile” (July 5, 2024).

[5] See Berg v. Johnson & Johnson Consumer Co., 983 F.Supp.2d 1151, 1154 (D.S.D. 2013); Carl v. Johnson & Johnson, 464 N.J. Super. 446, 237 A.3d 308, 310 (N.J. App. Div. 2020).

[6] Makary, “The FDA Presents Its Case for Targeting Talc,” Wall St. J. (June 2, 2025).

[7] Che-Jui Chang, Yao-Hsu Yang, Pau-Chung Chen, Hsin-Yi Peng, Yi-Chia, Sheng-Rong Song & Hsiao-Yu Yang, “Stomach Cancer and Exposure to Talc Powder without Asbestos via Chinese Herbal Medicine: A Population-Based Cohort Study,” 16 Internat’l J. Envt’l Res. Public Health 717 (2019).

[8] Raghav Sundar, Izuma Nakayama, Sheraz R Markar, Kohei Shitara, Hanneke W M van Laarhoven, Yelena Y. Janjigian & Elizabeth C. Smyth, “Gastric cancer,” 405 Lancet 2087, 2089 (2025).

The Relative Implausibility of Relative Plausibility

May 26th, 2025

For the moment, in the American legal academy, there seems to be a fair amount of support for the idea that the burden of proof in fact-finding is centered around a vigorous contest between the plausibility of competing stories advanced by the litigants. Professors Ronald Allen and Alex Stein, two well-respected evidence law scholars have written widely about this “relative plausibility” theory of adjudication and the burden of proof.[1] They claim to “demonstrate that factfinders decide cases predominantly by applying the relative plausibility criterion guided by inference to the best explanation … .”[2] As they see American courtroom practice, the norm is “the relative plausibility mode of factfinding involving a rigorous comparison between the parties’ stories about the individual event.”[3] They insist that their “theory aligns with ordinary people’s natural reasoning.”[4]

I am not so sure. Semantically, the authors’ choice of the term “plausibility” is curious. Plausibility in ordinary usage has only a tenuous relationship with epistemic warrant. Allen and Stein acknowledge that in law (as in science and in life), the “coin of the realm is truth.” Plausibility in epistemology and philosophy of science, however, is typically treated as a weak and often irrelevant factor in assessing the correctness of a factual (scientific) claim. A leading textbook of epidemiology, for instance, offers that

“[a] causal explanation is plausible if it appears reasonable or realistic within the context in which the hypothesized cause and its effect occur. *** Plausibility can change as the context evolves and will be misleading when current understanding is misleading or wrong.”[5]

A plausible fact is not the same as a known fact, or a well-established fact. In his oft-cited after-dinner speech, Sir Austin Bradford Hill, for instance, acknowledged that plausibility is a helpful but non-necessary consideration in evaluating an association for causality, but he cautions that plausibility

“is a feature I am convinced we cannot demand. What is biologically plausible depends on the biological knowledge of the day.”

Since Hill, many scientific writers have relegated plausibility to a limited role in assessing the correctness of a causal claim. In the language of a recent effort to modernize Hill’s factors, one author noted that “plausibility and analogy do not work well in most fields of investigation, and their invocation has been mostly detrimental.”[6]

To be sure, Allen and Stein do, in some places, make clear that they take plausibility to mean more than some uninformed Bayesian prior. Relative plausibility in their view thus has some connection to the coin of the realm. At least, fact finders are seen as considering more than the usual extent of plausibility; they must “determine which of the parties’ conflicting stories makes most sense in terms of coherence, consilience, causality, and evidential coverage.”[7]

Relativity of Plausibility

If we are truly concerned with “naturalism” (ordinary reasoning?) then we should give some weight to how people react to a claim that has support. In the real world, real people are implicitly aware of Brandolini’s Law. Inspired by his reading of Daniel Kahneman’s Thinking, Fast and Slow,[8] Alberto Brandolini articulated the “Bullshit Asymmetry Principle,” in a 2013 peer-reviewed tweet. According to Brandolini, The work needed to refute bullshit is [at least] an order of magnitude greater than the work needed to produce it.

Despite its crude name, the Bullshit Asymmetry Principle has a respected intellectual provenance. In 1845, economist Frédéric Bastiat expressed an early notion of the adage:

“We must confess that our adversaries have a marked advantage over us in the discussion. In very few words they can announce a half-truth; and in order to demonstrate that it is incomplete, we are obliged to have recourse to long and dry dissertations.”[9]

Recognition of Bullshit Asymmetry actually goes back to ancient times. The Roman lawyer and teacher of rhetoric, Marcus Fabius Quintilianus, known as Quintilian to his friends, addressed the principle in his Institutio Oratoria:

“The task of the accuser is consequently straightforward and, if I may use the phrase, vociferous; but the defence requires a thousand arts and stratagems.”[10]

Quintilian’s insight explains why most people, without invoking economic efficiency or grand moral theories, believe it is natural to place the burden of proof upon the accuser or the pursuer, as opposed to the defender.

The demands made upon us by claims and “stories,” often frivolous, result in our naturally evaluating the warrant (or plausibility if you insist) for a claim before we become mired down in assessing “relative plausibility.” Courts have developed procedural mechanisms, such as summary adjudication and expert witness gatekeeping, to avoid unnecessary detailed assessments of relative plausibility. Even when cases are submitted to the factfinder, the decision may be made solely on “plausibility” of the story proffered by the party with the burden of proof.

The framing of adjudication and the burden of proof as relative plausibility seems to contradict what often happens in American courtrooms. Frequently, the defense does not put forward a “story,” but attempts to show that the plaintiff’s story is rubbish. Indeed, litigation may end without the plausibility of the defense position ever being considered. In the litigation over health claims involving exposure to Agent Orange, Judge Jack Weinstein granted summary judgment because the plaintiffs’ medical causation case was weak and insufficient.[11] The defense may have been even weaker in terms of its “coherence, consilience, causality, and evidential coverage,” but the party with the burden of proof attracts the first round of critical scrutiny in the summary judgment process. In Agent Orange, Judge Weinstein found the plaintiffs’ “proofs” to be rather crummy, without regard for the strength or weakness of the defendants’ evidence.

Similarly, Judge Weinstein granted summary judgment on plaintiffs’ claims of systemic disease injury in the silicone gel breast implant litigation. In granting judgment, Judge Weinstein pretermitted the defendants’ motions to exclude plaintiffs’ expert witnesses on grounds of Rules 702 and 703. Again, without comparison with the defendants’ “story,” Judge Weinstein found the plaintiffs’ story to be insufficient.[12]

The situation in Agent Orange and in Silicone Gel often obtains in trial itself. Defendants are often unable to disprove the plaintiffs’ claim, and the law does not require them to do so. When the evidentiary display is insufficient to support a claim, it may well be insufficient to show the claim is false. Defendants may want to be able to establish their own “story,” but the best they may have to offer is a showing that the plaintiffs’ story is not credible. Allen and Stein suggest that “[t]heoretically, a defendant can simply deny the plaintiff’s complaint, … but this virtually never occurs.”[13] They cite to no empirical evidence in claiming that “a rigorous comparison between the parties’ stories about the individual event is the norm in American courtrooms.”[14]

As shown by the summary judgment examples above, the burden of proof means something quite different from Allen and Stein’s contention about relative plausibility. Before the advent of expert witness gatekeeping, one of the few ways that a party could challenge an adversary’s expert witness was to object that the plaintiff’s medical expert witnesses offered conflicting opinions on a key factual issue in dispute. In Pennsylvania, dismissals for inconsistent expert witness opinion testimony is known as the “Mudano rule,” for a 1927 Pennsylvania Supreme Court case that held that “there must be no absolute contradiction in their essential conclusions.”[15] The Mudano rule arises because the plaintiff must furnish consistent evidence on key issues, even though the jury could otherwise freely choose to accept some or all or none of the inconsistent expert witnesses’ testimony. The Mudano rule requires dismissal without regard to the “plausibility” or implausibility of the defense case.[16]

The Mudano rule follows from the plaintiff’s having the burden of proof. When the party with the burden of proof proffers two conflicting opinions, the guesswork is simply too palpable for an appellate court to tolerate. The rule does not apply to the defense case, should the defense mange to proffer two inconsistent expert witnesses on a key issue raised by plaintiff’s case.[17]

The party without the burden of proof on causation or other key issue requiring expert witness testimony need not present any expert testimony. And if the opposing party does present expert witnesses, the law does not require that they be as precise or certain as those presented by the party with the burden. As one work-a-day appellate court put the matter:

“Absent an affirmative defense or a counterclaim, the defendant’s case is usually nothing more than an attempt to rebut or discredit the plaintiff’s case. Evidence that rebuts or discredits is not necessarily proof. It simply vitiates the effect of opposing evidence. Expert opinion evidence, such as that offered by [the defendant] in this case, certainly affords an effective means of rebutting contrary expert opinion evidence, even if the expert rebuttal would not qualify as proof.”[18]

A defendant need not engage in “story telling” at all; it may present an expert witness to testify that the plaintiff’s causation claim is bogus, even if the alternatives are merely possible. This statement of law with respect to the required certitude of expert witnesses and the burden of proof comes from a Pennsylvania case, but it appears to be the majority rule.[19]

The asymmetry created by the epistemic requirements of the burden of proof undermines the simplistic model of a court, or jury, deciding the “relative plausibility” of a claim.

Jury Instructions

The typical jury instruction on expert witness opinion testimony also shows that the burden of proof may operate without the head-to-head comparison of “stories,” as suggested by Allen and Stein. Under the law of most states, the trier of fact is free to accept some, all, or none of an expert witness opinion. In New Jersey, for instance, jurors are instructed that they

“are not bound by the testimony of an expert. You may give it whatever weight you deem is appropriate. You may accept or reject all or part of an expert’s opinion(s).”[20]

The practice of American courts with respect to burden of proof does not support the reductionist formula offered by the evidence law scholars. Burden of proof has implications in terms of summary judgment and directed verdict practice, which seem glossed over by “relative plausibility.” Furthermore, in situations in which the factfinder assesses both parties’ stories for relative plausibility, it must reject the story from the party with the burden of proof, when that party fails to show its story is more likely than not correct, even when the opponent’s story has a lesser plausibility.

Cases almost always involve incomplete evidence, and so we should expect that evidential warrant, or relative plausibility, or posterior probability of both sides’ cases to be less than complete or 100 percent.  If the party with the burden has a story with 40% probability, and then opponent’s story has a 30% probability, the case still results in a non-suit.


[1] Ronald J. Allen & Alex Stein, “Evidence, Probability, and the Burden of Proof,” 55 Ariz. L. Rev. 557 (2013) [cited herein as Allen & Stein].  They are not alone in endorsing relative plausibility, but for now I will key my observations to Allen and Stein’s early paper on relative plausibility.

[2] Id. at 4. Allen and Stein cite the classical proponents of inference to the best explanation, but they do not in this 2013 article describe or defend such inferences in detail. See Peter Lipton, Inference to the Best Explanation (2d ed. 2004); Gilbert H. Harman, “The Inference to the Best Explanation,” 74 Philosophical Rev. 88 (1965).

[3] Allen & Stein at 14.

[4] Allen & Stein at 15.

[5] Tyler J. VenderWeele, Timothy L. Lash & Kenneth J. Rothman, “Causal Inference and Scientific Reasoning,” chap. 2, in Timothy L. Lash, et al., Modern Epidemiology 17, 20 (4th ed. 2021).

[6] Louis Anthony Cox, Jr., “Modernizing the Bradford Hill criteria for assessing causal relationships in observational data,”  48 Crit. Rev. Toxicol. 682, 684 (2018).

[7] Allen & Stein at 1.

[8] Daniel Kahneman, Thinking, Fast and Slow (2011).

[9] Frédéric Bastiat, Economic Sophisms (1845), in The Bastiat Collection vol. 1, t 172 (2007).

[10] Quintilian, Institutio Oratoria, book V, chapters 13-14 (Butler transl. 1920).

[11] In re Agent Orange Product Liab. Litig., 597 F. Supp. 740, 785 (E.D.N.Y. 1984), aff’d 818 F.2d 145, 150-51 (2d Cir. 1987) (approving district court’s analysis), cert. denied sub nom. Pinkney v. Dow Chemical Co., 487 U.S. 1234 (1988); In re “Agent Orange” Prod. Liab. Litig., 611 F. Supp. 1223 (E.D.N.Y. 1985), aff’d, 818 F.2d 187 (2d Cir. 1987), cert. denied, 487 U.S. 1234 (1988). See Peter H. Schuck, Agent Orange on Trial: Mass Toxic Disasters in the Courts (1987).

[12] In re Breast Implant Cases, 942 F. Supp. 958 (E.& S.D.N.Y. 1996).

[13] Allen & Stein at 12.

[14] Allen & Stein at 14.

[15] Mudano v. Philadelphia Rapid Transit Co., 289 Pa. 51, 60, 137 A. 104, 107 (1927).

[16] See Daniel E. Cummins, “The ‘Mudano’ Rule: Conflicting Expert Opinions Often Prove Fatal,” The Legal Intelligencer (Mar. 16, 2017). See also Brannan v. Lankenau Hospital, 490 Pa. 588, 596, 417 A.2d 196 (1980) (“a plaintiff’s case will fail when the testimony of his two expert witnesses is so contradictory that the jury is left with no guidance on the issue”); Menarde v. Philadelphia Transportation Co., 376 Pa. 497, 501, 103 A.2d 681 (1954). See also Halper v. Jewish Family & Children Services of Great of Philadelphia, 600 Pa. 145, 963 A.2d 1282, 1287-88 (2009).

[17] See Kennedy v. Sell, 816 A.2d 1153, 1159 (Pa. Super. 2003).

[18] Neal v. Lu, 365 Pa. Super. 464, 530 A.2d 103, 109-110 (1987); see also Jacobs v. Chatwani, 2007 Pa. Super. 102, 922 A.2d 950, 958-960 (2007) (holding that defense expert witnesses are not required to opinion to reasonable medical certainty). See generally James Beck, “Reasonable Certainty and Defense Experts,” Drug & Device Law (Aug. 4, 2011).

[19] Jordan v. Pinamont, 2007 WL 4440900, at *2 (E.D. Pa. May 8, 2007) (“Defendants are entitled to inform the jury of other medical conditions which reasonably could have caused Plaintiff’s complaints, even if it cannot be stated to a reasonable degree of medical certainty that Defendants’ proffered alternatives were, in fact, the cause”); Johnesee v. The Stop & Shop Co., 174 N.J. Super. 426, 416 A.2d 956, 959 (N.J. Super. App. Div. 1980) (holding that defense expert witness may criticize plaintiff’s expert witness’s opinion as unfounded even though he can offer only possible alternative causes); Holbrook v. Lykes Bros. Steamship Co., 80 F.3d 777, 786 (3d Cir. 1996) (affirming admission of defense expert testimony that plaintiff had failed to exclude radiation as a possible cause of his mesothelioma, but reversing judgment for the defense on other grounds); Wilder v. Eberhart, 977 F.2d 673, 676-77 (1st Cir. 1992) (applying New Hampshire law); Allen v. Brown Clinic, P.L.L.P., 531 F.3d 568, 574-75 (8th Cir. 2008) (applying South Dakota law).

[20] N.J. CHARGE 1.13, citing State v. Spann, 236 N.J. Super. 13, 21 (App Div. 1989). See Pennsylvania’s Suggested Standard Civil Jury Instructions. PA. SSJI (Civ), § 4.100, § 4.80 (2013) (providing that the jury is not required to accept an expert witness’s testimony); Nina Chernoff, Standard jury instruction in New York on expert testimony (2023) (“You may accept or reject such testimony, in whole or in part, just as you may with respect to the testimony of any other witness.”).

SCOTUS Embraces Totalitarian Version of Unitary Executive Doctrine

May 25th, 2025

Earlier this year, President Felonious Trump fired Gwynne Wilcox, a member of the National Labor Relations Board (NLRB), and Cathy A. Harris, the chair of the Federal Merit Systems Protection Board (MSPB). Wilcox sued, and the district court in the District of Columbia enjoined the President from removing her. Federal statutory law prohibits the president from removing the plaintiff officers except for cause. See 29 U. S. C. § 153(a); 5 U. S. C. § 1202(d). Felonious Trump identified no such cause.

Felonious Trump took the case up to the Supreme Court, not on the merits, but on the propriety of the interlocutory stay. Last week, the Court reversed the stay, and remanded the case to be heard on its merits.[1]  But in addressing the stay, the Court necessarily addressed the merits, as it was required to do, in assessing the likelihood of success. The net result was that the Court signaled its embrace of an imagined unitary and totalitarian conception of the president’s power.

In an unsigned opinion, the Court went beyond its limited role in addressing the interlocutory injunction, when it declared:

“Because the Constitution vests the executive power in the President, see Art. II, § 1, cl. 1, he may remove without cause executive officers who exercise that power on his behalf.”[2]

This assertion begged the question whether these officers were the sort of executive officers whom the president can remove at will. The Court’s reasoning was unusually anemic. The Court assumed that the two fired officials exercise “considerable executive power,” which thus puts them at the mercy of the president. Of course, the whole point of independent agencies is that they exercise hybrid executive-legislative-judicial power. The Court briefly acknowledged that there are “exceptions,” but left for the litigation’s outcome to address them.[3]

Wilcox and Harris invoked the specter of Trump’s removing, without cause, members of the Federal Reserve’s Board of Governors. Felonious Trump has intimated he wanted to fire Jerome Powell, but has for the while backed off his threats, after the stock market tanked in response to his palavering. The Court went out of its way to distinguish the Federal Reserve as “a uniquely structured, quasi-private entity that follows in the distinct historical tradition of the First and Second Banks of the United States.”[4] All the independent agencies, however, are uniquely structured and designed so as not to be under the complete control of the president.

In dissent, Justice Elena Kagan, joined by Justices Sotomayor and Jackson, blasted her colleagues for using the court’s emergency docket to make a significant statement about an issue with implications for the fundamental structure of the federal government. The order, she wrote, essentially allows Trump to overrule the court’s 1935 decision in Humphrey’s Executor [5] “by fiat,” at least until the justices eventually take up the case. In the meanwhile, the Court takes up the surrender monkey posture of some of our leading law firms.

Justice Kagan understandably emphasized the abandonment of precedent in obeisance to Trump, as well as its ignoring and abandoning the legitimate interests of Congress in fashioning an independent agency. Justice Kagan also noted that the Court’s ruling on the interlocutory stay threw out “the presumption of constitutionality which attaches to every Act of Congress,” as somehow unworthy of consideration in an equitable analysis of the stay.

Although Justice Kagan enjoyed the better grounded argument, the dissent did not go far enough. Her dissent never actually identified the full range of executive branch interests at stake. The NLRB and the MSPB were created by statutes, passed by Congress, but which presidents signed.

In 1935, Congress passed the National Labor Relations Act to advance a policy encouraging collective bargaining. The Act was signed into law by President Franklin Roosevelt. The NLRB was created by the Act, passed by Congress, and made law by the executive.

Similarly, the Merit Systems Protection Board is an independent, quasi-judicial agency that protects the federal merit system. The Board was created by statute, and was codified by the Civil Service Reform Act of 1978, Public Law No. 95-454. This legislation was signed into law by President Jimmy Carter.

Executive power was involved in creating both boards, and in specifying the protections that board members would enjoy in doing their jobs. The firings by Felonious Trump were thus in derogation of executive power, as much as they were of legislative power. So once again, the Court has allowed Felonious Trump to ignore law that previous presidents, who exercised their executive power to create the for-cause protections. The executive may be unitary, but it is bound by laws that it enacts in conjunction with the legislature. The logic of the Court’s position implies that there is no limit to a president’s power to ignore statutory law.


[1] Trump v. Wilcox, ___ S.Ct.___, 605 U. S. ____ (May 22, 2025) [Slip op.]. See Nina Totenberg, “Supreme Court allows Trump to fire members of independent agency boards — for now,” Nat’l Public Radio (May 22, 2025).

[2] Slip op. at 1.

[3] Id. (“Because the Constitution vests the executive power in the President, he may remove without cause executive officers who exercise that power on his behalf, subject to narrow exceptions recognized by our precedents.”).

[4] Slip at 2.

[5] Humphrey’s Executor v. United States, 295 U. S. 602 (1935).

Judging Science Symposium

May 25th, 2025

While waiting for the much delayed fourth edition of the Reference Manual on Scientific Evidence, you may want to take a look at a recent law review issue on expert witnesses issues. Back in November 2024, the Columbia Science & Technology Law Review held its symposium at the Columbia Law Review on “Judging Science.” The symposium explored current judicial practice for, and treatment of, scientific expert witness testimony in the United States. Because the symposium took place at Columbia, we can expect any number of antic proposals for reform, as well.

Among the commentators on the presentations were Hon. Jed S. Rakoff, Judge on the Southern District of New York,[1] and the notorious Provost David Madigan, from Northeastern University.[2]

The current issue (vol. 26, no.2) of the Columbia Science and Technology Law Review, released on May 23, 2025, contains papers originally presented at the symposium:

Edith Beerdsen, “Unsticking Litigation Science.”

Edward Cheng, “Expert Histories.”

Shari Seidman Diamond & Richard Lempert, “How Experts View the Legal System’s Use of Scientific Evidence.”

David Faigman, “Overcoming Judicial Innumeracy.”

Maura Grossman & Paul Grimm, “Judicial Approaches to Acknowledged and Unacknowledged AI-Generated Evidence.”

Valerie Hans, “Juries Judging Science.”

Enjoy the beach reading!


[1] See Schachtman, “Scientific illiteracy among the judiciary,” Tortini (Feb. 29, 2012).

[2] See, e.g., In re Accutane Litig., No. 271(MCL), 2015 WL 753674 (N.J. Super., Law Div., Atlantic Cty., Feb. 20, 2015) (excluding plaintiffs’ expert witness David Madigan); In re Incretin-Based Therapies Prods. Liab. Litig., 524 F. Supp. 3d 1007 (S.D. Cal. 2021), aff’d, No. 21-55342, 2022 WL 898595 (9th Cir. Mar. 28, 2022) (per curiam). Provost Madigan is stepping down from his position next month. Sonel Cutler, Zoe MacDiarmid & Kate Armanini, “Northeastern Provost David Madigan to step down in June,” The Huntington News (Jan. 16, 2025).

Can Lawyers Sink Lower Than Plagiarizing a Bot?

May 16th, 2025

Several years ago, I submitted a brief, which I had written, in a New York case. When a co-defendant’s counsel filed the same brief, without acknowledging that it was plagiarised, I was annoyed. It seemed to me that such plagiarism clearly has professional and general ethical implications, especially if the plagiarists charged clients for writing something that they stole from another person.[1]

Legal culture does to some extent encourage plagiarism. Law students work as research assistants for professors and often write segments of legal treatises and hornbooks that are published under their professors’ names. Presumably the law students are satisfied that their work was used and that they received strong recommendations in future job searches. When bright young law school graduates accept judicial clerkships, they understand that their writing for draft opinions or memoranda will be “cannibalized” by their judges at will. Similarly, young law firm associates know that much of their writing may be used in briefs without attribution or signature lines on the brief. This practice goes too far, in my view, when partners require associates to draft articles for publication without making them authors, and with at most an anemic note of gratitude for “assistance.”

When courts use lawyers’ arguments and their actual language advanced in briefs, lawyers rarely complain. At least there are no complaints from the plagiarized lawyers who prevailed.

Sometimes the plagiarized argument reveals the source of a court’s error. In an opinion issued over Justice Sotomayor’s name, the Supreme Court adopted wholesale an argument advanced by the Solicitor General. The origin of the argument was unmistakable because the claim was so egregiously wrong. In its amicus brief, the Solicitor General argued that statistical significance was unnecessary for reaching a conclusion of causation between the use of Zicam and anosmia. In support of its argument, the Solicitor General’s amicus brief cited three cases: Best, Westberry, and Ferebee.[2] The three cited cases all involved disputes over specific causation, whereas the case sub judice purported to involve an issue of general causation. (The Court correctly decided that the corporate disclosure issue under the securities laws did not actually require general causation.) Nevertheless, the Solicitor General’s sloppy legal scholarship was incorporated into the Supreme Court’s opinion. Justice Sotomayor repeated the citation to the first two cases, dropped the reference to Ferebee, but curiously added an even more bizarre third case to the argument by citing the infamous Wells case.[3] Remarkably, as notorious and poorly reasoned as the Wells case was,[4] it involved plaintiffs’ expert witnesses’ reliance upon at least one poorly conducted study that reported nominal statistical significance. And thus the Supreme Court produced the following text, with three inapposite cases:

“We note that courts frequently permit expert testimony on causation based on evidence other than statistical significance. Seee.g.Best v. Lowe’s Home Centers, Inc., 563 F. 3d 171, 178 (6th Cir 2009); Westberry v. Gislaved Gummi AB, 178 F. 3d 257, 263–264 (4th Cir. 1999) (citing cases); Wells v. Ortho Pharmaceutical Corp., 788 F. 2d 741, 744–745 (11th Cir. 1986). We need not consider whether the expert testimony was properly admitted in those cases, and we do not attempt to define here what constitutes reliable evidence of causation.”[5]

I suspect that a law clerk acted as an intermediary, or a vcctor, in the plagiarism by incorporating the Solicitor General’s argument into a draft or a memorandum, which became part of the opinion that none of the justices considered carefully. At least, the three cases cited by the Solicitor General and the cases cited by Justice Sotomayor actually existed.

The introduction of large language models in artificial intelligence (A.I.) has taken plagiarism to a new level.[6] Lawyers can now prompt a machine to review the case law on a specified issue and to create an output of analysis in favor of an identified litigation position. And then the lawyers can submit the output to a court as their own work, and charge their clients for the brief writing. The submission of a brief or memorandum to a court, however, implies that the facts are supported, and that the legal precedents cited exist and are pertinent authorities for the court to consider.

The problem with the use of AI, however, is that AI “hallucinates” non-existent cases, all with citations, case specifics, and sometimes fanciful quotes that seem pertinent. It sucks to be a bot, but it is even worse for lawyers who take AI output, and present it as their own, without further research, in hopes of persuading a court.

Last week, Special Master Magistrate Judge Michael R. Wilner (retired) imposed a monetary sanction of $31,100 against the lawfirm K&L Gates for failing to fact check a brief prepared in substantial part by AI, as well as failing to disclose its use of AI, or to correct errors after notified of the Special Master’s concerns.[7] The Special Master noted that “no reasonably competent attorney should out-source research and writing to this technology – particularly without any attempt to verify the accuracy of that material.”[8] Ouch. K&L Gates is not the first firm, and it sadly will not be the last firm to be sanctioned for the improvident use of AI, and the submission of fraudulent authorities to a court.[9]

The Special Master’s outrage was generated by his discovery that one third of the legal citations were incorrect, and that two of them were non-existent. Several quotations from cases presented in support of the plaintiffs’ argument were entirely bogus.[10] Although the Special Master freely described the lawyers’ actions as “misconduct,” he concluded that disciplinary sanctions against the lawyers involved was unwarranted.[11]

The Special Master’s opinion elided the ethical significance of the plaintiffs’ lawyers’ conduct. The opinion never mentions the Rules of Professional Responsibility; nor does it suggest that a reference to the California State Bar’s Office of Chief Trial Counsel was in order. Plagiarism is, after all, research misconduct in most other professional domains. Under the regulations of the Office of Research Integrity (ORI), plagiarism is “the appropriation of another person’s ideas, processes, results, or words without giving appropriate credit.”[12] An AI model may not be eligible for copyright, or the moral rights of authors, but it seems that the spirit of the prohibition against plagiarism requires disclosure and credit to AI, however bogus AI’s contribution may have been.

Although I tend to think of plagiarism in briefs and other court submissions as a violation of a lawyers’ professional responsibility, the issue actually is not clear cut. Plagiarism would seem to violate core professional responsibilities of honesty and integrity. In disparaging plagiarism, courts have occasionally invoked Model Rule 8.4(c), which prohibits engaging in “dishonesty, fraud, deceit or misrepresentation.”[13] Legal commentators have divided over the propriety of recycling legal arguments and verbatim language without acknowledgments.[14] Context also matters. The legal analysis in a routine motion in a mass tort litigation, say for dismissal for lack of diversity, or for change of venue, probably should not be re-invented. Copying another lawyer’s appellate brief and and its consideration of a legal issue, without acknowledgment, seems ethically dodgy.

Of course, copying, whether permissible or not, does not mean that lawyers are freed from their ethical responsibility of ensuring that citations and interpretations of authorities are correct. Without having taken steps to ensure the relevance and correctness of cited authorities, lawyers cannot represent to the court that their argument has a good-faith basis in law and fact.

Hallucinations versus Delusions

Philosophy professor Hilarius Bookbinder (not Søren Kierkegaard) points out that describing bogus AI output as “hallucinations” is euphemistic and erroneous. When AI makes stuff up, the output is not really an hallucination, but delusional.[15]

Bookbinder channels the insight of William James, who gave extensive consideration to the phenomenon of hallucinations, and ultimately characterized them as correct reports of altered consciousness.[16] In a footnote to The Principles of Psychology, James offered the following helpful distinction:

“Illusions and hallucinations must both be distinguished from delusions. A delusion is a false opinion about a matter of fact, which need not necessarily involve, though it often does involve, false perceptions of sensible things. We may, for example, have religions delusions, medical delusions, delusions about our own importance, about other peoples’ characters, etc., ad libitum.”[17]

Bookbinder has a point about how we talk about large language models of AI. In James’ parlance, AI does not really hallucinate, but it clearly suffers delusions; or perhaps it simply fabricates unwittingly. This feature, or flaw, of AI makes lawyers’ uncritical reliance upon AI for legal research and writing not only unethical, not merely for plagiarizing, but for violating their professional duties of competence and candor to the tribunal. Outsourcing thinking to a machine seems unbecoming for a profession that is built upon careful, independent analysis.

Hallucinations and delusions are both distinguishable from a third phenomenon, bullshit – or willful indifference to the truth.[18] For bull shitters, the assertion is more important than the truth value of the statement. When Felonious Trump claimed a Civil War battle took place on one of his golf courses, and even went so far as to identify the site with a plague. Several historians pushed back, and pointed out, his mistake, to which Trump asked “How would they know that?” Were they there?”[19] Trumpian lies and bullshit have now begun to infiltrate into the judicial system, so we must sort delusions, bullshit, and lies among the pathology of lawyering. We can probably say fairly that AI lacks the intentionality to deceive, or the psychopathology that confuses assertion with fact.

There may well be conduct worse than plagiarizing a bot, but that is hardly a recommendation.


[1] Schachtman, “Copycat – Further Thoughts on Plagiarism in the Law,” Tortini (Oct. 24, 2010); “Plagiarism in the Law,” Tortini (Oct. 16, 2010).

[2] Brief for the United States as Amicus Curiae Supporting Respondents, in Matrixx Initiatives, Inc. v. Siracusano, 2010 WL 4624148, at *14-16 (Nov. 12, 2010) (“Best v. Lowe’s Home CentersInc., 563 F.3d 171, 178 (6th Cir. 2009) (“an ‘overwhelming majority of the courts of appeals’ agree” that differential diagnosis, a process for medical diagnosis that does not entail statistical significance tests, informs causation) (quoting Westberry v. Gislaved Gummi AB, 178 F.3d 257, 263 (4th Cir. 1999)),” and “Ferebee v. Chevron Chem. Co., 736 F.2d 1529, 1536 (D.C. Cir.) (‘[P]roducts liability law does not preclude recovery until a “statistically significant” number of people have been injured’.), cert. denied, 469 U.S. 1062 (1984)).

[3] Wells v. Ortho Pharmaceutical Corp., 615 F. Supp. 262 (N.D. Ga. 1985), aff’d in relevant part, 788 F.2d 741 (11th Cir.), cert. denied, 479 U.S.950 (1986).

[4] See, e.g., James L. Mills and Duane Alexander, “Teratogens and ‘Litogens’,” 15 New Engl. J. Med. 1234 (1986); Samuel R. Gross, “Expert Evidence,” 1991 Wis. L. Rev. 1113, 1121-24 (1991) (“Unfortunately, Judge Shoob’s decision is absolutely wrong. There is no scientifically credible evidence that Ortho-Gynol Contraceptive Jelly ever causes birth defects.”). See also Editorial, “Federal Judges v. Science,” N.Y. Times, December 27, 1986, at A22 (unsigned editorial) (“That Judge Shoob and the appellate judges ignored the best scientific evidence is an intellectual embarrassment.”);  David E. Bernstein, “Junk Science in the Courtroom,” Wall St. J. at A 15 (Mar. 24,1993) (pointing to Wells as a prominent example of how the federal judiciary had embarrassed American judicial system with its careless, non-evidence based approach to scientific evidence); Bert Black, Francisco J. Ayala & Carol Saffran-Brinks, “Science and the Law in the Wake of Daubert: A New Search for Scientific Knowledge,” 72 Texas L. Rev. 715, 733-34 (1994) (lawyers and leading scientist noting that the district judge “found that the scientific studies relied upon by the plaintiffs’ expert were inconclusive, but nonetheless held his testimony sufficient to support a plaintiffs’ verdict. *** [T]he court explicitly based its decision on the demeanor, tone, motives, biases, and interests that might have influenced each expert’s opinion. Scientific validity apparently did not matter at all.”) (internal citations omitted); Troyen A. Brennan, “Untangling Causation Issues in Law and Medicine: Hazardous Substance Litigation,” 107 Ann. Intern. Med. 741, 744-45 (1987) (describing the result in Wells as arising from the difficulties created by the Ferebee case; “[t]he Wells case can be characterized as the court embracing the hypothesis when the epidemiologic study fails to show any effect”).  Kenneth R. Foster, David E. Bernstein, and Peter W. Huber, eds., Phantom Risk: Scientific Inference and the Law 28-29, 138-39 (MIT Press 1993) (criticizing Wells decision); Hans Zeisel & David Kaye, Prove It With Figures: Empirical Methods in Law and Litigation § 6.5, at 93(1997) (noting the multiple comparisons in studies of birth defects among women who used spermicides, based upon the many reported categories of birth malformations, and the large potential for even more unreported categories); id. at § 6.5 n.3, at 271 (characterizing Wells as “notorious,” and noting that the case became a “lightning rod for the legal system’s ability to handle expert evidence.”).

[5] Matrixx Initiatives, Inc. v. Siracusano, 131 S.Ct. 1309, 1319 (2011).

[6] Schachtman, “Artificial Intelligence May Be Worse Than None At All,” Tortini (Feb. 2, 2025); “Hallucinations in Law and in Government,” Tortini (Feb. 19, 2025).

[7] Lacey v. State Farm General Insurance Co., Case 2:24-cv-05205-FMO-MAA, doc. 119 (C.D. Calif. May 6, 2025).

[8] Id. at 7. The Special Master ducked the more interesting counter-factual question: what if AI had generated a perfect brief, with exactly the right citations, properly cited, with all inferences and conclusions proper and correct? Would the outsourcing of human intelligence be acceptable to us, with all the requisite disclosures? See Hilarius Bookbinder, “Why AI is Destroying Academic Integrity: It’s because students prefer The Experience Machine,” Scriptorium Philosophia (Jan. 02, 2025).

[9] See note 1, supra. See also Mata v. Avianca, 678 F. Supp. 3d 443 (S.D.N.Y. 2023) (ordering sanctions against lawyers who submitted briefs with six fabricated judicial opinions and fake quotes); Gauthier v. Goodyear Tire & Rubber Co., civil action no. 1:23-CV-281 (E.D. Tex Nov. 25, 2024) (imposing sanctions for citing non-existing cases with fabricated quotations). Canadian lawyers have also been seduced by the prospect of outsourcing their thinking, researching, analyzing, and writing to a bot. Ko v. Li, CV-25-00736891-00ES, 2025 Ontario Super. Ct. Justice 2766 (May 1, 2025) (ordering lawyer to show cause why she should not be held in contempt). See Bernise Carolino, “Ko v. Li, Ontario Superior Court, 2 nonexistent case citations, attorney referred for potential contempt proceedings,” Canadian Lawyering (May 13, 2025).

[10] Kat Black, “‘A Collective Debacle’: Ellis George and K&L Gates Ordered to Pay $31,000 after Using AI to Write Brief in Insurance Case,” Legal Intelligencer (May 13, 2025).

[11] Lacey, supra, at 7; Eugene Volokh, “AI Hallucination in Filings Involving 14th-Largest U.S. Law Firm Lead to $31K in Sanctions,” The Volokh Conspiracy, Reason (May 13, 2025).

[12] 42 CFR 93.103 (c) Department of Health and Human Services, Office of Research Integrity. See, e.g., Sena Chang, “Secretary of Defense Pete Hegseth ’03 ‘plagiarized’ small portions of his senior thesis, experts say. But how serious is it?” Daily Princetonian (May 10, 2025).

[13] See In re Mundie, 453 Fed.Appx. 9 (2d Cir. 2011) (publicly reprimanding lawyer for various acts, including copying extensively from another lawyer’s brief in a different case). See also In re Summit Financial, Inc., 2021 WL 5173331 (Bankr. C.D. Cal. Nov. 5, 2021); Lohan v. Perez, 924 F.Supp. 2d 447 (E.D.N.Y. 2013). Compare New York City Bar Formal Opinion 2018-3 (disapproving “extensive” copying, while noting that copying source material without attribution is not “per se” an ethical violation) with North Carolina State Bar Formal Ethics Opinion 2008-14 (acknowledging that lawyers may copy language used in other briefs without attribution).

[14] Dennis A. Rendleman, “Copy That!: What is plagiarism in the practice of law?,” YourABA (Mar. 2020) (arguing that unacknowledged copying in legal filings is different from such conduct in scholarly publications); Andrew M. Carter, “The Case for Plagiarism,” 9 U. Calif. Irvine L. Rev. 531 (2019); Carol M. Bast & Linda B. Samuels, “Plagiarism and legal scholarship in the age of information sharing: the need for intellectual honesty,” 57 Catholic Univ. L. Rev. 777 (2008); Peter A. Joy & Kevin C. McMunigal, “The Problems of Plagiarism as an Ethics Offense,” ABA Criminal Justice 56 (Summer 2011).

[15] Hilarius Bookbinder, “Hallucination, bullshit, confabulation: AI and the outsourcing of thinking,” Scriptorium Philosophia (May 15, 2025).

[16] William James, The Principles of Psychology, vol. 2 (ch. 18-19) (1918).

[17] Id. at ch. 19, n. 41.

[18] Harry Frankfurt, On Bullshit 63 (2005) (“Bullshit is unavoidable whenever circumstances require someone to talk without knowing what he is talking about.  Thus the production of bullshit is stimulated whenever a person’s obligations or opportunities to speak about some topic exceed his knowledge of the facts that are relevant to that topic.”).

[19] Joyce Chen, “Donald Trump’s Golf Course Plaque Honors Fake Civil War Battle,” Rollingstone (Aug. 17, 2017); Nicholas Fandos, “In Renovation of Golf Club, Donald Trump Also Dressed Up History,” N.Y. Times (Nov. 24, 2015).

Man Oh Mann, Has the Climate Changed

March 15th, 2025

Michael Mann, formerly a climate scientist at Penn State University, is no stranger to controversy.[1] As an outspoken advocate for climate change, he has attracted close scrutiny and harsh criticism. Several right-of-center commentators criticized Mann’s work in potentially defamatory terms of “misconduct,” or “manipulation,” or data torturing. One blogger likened Mann’s conduct to Penn State’s Jerry Sandusky’s sexual abuse scandal.[2]

Mann sought vindication, not by a duel, but by lawsuits for defamation. His cases have bounced up and down the court system for over a decade,[3] but last week, they crashed landed. In the course of yo-yo’ing through the courts, the case resulted in the Supreme Court’s denial of a petition for a writ of certiorari, which was accompanied by a dissent from Associate Justice Alito. The published dissent is interesting for the light it sheds on recent speculation about the fate of New York Times v. Sullivan,[4] but also for providing a reasonably accurate statement of the facts of the case:

“Penn State professor Michael Mann is internationally known for his academic work and advocacy on the contentious subject of climate change. As part of this 345*345 work, Mann and two colleagues produced what has been dubbed the ‘hockey stick’ graph, which depicts a slight dip in temperatures between the years 1050 and 1900, followed by a sharp rise in temperature over the last century. Because thermometer readings for most of this period are not available, Mann attempted to ascertain temperatures for the earlier years based on other data such as growth rings of ancient trees and corals, ice cores from glaciers, and cave sediment cores. The hockey stick graph has been prominently cited as proof that human activity has led to global warming. Particularly after emails from the University of East Anglia’s Climate Research Unit were made public, the quality of Mann’s work was called into question in some quarters.

Columnists Rand Simberg and Mark Steyn criticized Mann, the hockey stick graph, and an investigation conducted by Penn State into allegations of wrongdoing by Mann. Simberg’s and Steyn’s comments, which appeared in blogs hosted by the Competitive Enterprise Institute and National Review Online, employed pungent language, accusing Mann of, among other things, ‘misconduct’, ‘wrongdoing’, and the ‘manipulation’ and ‘tortur[e]’ of data. App. to Pet. for Cert. in No. 18-1451, pp. 94a, 98a (App.).

Mann responded by filing a defamation suit in the District of Columbia’s Superior Court. Petitioners moved for dismissal, relying in part on the District’s anti-SLAPP statute, D. C. Code § 16-5502(b) (2012), which requires dismissal of a defamation claim if it is based on speech made ‘in furtherance of the right of advocacy on issues of public interest’ and the plaintiff cannot show that the claim is likely to succeed on the merits. The Superior Court denied the motion, and the D. C. Court of Appeals affirmed. 150 A.3d 1213, 1247, 1249 (2016). The petition now before us presents two questions: (1) whether a court or jury must determine if a factual connotation is ‘provably false’ and (2) whether the First Amendment permits defamation liability for expressing a subjective opinion about a matter of scientific or political controversy. Both questions merit our review.”[5]

Subsequent events in the Mann case have made a return trip to the Supreme Court for a substantive decision on the First Amendment issue very unlikely. Mann’s case against the National Review was dismissed before trial. A District of Columbia jury returned verdicts in favor of Mann, and against Steyn and Simberg, on Mann’s claims of libel. The jury awarded Mann two dollars, one dollar against each defendant, but one million dollars against Steyn, and one thousand dollars against Simberg, as punitive damages. Post-trial motions have been pending after the trial until earlier this month.[6]

On January 7, 2025, the trial court ordered Dr. Mann to pay court costs and attorney fees in the amount $530,820.21 to The National Review, which had been dismissed from the case, before trial.[7] Mann plans to appeal this cost award against him.

Punitive Damages

Judge Irving upheld the libel verdict for Dr. Mann, but found that the punitive damages awards were grossly excessive given the nominal damage awards.[8] As such, the punitive damage awards offended the due process clause of the constitution, and had to be reduced.[9] The one million dollar award was reduced to $5,000.

Sanctions against Michael Mann for Misconduct

In the course of the trial, Dr. Mann and his counsel introduced an exhibit with items of alleged damages in the form of loss grants.[10] In the pre-trial discovery phase of the case, Mann had not been able to adduce any evidence that he actually lost any funding because grants withheld or withdrawn because of the comments of the two blogging defendants. Mann had acknowledged, at least at one point, that the details of grants not received were not relevant to any claim or defense in the case.  Understandably, Judge Alfred S. Irving, Jr., presiding, was rather upset about the Mann testimony and exhibit. The defendants filed a “Motion for Sanctions for Bad-Faith Trial Misconduct,” during the trial.[11]

The facts of the motions were further litigated in post-trial motions, with the result that Judge Irving found, by clear and convincing evidence, that Dr. Mann and his counsel had acted in bad faith in pressing claims for several lost grants. In last week’s 46-page Order, Judge Irving documented in painful detail the dishonesty and mendacity exhibited by Mann and his lawyers, and the violation of multiple rules of professional responsibility. The court found that Dr. Mann, through his lawyers, had:

“acted in bad faith when they presented erroneous evidence and made false representations to the jury and the Court regarding damages stemming from loss of grant funding… . The Court does not reach this decision lightly.”

Judge Irving characterized the misconduct of Dr. Mann and his counsel as “extraordinary in its scope, extent, and intent.” The court has not yet made an assessment of the dollar amount for Mann’s egregious conduct. In all likelihood, the sanction award for his trial misconduct will exceed the $6,002, he has in the plus column for his litigation efforts. With over a half a million dollars assessed against Dr. Mann, in favor of the National Review, Mann’s litigation efforts to date might seem like being hit over the head repeatedly with a hockey stick.

Over a year ago, the New York Times reported on the initial jury verdict in favor of Dr. Mann.[12] Since then, however, the paper has been remarkably silent on the developments in the case, including the court’s findings concerning Dr. Mann’s misconduct in presenting evidence.

No one will miss the irony in Mann’s prevailing at trial in showing that he had been defamed by the trial defendants, and then attempting in plain sight to deceive the jury on damages, in what fair comment might call “misconduct,” or “manipulation,” or “data torturing.” Of course, none of the litigation events described by Judge Irving bear on the correctness vel non of predictions of climate change. These litigation events do, however, single out Dr. Michael Mann as lacking the ethos for serving as a spokesman for any scientific claim. Being called out for manipulating evidence is not a good thing for anyone in the evidence business.


[1][1] Mann left Penn State in 2022, to become a Presidential Distinguished Professor in the Department of Earth and Environmental Science at the University of Pennsylvania.

[2] See Competitive Enterprise Institute v. Mann (D.C. Ct. Apps. 2016).

[3] SeeOreskes Excluded as Historian Expert Witness in Mann Case,” Tortini  (Feb. 28, 2023); “Climategate on Appeal,” Tortini (Aug. 17, 2014).

[4] 376 US 254 (1964).

[5] National Review, Inc. v. Mann, 140 S.Ct. 344, 344-45 (2019).

[6] Eugene Volokh, “Punitive Damages Award in Mann v. Steyn Reduced from $1M to $5K, largely because the compensatory damages were just $1,” Reason (Mar. 4, 2025); Roger Pielke, “In Bad Faith,” AEI (Mar. 12, 2025).

[7] Mann v. National Review, Inc., 2012 CA 008263B, Amended Order Granting in Part National Review Inc.’s Motion for Attorneys’ Fees and Supplemental Motion for “Fees on Fees” (D.C. Super. Ct. Jan. 7, 2025); see Danielle Shockey, “Pennsylvania Climate Scientist Must “Pay Up” $530K After 8 Year Legal Battle Over 2 Blog Posts,” Tampa Free Press (Jan. 12, 2025); Marc Morano, “Prof. Michael Mann ‘intends to appeal’ court order to pay ‘National Review Inc. $530,820.21 in attorneys’ fees & costs’,” Climate Depot (Jan. 10, 2025).

[8] Mann v. National Review, Inc., 2012 CA 008263B, Omnibus Order on Defendants’ Post-Trial Motions for Judgment as a Matter of Law (D.C. Super. Ct. Mar. 4, 2025).

[9] Id. at 20-30. See BMW of North America v. Gore, 517 U.S. 559, 575 (1996); Cooper Indus., Inc. v. Leatherman Tool Group, Inc., 532 U.S. 424, 433 (2001); State Farm Mut. Auto. Ins. Co. v. Campbell, 538 U.S. 408, 427 (2003).

[10] Mann v. National Review, Inc., 2012 CA 008263B, Order Granting in Part Defendants’ Motions for Sanctions (D.C. Super. Ct. Mar. 12, 2025).

[11] Id. at 1-2.

[12] Delger Erdenesanaa, “Michael Mann, a Leading Climate Scientist, Wins His Defamation Suit,” N.Y. Times (Feb. 8, 2024).

The Greatest Anti-Science President Ever

March 10th, 2025

From an epistemological and psychological perspective, we would expect the most mendacious president to have the most tenuous relationship with science. President Trump never fails to disappoint when it comes to matters scientific.

Although Felonious Trump takes pride in his uncle who was a professor at the Massachusetts Institute of Technology, our 47th president has a science IQ that could well be in the negatives. In his first term, Trump gave us sharpie-gate wherein he determined the course of a hurricane based upon politically expedient lines. He floated the use of sodium hypochlorite as a treatment for Covid, and encouraged his administration’s health officials to investigate the possibilities.[1]

We might judge him harshly for his first-term alliances with quack Covid denialists and peddlers of quack nostrums. More recently, we have seen Felonious Trump forge alliances with the likes of supplement advocate Dr. Oz and lawsuit industry foot soldier, Robert F. Kennedy, Jr. (“Junior”). The alliance between Trump and Junior is especially strange, given Kennedy’s long-standing participation in the lawsuit industry and his demonization of pharmaceutical and other manufacturers.

On March 6, 2025, in a performative speech to Congress,[2] Felonious Trump provided further evidence of his low science I.Q. The speech contained a boast about cost-cutting begat from ignorance and stupidity. The president took credit for cutting $8 million for research “for making mice transgender — this is real.”[3]

Although it would be tempting to argue that the transgender mice were taking over laboratories because Trump supporters were eating cats, the reality is that there was no spending on supposedly transgender mice. No Mickeys became Minnies, on the watch of the National Institutes of Health. Trump had misrepresented cuts to research involving transgenic mice, mice with foreign DNA, for the purpose of conducting targeted experimental research.Transgenic mice were developed in the 1980s, and have become a standard tool in medical research.[4]

Childhood Cancer

There can hardly be a more emotional issue than childhood cancer, so we should not be surprised that Felonious Trump would exploit the issue for political gain. In the course of his March 6th address, Trump announced that a 13 year old child, Devarjaye (“DJ”) Daniel, would become an honorary Secret Service agent. DJ is a survivor of a cancer of his brain and spine. According to Trump:

“DJ’s doctors believe his cancer likely came from a chemical he was exposed to when he was younger. Since 1975, rates of child cancer have increased by more than 40 percent.”

Given that all living beings and the planet that we inhabit are all made of chemicals, it is hard to know exactly what Trump was trying to say. Presumably, he was channeling the environmentalism and chemophobia of the progressive left and its darling, Junior. But what chemicals, when, where, and in what doses? The one thing I know is that neither Trump nor Junior knows. Trump went on to give a shout out to Junior:

“Reversing this trend is one of the top priorities for our new presidential commission to Make America Healthy Again chaired by our new secretary of Health and Human Services, Robert F. Kennedy Jr. With a name Kennedy, you would have thought everybody over here would have been cheering. How quickly they forget!”

Just as Professor Trump of M.I.T. has a moronic nephew, so did the late President Kennedy. Could it be regression to the mean?

Trump was, no doubt, channeling the chemophobia usually disseminated by the radical left. What are chemicals? Everything is a chemical, but which ones was he indicting.

In a big tell, Felonious Trump did not call on Congress to allocate more funding for scientific inquiry into the “chemicals” that might have caused DJ’s cancer, or for treating childhood cancer. Cancer in children is rare, but it is the leading cause of disease morbidity among children and adolescents past infancy. Firearms are a significant cause of death as well. But has the rate of childhood cancer gone up by 40% since 1975? Because of changes in reporting methods, assessing this 50 year period is difficult. There are, however, good SEER data for the last 30 or so years that show, for nervous system cancers, there is no important increase.

The SEER (Surveillance, Epidemiology, and End Results) data comes from a program set up by the National Cancer Institute (NCI) to collect and study data on cancer incidence and mortality in the United States. The data for DJ’s cancer for the relevant time period, 1992 – 2022, are available from the NCI, and the NCI’s website. The chart below shows the incidence rate of childhood brain and nervious system cancers (ages 0 to 19):[5]

A group outside the National Cancer Institute reported its analysis over a long period, 45 years, for SEER data.[6] Looking at the most important specific cancer types, the group found that some cancer types increased, but nothing remotely close to the 40% for the cancer that afflicted young DJ.

In this group’s analysis, the incidence of childhood cancer increased from 14.23 cases per 100,000 (for 1975-1979) to 18.89 (for 2010-2019), but they noted the obvious variability among relevant cancers and the potential bias from improved diagnoses and data registration over time. Most important, the authors noted that the “underlying causes remain unclear.”

Autism

Despite his first-term success in Operation Warp Speed to encourage the development of Covid vaccines and to promote their distribution, Felonious Trump has run away from one of his few successes ever since he was booed by his MAGATs at a political rally.[7] Indeed, Trump has long been anti-vax adjacent, but reluctant to acknowledge his superstitions publicly. In a conversation with Junior, back in July 2024, both Trump and Junior let their hair down and revealed their anti-vax convictions.[8]

In the past, Trump had been cagey (and dishonest) about his anti-vax beliefs. Andrew Wakefield, the disgraced author of a retracted 1998 article, attended  one of Trump’s first inaugural balls, which occasioned numerous public denunciations that pushed Trump’s inner quack into hiding for the while.[9] In his second term, after being groomed by Junior, Trump is now unrestrained by sober second thoughts:

“Our goal is to get toxins out of our environment, poisons out of our food supply, and keep our children healthy and strong. As an example, not long ago, and you can’t even believe these numbers, one in 10,000 children have autism. One in 10,000. And now it’s one in 36. There’s something wrong. One in 36. Think of that. So we’re going to find out what it is and there’s nobody better than Bobby and all of the people that are working with you. You have the best to figure out what is going on. OK, Bobby, good luck. It’s a very important job.”

No, you really cannot believe those numbers because the diagnostic categories and criteria have changed, as have the social connotations of having an autistic child has changed. And so has the average age of fathers at the time of conception. Turning the issue over to Junior, who has labored for decades in the lawsuit industry, is hardly likely to yield any meaningful knowledge.

The result of Trump’s delegation to Junior was highly predictable. The vaccine autism hypothesis has been extensively explored,[10] and a disinterested observer might think doing another study would be a wonderful example of waste in government.[11]

And yet within a couple of days of Trump’s congressional address, Reuters reported that the government plans a large study on autism and vaccines.[12] The exact nature of the study and Junior’s role in the study remain unclear.[13]

Recent news reports suggest that the Centers for Disease Control intend to search for correlations between vaccines and autism in the Vaccine Safety Datalink (VSD), a collaboration between CDC and various healthcare organizations across the country that monitor vaccine safety and study rare and serious adverse events.[14] The CDC website has a link to a white paper on studying childhood immunization, prepared by the VSD.[15] The so-called white paper is undated and appears to have been prepared almost 10 years ago.

The hyped claim that vaccines cause autism was advanced by a British physician, Andrew Wakefield, who has since been stripped of his license. Wakefield blamed vaccines in his 1998 Lancet paper, which has since been retracted.[16] Wakefield fled his native England for the warm embrace of MAGAT nation, where he could continue to agitate against vaccines. In 2017, Wakefield attended one of Trump’s inaugural balls, which provoked a quackwatch hue and cry.[17]


[1]Coronavirus: Outcry after Trump suggests injecting disinfectant as treatment,” BBC (Apr. 24, 2020).

[2]  “Remarks by President Trump in Joint Address to Congress,” The White House (Mar. 6, 2025).

[3] Miles Klee, “Trump Decried Millions Spent Making Mice Transgender: It was Cancer and Asthma Research,” Rolling Stone (Mar. 5, 2025); Kiona N. Smith, “This Is What’s Behind Trump’s Uproar Over ‘Transgender Mice,” Forbes (Mar. 07, 2025).

[4] See generally National Research Council. Sharing Laboratory Resources: Genetically Altered Mice (1994).

[5]Cancer Stat Facts: Childhood Brain and Other Nervous System Cancer (Ages 0–19),” N.C.I. (last visited Mar. 10, 2025); see also  “Cancer in Children and Adolescents,” NCI (last visited Mar. 10, 2025).

[6] Iyad Sultan, Ahmad S. Alfaar, Yaseen Sultan, Zeena Salman, Ibrahim Qaddoumi, “Trends in childhood cancer: Incidence and survival analysis over 45 years of SEER data,” 20 PLoS One e0314592 (2025).

[7] See, e.g., Dan Merica, “Trump met with boos after revealing he received Covid-19 booster,” CNN (Dec. 21, 2021).

[8] Rachel Treisman, “Leaked video shows Trump criticizing vaccines on phone with RFK Jr.,” Nat’l Public Ratio (July 16, 2024).

[9] See, e.g., Casey Ross, “Andrew Wakefield appearance at Trump inaugural ball triggers social media backlash,” Stat News (Jan. 21, 2017).

[10] Kathleen Stratton, et al., eds., Adverse Effects of Vaccines: Evidence and Causality (Instit. of Med. 2012).

[11] Sheryl Gay Stolberg, “A Skeptical G.O.P. Senator Makes His Peace with Kennedy,” N.Y. Times (Mar. 5, 2025).

[12] Dan Levine and Leah Douglas, “US CDC plans study into vaccines and autism, sources say,” Reuters (Mar. 9, 2025).

[13] Judy George, “CDC Plans Large Study on Autism and Vaccines, Report Says — HHS Secretary Kennedy’s role in this research is unclear,” MedPage Today (Mar. 7, 2025).

[14] Emily Baumgaertner Nunn & Sheryl Gay Stolberg, “C.D.C. Will Investigate Debunked Link Between Vaccines and Autism,” N.Y. Times (Mar. 7, 2025).

[15] Jason M. Glanz, et al., for the Vaccine Safety Datalink, “White Paper on Studying the Safety of the Childhood Immunization Schedule,” CDC.

[16] Andrew J. Wakefield, S.H. Murch, A Anthony, J. Linnell, D.M. Casson, M. Malik, M. Berelowitz, A.P. Dhillon, M.A. Thomson, P. Harvey, A. Valentine, S.E. Davies, J.A. Walker-Smith, “Ileal-lymphoid-nodular hyperplasia, non-specific colitis, and pervasive developmental disorder in children,” 351 Lancet 637 (1998).

[17] Casey Ross, “Andrew Wakefield appearance at Trump inaugural ball triggers social media backlash,” Stat News (Jan. 21, 2017).

Artificial Intelligence May Be Worse Than None At All

February 25th, 2025

Artificial intelligence poses some distinct dangers to lawyers as evidenced by the cockup of the lawfirm of Morgan & Morgan in submitting a brief with bogus citations. It is hard to imagine a more serious dereliction of professional duty than in submitting a brief with citations to cases that do not exist, and which no lawyer could have ever have read and selected as appropriate to cite.[1] Apparently, a user of A.I. cannot simply direct the computer to stop making stuff up, any more than we can expect Felonious Trump to stop making stuff up.

Other dangers lurk in artificial intelligence. Back in 2020, Thomson Reuters, the owner of the Westlaw legal database sued an A.I. company, ROSS Intelligence for copyright infringement. As all lawyers know, Thomas Reuters publishes legal decisions in the Westlaw database. The content of federal decisions are in the public domain, but Westlaw adds headnotes that categorize parts of opinions by legal concepts, with a précis of the subject matter addressed in the opinion. In attempting to create an A.I.-powered rival to Westlaw, ROSS Intelligence trained its system with Westlaw content, including the headnote content written by Thomson Reuters employees.

ROSS apparently failed, however, to check whether it’s A.I. system lifted headnotes wholesale from Thomson Reuters. Thomson Reuters alleged that over 21,000 headnotes infringed its copyright. Some of the headnotes used by ROSS were not clearly infringing, but an expert witness for ROSS acknowledged that 2,830 headnotes were copied. The trial judge reviewed these 2,830 headnotes and determined that 2,243 of the headnotes were so clearly infringing that partial summary judgment was warranted in favor of Thomson Reuters.[2] The trial court found that ROSS’s assertion of a “fair use” defense was improvidently deployed and unavailing to avoid liability.[3] Many of the pleadings in the case can be found here.

In a previous post, I reported some of the frustrations I experienced in working with A.I. large-language models for obtaining an accurate summary of medical research.[4] Since then, I have had a chance to review additional output directed in the hopes of providing a comprehensive summary of various problems in the communication of scientific ideas, both in the scholarly journals, main-stream news media, and social media. Although I would not close the door on attempts to harnass A.I. for creating sophisticated, meaningful content, I remain deeply skeptical of the current state of the art. As the ROSS case shows, there are serious problems with copyright violations because of wholesale copying of texts that are part of the domain of the A.I. engine. From the point of view of the human author, there is also the very real danger of unethical plagiarism.

There are other dangers lurking in the use of A.I. for writing tasks. From what I have seen to date, some of the problematic output includes:

  1. glib generalizations without support,
  2. incorrect assertions without support,
  3. incorrect assertions with erroneous support,
  4. haphazard citations,
  5. citations to known unreliable sources, and
  6. recycling of old claims without any new insight or analysis.

And then there is also the distinct danger of “hallucinations” in the form of non-existent citations, a danger that put the Morgan & Morgan lawyers into shame and disrepute. Maybe we humans should simply learn how to read, research, and write ourselves!

自由西藏


[1]Hallucinations in Law and in Government,” Tortini (Feb. 19, 2025).

[2] Thomson Reuters Enterprise Centre GmbH & West Publishing Corp. v. ROSS Intelligence Inc., 1:20-cv-00613-SB, ECF 770 (D. Del. Feb. 11, 2025).

[3] Jonathan Bailey, “Judge Rules Against Fair Use Defense for AI Company,” Plagiarism Today (Feb. 11, 2025); Ashley Brooks, “Thomson Reuters v. Ross Intelligence: Use Of Copyrighted Material To Train AI Systems Is Not Fair Use,” Roth Jackson (Feb. 19, 2025); Richard M. Assmus, Brian W. Nolan, and Megan P. Fitzgerald, “ROSS AI Decision Gives Early Indication of Strengths and Weaknesses of Fair Use Defense, Mayer Brown (Feb. 12, 2025).

[4]Debating a Computer about Genetic Causes of Mesothelioma – Part Two,” Tortini (Feb. 18, 2025).

The opinions, statements, and asseverations expressed on Tortini are my own, or those of invited guests, and these writings do not necessarily represent the views of clients, friends, or family, even when supported by good and sufficient reason.