Avoiding Nonsense About Science — Ask For The Evidence

Sense about Science is a British charitable organization that is devoted to helping people understand scientific and medical claims. Sense about Science acknowledges that:

“Sharing scientific reasoning involves giving people the tools to question pseudoscience and misleading claims, to help cut through the noise around scientific or medical issues.”

To further its laudable goals, Sense about Science has launched an “Ask for Evidence Campaign”:

“We hear daily claims about what is good for our health, bad for the environment, how to improve education, cut crime, treat disease or improve agriculture. Some are based on reliable evidence and scientific rigour. Many are not.  How can we make companies, politicians, commentators and official bodies accountable for the claims they make? If they want us to vote for them, believe them or buy their products, then we should Ask for Evidence.”

*************

Mr. Nicholas Kristof grew up on a cherry farm, and went on to a successful academic and writing career. For over a decade,  Kristof has written “columns” for The New York Times, a public platform that has helped him win two Pulitzer Prizes.  Sometimes, Kristof’s early experience in cherry picking has helped him with discussions of scientific issues, which seem more like “Nonsense about Science.”  Consider yesterday’s New York Times, in which, Kristof combines cherry picking with scare mongering.  SeeDanger Lurks in That Mickey Mouse Couch”:

“RESEARCHERS this summer purchased 42 children’s chairs, sofas and other furniture from major retailers and tested them for toxic flame retardants that have been linked to cancer, birth defects, diminished I.Q.’s and other problems.”

Besides the vague and conclusory language of “links,” Kristof does not cite a scintilla of evidence; instead he cites opinion from an environmentalist organization, Center for Environmental Health (CEH).  What is the CEH?  From its website, the CEH appears to be a group led by actors, community activists, politicians, self-styled “philanthropists,” advocates for “environmental justice.”  No serious scientists appear on the CEH’s board of directors, or on its staff, which is populated mostly by lawyers and activists.

Does the CEH, without the benefit of real scientific talent, marshal serious scientific evidence?  You should judge for yourself by reading the webpage that Kristof cites.  See CEH, “Playing on Poisons: Children’s Furniture Found with Harmful Flame Retardant Chemicals” (November 20, 2013).  If diligent readers of Kristof’s column were to read his “source,” they would find only hand waving and opinionated pronouncements without any reference to supporting scientific studies. Perhaps there is something to the accusations made by Kristof and his band of “environmental justice” advocates, but nothing in the column or its sources would shed any light on the matter. 

Mr. Kristof prefers to deal in vague, if not meaningless terms, such as “links” between chemical exposures and myriad dire outcomes.  He patronizes readers by giving them no understanding of the quantity or quality of the evidence that supports his innuendo.  Kristof repeats his bad, unscientific brand of journalism on his blog. See Nicholas Kristof, “Are You Sitting Down? On a Couch?” (Nov. 23, 2013).

Citing regulatory approval of the fire retardants at issue, the American Chemistry Council has taken Mr. Kristof to task.  SeeNew York Times columnist and new docudrama mislead public on importance of flame retardants, strong fire safety standards” (Nov. 23, 2013).  The Council’s webpage points to other sites that provide some additional evidence of regulatory approvals and efficacy testing of fireproofing chemicals, but it does not list the chemicals involved, and it does not address the biological causal claims made by Kristof and the CEH.  Nor does the American Chemistry Council mention that the litigation industry (a/k/a plaintiffs’ bar) has waged war against the use of companies for using natural, flammable fabrics and materials.

The Sense about Science organization focuses upon scientific nonsense mostly in the United Kingdom.  Kristof’s brand of hit-and-run journalism illustrates that we very much need a similar organization in the United States.  The discussion and debate over health issues should not take place by the trading of assertions and adjectives, without reference to the actual evidence at hand.  Interestingly, in the same issue of the New York Times, which carried Kristof’s column, two reporters, Walt Bodganich and Glenn Silber, covered a flawed forensics investigation in Florida.  Bodganich & Silber, “Two Gunshots on a Summer Night,” New York Times, A1 (Nov. 24, 2013).  In almost four full pages of coverage, these Times reporters analyze the circumstantial and forensic evidence in great detail to expose a flawed police investigation.  Although the death involved, and the police incompetence suggested by these journalists, is a tragedy, the inability of a newspaper to cover a story that alleges many thousands of deaths, with any attention to the actual evidence, is a much greater tragedy.

*************

The aversion to reading and understanding the actual scientific evidence finds ample expression in the legal arena. In the recent case of Jackson v. Pollion, the Seventh Circuit chided the lawyers, and trial judges, for their failure to examine and understand the scientific evidence at issue in the merits of the case. Jackson v. Pollion, No. No. 12-2682 (7th Cir. Oct. 28, 2013) (Posner, J.).  Judge Posner argued the noteworthiness of the lapse by the advocates and the judges:

“This lapse is worth noting because it is indicative of a widespread, and increasingly troublesome, discomfort among lawyers and judges confronted by a scientific or other technological issue.”

Slip op. at 2.

And in more Kierkegaardian terms, Judge Posner admonishes the legal profession:

“The legal profession must get over its fear and loathing of science.”

Slip op. at 8.

Indeed!  Judge Posner’s admonition is undermined by the current Federal Rule of Evidence, which diminish the value of underlying data and evidence in expert witness opinion.  Rule 702 makes opinion admissible, and Rule 703 acknowledges that much of the bases for expert witness opinion will itself be inadmissible.  The structure of the Federal Rules of Evidence, however, undermines the importance of underlying evidence by not requiring that expert witnesses disclose the facts and data upon which they rely.

The evidence law of some states is to the contrary.  Consider Hansen v. Wyeth Inc., 77 Pa. D. & C.4th 501, 2005 WL 3068256 (Phila. Cty. Ct. Com.Pl. 2005) (Bernstein, J.).  The Hansen case focused on the testimony that was given by Dr. Harris Busch in a fenfluramine products liability case in Philadelphia.  Some may recall Busch as a veteran plaintiffs’ expert witness from the silicone gel breast implant litigation.  See Hon. Jack B. Weinstein, “Preliminary Reflections on Administration of Complex Litigation” 2009 Cardozo L. Rev. de novo 1, 14 (2009) (describing plaintiffs’ expert witnesses in silicone litigation as “charlatans” and the litigation as largely based upon fraud). 

In Hansen, Busch testified that Wyeth had been negligent, but on post-trial motions, Judge Bernstein found that:

“The doctor’s opinion, however, was presented in conclusory form and was ‘generically’ predicated on voluminous materials.”

Hansen, 77 Pa. D. & C.4th at 501.

Applying Pennsylvania’s version of Rule 705, which incorporated the state’s traditional common-law approach, Judge Bernstein held that Dr. Busch’s failure to give a detailed accounting of the evidentiary basis for his opinion rendered his opinion inadmissible.  Pennsylvania Rule 705 provides:

Disclosure of facts or data underlying expert opinion.

The expert may testify in terms of opinion or inference and give reasons therefore; however the expert must testify as to the facts or data on which the opinion or inference is based.”

Hansen, 77 Pa. D. & C.4th at 504 (citing and quoting Rule 705).  The Pennsylvania version of Rule 705 differs significantly from the Federal Rule of Evidence 705 by requiring actual disclosure of the evidence upon which an expert witness opines.  In Pennsylvania state court, it is not sufficient for juries or judges to evaluate expert witness testimony upon looks, demeanor, apparent bias, and the like:

“While most rules of evidence concern the admission of facts, Rule 705 concerns itself not with admission but disclosure. Absent a clear disclosure of the factual basis of opinion testimony, an expert’s opinion does not so much assist the jury with their determination of the facts as replace the jury’s essential factfinding  role. Without a clear disclosure, the jury has no basis for determining whether the facts as understood or assumed by the expert are compatible with the facts as the jury finds them to be. Thus, Rule 705 was adopted to preserve the exclusive  factfinding function of the jury.”

Id. at 507 (internal citations omitted).  Pennsylvania Rule of Evidence 705 requires specificity by the testifying expert witness in identifying the actual basis for his or her opinion:

“The Rule 705 requirement of presenting the ‘facts and data’ which form the basis of the opinion may not be satisfied by a mere formalistic recitation of the material reviewed or considered. That pro forma routine absolutely obscures what Rule 705 intends to clarify and is tantamount to the clearly impermissible tactic of offering an opinion based on ‘all the evidence’.”

Id. at 511 -12 (internal citations omitted).

The omission of the Pennsylvania rule from federal practice and many other states’ practices illustrates our legal system’s failure to insist upon showing the factfinder the actual evidence.  We have a long way to go, in journalism, politics, and law, to become an evidence-based society.