{"id":42207,"date":"2018-02-13T05:00:28","date_gmt":"2018-02-13T10:00:28","guid":{"rendered":"http:\/\/quotulatiousness.ca\/blog\/?p=42207"},"modified":"2018-02-12T12:01:15","modified_gmt":"2018-02-12T17:01:15","slug":"forensic-junk-science","status":"publish","type":"post","link":"https:\/\/quotulatiousness.ca\/blog\/2018\/02\/13\/forensic-junk-science\/","title":{"rendered":"Forensic (junk) science"},"content":{"rendered":"

In The Nation<\/em>, Meehan Crist and Tim Requarth<\/a> report on a solved-by-forensic-science case that opens a lot of valid questions about the “science” part of forensic science:<\/p>\n

Today, Genrich is 55 years old and has been in prison for nearly 25 years for crimes he says he didn\u2019t commit. His latest appeal has been taken up by the Innocence Project, in the hopes of not only freeing Genrich, but getting the courts to recognize recent scientific challenges to forensic pattern-matching techniques that affect hundreds of thousands of people at all levels of the criminal-justice system. In our investigation, we comprehensively reviewed the literature on handheld toolmarks published in forensic trade journals, dug through past legal rulings, pored over nearly 7,000 pages of trial transcripts, and conducted dozens of interviews with prosecutors, defense attorneys, forensic practitioners, judges, academics, and scientists, from Grand Junction to the Department of Justice. What we found was a startling lack of scientific support for forensic pattern-matching techniques such as toolmark analysis; a legal system that has failed to separate nonsense from science even in capital cases; and a consensus among prosecutors all the way up to the attorney general\u2019s office that scientifically dubious forensic techniques should be not only protected, but expanded. With Donald Trump in the White House and Jeff Sessions at the helm of the DOJ, the nominal momentum for forensic-science reform spurred by the two major reports is slowing. Genrich\u2019s case reveals a system that makes it nearly impossible to throw unproven forensic science out of courts and may be keeping thousands of innocent people behind bars.<\/p>\n

[…]<\/p>\n

Firearm and toolmark analysis emerged out of a national push in the early 20th century to professionalize police investigative techniques at a moment when Americans were particularly enamored with science. Law enforcement borrowed terms from science, establishing crime \u201claboratories\u201d staffed by forensic \u201cscientists\u201d who announced \u201ctheories\u201d cloaked in their own specialized jargon. But forensic \u201cscience\u201d focused on inventing clever ways to solve cases and win convictions; it was never about forming theories and testing them according to basic scientific standards. By adopting the trappings of science, the forensic disciplines co-opted its authority while abandoning its methods.<\/p>\n

Amid the swirl of new forensic techniques, the courts realized there had to be a gatekeeping mechanism to filter out quackery. In 1923, the DC Court of Appeals provided that mechanism in Frye v. United States<\/em>. The judges rejected a doctor\u2019s dubious claim that he could use a polygraph to detect when a person was lying from a rise in their blood pressure. In the ruling, the court said that in order for scientific evidence or expert testimony to be admitted, it must be offered by an experienced practitioner making inferences from a \u201cwell-recognized scientific principle\u201d that has \u201cgeneral acceptance in the particular field in which it belongs.\u201d In Frye<\/em>, the judges deemed the scientists in the \u201cparticular field\u201d relevant to polygraph use to include psychologists and physiologists\u2014not just polygraph practitioners who would, presumably, be biased toward preserving the technique\u2019s reputation. The effectiveness of Frye<\/em> in keeping dubious science out of the courts depends on whom judges include in their definition of the \u201crelevant scientific community.\u201d But as the decades wore on, and the forensic disciplines gained influence, judges tended to restrict their definition of the \u201crelevant scientific community\u201d to the forensic examiners themselves. Judges began taking advice on what counted as good forensics from the very people who invented the techniques and made a living off of them.<\/p>\n

In the American criminal-justice system, where prosecutors regularly battle defense attorneys over what constitutes valid evidence, judges\u2019 rulings on admissibility are the final word. Once a technique has made it into court and survived appeals, subsequent judges, most of whom have no scientific training and little ability to assess the scientific validity of a technique, will continue to allow it by citing precedent. Forensic examiners, in turn, cite precedent in order to claim that their techniques are reliable science. Prosecutors point to guilty verdicts as evidence that the science brought to court was sound. In this circular way, legal rulings \u2014 which never really vetted the science to begin with \u2014 substitute for scientific proof. This is Frye<\/em>\u2019s fatal flaw: Nowhere in this process is anyone required to provide empirical evidence that the techniques work as advertised. Frye<\/em> aimed to keep pseudoscience out of the courts, but instead has helped create the perfect conditions to keep it in.<\/p>\n

[…]<\/p>\n

No human endeavor is perfect, yet many forensic examiners claim \u201czero\u201d or near-zero error rates. In a widely cited 1984 paper in the Journal of Forensic Sciences<\/em>, bite-mark examiners claimed a coincidental match would occur less than one in 10 quadrillion times. But when actually tested, even the most experienced examiners were wrong about one in six times, and in one study they struggled to distinguish a child\u2019s bite mark from an adult\u2019s. In 2009, the chief of the FBI Firearms-Toolmarks Unit wrote that a qualified examiner will \u201crarely if ever commit a false positive error (misidentification).\u201d In practice, error rates for matching bullets to firearms can be dramatically higher: In 2008, the Detroit Police Department\u2019s crime lab was shuttered when auditors found that its examiners made one error in every 10 cases. The head of the FBI\u2019s fingerprint laboratory testified that its error rate was one in 11 million\u2014because he knew of only one error in the FBI\u2019s 11 million comparisons\u2014but subsequent tests of fingerprint examiners show error rates ranging from one in 680 to one in 24.<\/p><\/blockquote>\n","protected":false},"excerpt":{"rendered":"

In The Nation, Meehan Crist and Tim Requarth report on a solved-by-forensic-science case that opens a lot of valid questions about the “science” part of forensic science: Today, Genrich is 55 years old and has been in prison for nearly 25 years for crimes he says he didn\u2019t commit. His latest appeal has been taken […]<\/p>\n","protected":false},"author":1,"featured_media":35193,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[9,16,13],"tags":[343,39,267,98],"class_list":["post-42207","post","type-post","status-publish","format-standard","hentry","category-law","category-science","category-usa","tag-crimeandpunishment","tag-junkscience","tag-justice","tag-police"],"jetpack_featured_media_url":"https:\/\/quotulatiousness.ca\/blog\/wp-content\/uploads\/2016\/06\/favicon.png","jetpack_shortlink":"https:\/\/wp.me\/p2hpV6-aYL","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/quotulatiousness.ca\/blog\/wp-json\/wp\/v2\/posts\/42207","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/quotulatiousness.ca\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/quotulatiousness.ca\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/quotulatiousness.ca\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/quotulatiousness.ca\/blog\/wp-json\/wp\/v2\/comments?post=42207"}],"version-history":[{"count":1,"href":"https:\/\/quotulatiousness.ca\/blog\/wp-json\/wp\/v2\/posts\/42207\/revisions"}],"predecessor-version":[{"id":42208,"href":"https:\/\/quotulatiousness.ca\/blog\/wp-json\/wp\/v2\/posts\/42207\/revisions\/42208"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/quotulatiousness.ca\/blog\/wp-json\/wp\/v2\/media\/35193"}],"wp:attachment":[{"href":"https:\/\/quotulatiousness.ca\/blog\/wp-json\/wp\/v2\/media?parent=42207"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/quotulatiousness.ca\/blog\/wp-json\/wp\/v2\/categories?post=42207"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/quotulatiousness.ca\/blog\/wp-json\/wp\/v2\/tags?post=42207"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}