{"id":2098,"date":"2009-12-10T12:22:58","date_gmt":"2009-12-10T16:22:58","guid":{"rendered":"http:\/\/quotulatiousness.ca\/blog\/?p=2098"},"modified":"2009-12-10T14:36:35","modified_gmt":"2009-12-10T18:36:35","slug":"qotd-peer-review","status":"publish","type":"post","link":"https:\/\/quotulatiousness.ca\/blog\/2009\/12\/10\/qotd-peer-review\/","title":{"rendered":"QotD: Peer review"},"content":{"rendered":"<blockquote>\n<p>Too often these days when people want to use a scientific study to bolster a political position, they utter the phrase, \u201cIt was peer reviewed\u201d like a magical spell to shut off any criticism of a paper\u2019s findings.<\/p>\n<p>Worse, the concept of \u201cpeer review\u201d is increasingly being treated in the popular discourse as synonymous with \u201cthe findings were reproduced and proven beyond a shadow of a doubt.\u201d<\/p>\n<p>This is never what peer review was intended to accomplish. Peer review functions largely to catch trivial mistakes and to filter out the loons. It does not confirm or refute a paper\u2019s findings. Indeed, many scientific frauds have passed easily through peer review because the scammers knew what information the reviewers needed to see.<\/p>\n<p>Peer review is the process by which scientists, knowledgeable in the field a paper is published in, look over the paper and some of the supporting data and information to make sure that no obvious errors have been made by the experimenters. The most common cause of peer review failure arises when the peer reviewer believes that the experimenters either did not properly configure their instrumentation, follow the proper procedures or sufficiently document that they did so.<\/p>\n<p>Effective peer review requires that the reviewers have a deep familiarity with the instruments, protocols and procedures used by the experimenters. A chemist familiar with the use of a gas-chromatograph can tell from a description whether the instrument was properly calibrated, configured and used in a particular circumstance. On the other hand, a particle physicist who never uses gas-chromatographs could not verify it was used properly. <\/p>\n<p>Shannon Love, <a href=\"http:\/\/chicagoboyz.net\/archives\/10436.html\" target=\"_blank\">&#8220;No One Peer-Reviews Scientific Software&#8221;, <em>Chicago Boyz<\/em><\/a>, 2009-11-28<\/p>\n<\/blockquote>\n","protected":false},"excerpt":{"rendered":"<p>Too often these days when people want to use a scientific study to bolster a political position, they utter the phrase, \u201cIt was peer reviewed\u201d like a magical spell to shut off any criticism of a paper\u2019s findings. Worse, the concept of \u201cpeer review\u201d is increasingly being treated in the popular discourse as synonymous with [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[41,16],"tags":[86,39,434],"class_list":["post-2098","post","type-post","status-publish","format-standard","hentry","category-quotations","category-science","tag-criticism","tag-junkscience","tag-peerreview"],"jetpack_featured_media_url":"","jetpack_shortlink":"https:\/\/wp.me\/p2hpV6-xQ","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/quotulatiousness.ca\/blog\/wp-json\/wp\/v2\/posts\/2098","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/quotulatiousness.ca\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/quotulatiousness.ca\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/quotulatiousness.ca\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/quotulatiousness.ca\/blog\/wp-json\/wp\/v2\/comments?post=2098"}],"version-history":[{"count":2,"href":"https:\/\/quotulatiousness.ca\/blog\/wp-json\/wp\/v2\/posts\/2098\/revisions"}],"predecessor-version":[{"id":2104,"href":"https:\/\/quotulatiousness.ca\/blog\/wp-json\/wp\/v2\/posts\/2098\/revisions\/2104"}],"wp:attachment":[{"href":"https:\/\/quotulatiousness.ca\/blog\/wp-json\/wp\/v2\/media?parent=2098"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/quotulatiousness.ca\/blog\/wp-json\/wp\/v2\/categories?post=2098"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/quotulatiousness.ca\/blog\/wp-json\/wp\/v2\/tags?post=2098"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}