{"id":61297,"date":"2020-11-04T03:00:38","date_gmt":"2020-11-04T08:00:38","guid":{"rendered":"https:\/\/quotulatiousness.ca\/blog\/?p=61297"},"modified":"2020-11-03T16:32:04","modified_gmt":"2020-11-03T21:32:04","slug":"the-replication-crisis-in-all-fields-is-worse-than-you-imagine","status":"publish","type":"post","link":"https:\/\/quotulatiousness.ca\/blog\/2020\/11\/04\/the-replication-crisis-in-all-fields-is-worse-than-you-imagine\/","title":{"rendered":"The replication crisis in all fields is worse than you imagine"},"content":{"rendered":"

It may sound like a trivial issue, but it absolutely is not: scientific studies that can’t be replicated are worthless<\/a>, yet our lives are often impacted by these failed studies, especially when politicans are guided by junk science results:<\/p>\n

More than 70% of researchers have tried and failed to reproduce another scientist’s experiments, and more than half have failed to reproduce their own experiments. Those are some of the telling figures that emerged from Nature<\/em>‘s survey of 1,576 researchers who took a brief online questionnaire on reproducibility in research.<\/p>\n

The data reveal sometimes-contradictory attitudes towards reproducibility. Although 52% of those surveyed agree that there is a significant ‘crisis’ of reproducibility, less than 31% think that failure to reproduce published results means that the result is probably wrong, and most say that they still trust the published literature.<\/p>\n

\"\"<\/a><\/p>\n

Data on how much of the scientific literature is reproducible are rare and generally bleak. The best-known analyses, from psychology and cancer biology, found rates of around 40% and 10%, respectively. Our survey respondents were more optimistic: 73% said that they think that at least half of the papers in their field can be trusted, with physicists and chemists generally showing the most confidence.<\/p>\n

The results capture a confusing snapshot of attitudes around these issues, says Arturo Casadevall, a microbiologist at the Johns Hopkins Bloomberg School of Public Health in Baltimore, Maryland. “At the current time there is no consensus on what reproducibility is or should be.” But just recognizing that is a step forward, he says. “The next step may be identifying what is the problem and to get a consensus.”<\/p>\n

Failing to reproduce results is a rite of passage, says Marcus Munafo, a biological psychologist at the University of Bristol, UK, who has a long-standing interest in scientific reproducibility. When he was a student, he says, “I tried to replicate what looked simple from the literature, and wasn’t able to. Then I had a crisis of confidence, and then I learned that my experience wasn’t uncommon.”<\/p>\n

The challenge is not to eliminate problems with reproducibility in published work. Being at the cutting edge of science means that sometimes results will not be robust, says Munafo. “We want to be discovering new things but not generating too many false leads.”<\/p><\/blockquote>\n","protected":false},"excerpt":{"rendered":"

It may sound like a trivial issue, but it absolutely is not: scientific studies that can’t be replicated are worthless, yet our lives are often impacted by these failed studies, especially when politicans are guided by junk science results: More than 70% of researchers have tried and failed to reproduce another scientist’s experiments, and more […]<\/p>\n","protected":false},"author":1,"featured_media":35193,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[28,16],"tags":[755,39,1233,513],"class_list":["post-61297","post","type-post","status-publish","format-standard","hentry","category-media","category-science","tag-incentives","tag-junkscience","tag-replicationcrisis","tag-research"],"jetpack_featured_media_url":"https:\/\/quotulatiousness.ca\/blog\/wp-content\/uploads\/2016\/06\/favicon.png","jetpack_shortlink":"https:\/\/wp.me\/p2hpV6-fWF","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/quotulatiousness.ca\/blog\/wp-json\/wp\/v2\/posts\/61297","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/quotulatiousness.ca\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/quotulatiousness.ca\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/quotulatiousness.ca\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/quotulatiousness.ca\/blog\/wp-json\/wp\/v2\/comments?post=61297"}],"version-history":[{"count":1,"href":"https:\/\/quotulatiousness.ca\/blog\/wp-json\/wp\/v2\/posts\/61297\/revisions"}],"predecessor-version":[{"id":61299,"href":"https:\/\/quotulatiousness.ca\/blog\/wp-json\/wp\/v2\/posts\/61297\/revisions\/61299"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/quotulatiousness.ca\/blog\/wp-json\/wp\/v2\/media\/35193"}],"wp:attachment":[{"href":"https:\/\/quotulatiousness.ca\/blog\/wp-json\/wp\/v2\/media?parent=61297"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/quotulatiousness.ca\/blog\/wp-json\/wp\/v2\/categories?post=61297"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/quotulatiousness.ca\/blog\/wp-json\/wp\/v2\/tags?post=61297"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}