Ed Yong on the opening of a new lab in Virginia:
The field of psychology is going through a period of introspective turmoil. One the one hand, it has never been more popular. Its results lead to attention-grabbing headlines, and fill books that sit happily on bestseller lists. Conversely, some of its own practitioners are starting to ask themselves a difficult question: What proportion of the field’s findings are genuine and reliable insights into the human mind, and what proportion are red herrings produced by questionable research practices and, in rare cases, outright fraud?
This line of questioning comes from: cases of classic results that cannot be easily reproduced; studies that have documented widespread dodgy practices that lead to false results; the publication of papers that claim the impossible, like evidence for precognition; and the outing of several fraudulent scientists (with a new case emerging literally as I write this paragraph). To some, these signs augur a looming crisis of confidence for psychology. To others, these problems are unrepresentative, and being used to damn a field that generally produces solid, reliable results.
The debates can get quite energetic, but one of the more calm-headed voices in them is Brian Nosek’s. A psychologist from the University of Virginia, Nosek has been quietly trying to turn the problems into solutions. “There hasn’t been anything new in all this recent hubbub,” he says. “We’ve been talking about these problems since the 60s, but where it stopped was people complaining. There have been a lot of people who have been frustrated at how science is operating but had no outlet for making it better.”
Nosek’s solution launches today — the Center for Open Science, a new laboratory at Charlottesville, Virginia. Unlike many new research centres, this one is less about doing great science than about making science greater. It will try to foster a new approach to research that will produce more reliable results.
Show your working
The Center’s values are epitomised in its signature project — the Open Science Framework. It’s a website that lets scientists store and share every aspect of their work, including facets that are often hidden from each other, let alone from the public. Failed experiments, the minutiae of methods, the genesis of ideas… these are often omitted from published papers or left to languish in personal file drawers. That creates strong biases in the literature, and makes it harder for people to check and reproduce each other’s work.
H/T to Tim Harford for the link.
