Monday, January 22, 2018

A Student's Reaction to the Reproducibility Crisis

A common fear among academic scientists today is that many of the latest and greatest findings, which cost years of work and millions of mostly tax-payer dollars, are not actually true. Even as a new graduate student, I have already come across the challenge of reproducing other's work in my own research. The author of a recent Scientific American article claims that the lack of reproducibility in science is why science actually works, why progress can be made, and how science evolves. The author takes the position that if scientists worked until their research was valid (measured by the gold standard of reproducibility), then nothing would ever be published. His conclusion is that scientists should be honest with themselves, their peers, and the public about the impossibility of perfectly reproducible science, and the likelihood that untrue findings will be published with great frequency. I feel that the author of this article confuses validity of data with data that doesn't support the original hypothesis. It's true that a scientist must never allow himself to become so committed to his model that he forces his data to match it (either through outright fraud or innocent tinkering), however, a scientist should always seek to obtain and publish data, that to the best of his ability represents the truth, whether that matches the original hypothesis or not. Perhaps I am still early enough in my scientific career that my naive hopefullness has not yet been replaced by this author's cynicism, but I feel that this author's position sets the bar for scientists too low. As scientists, we must do the best we can with our current knowledge and technological capabilities, acknowledge the limitations of what we are capable of, and accept that the findings we discover may later be disproven by other scientists who are just trying to do the same thing. 


No comments:

Post a Comment