Hello PhD
005: Perfecting Peer Review
Scientists are supposed to be objective, so why is it easier to publish your paper when you’re in a big-name lab? Why do women and minorities get harsher feedback from reviewers than white men? And more importantly, what can be done to make the process fair?
When Peer Review Attacks
In this episode, we uncover the seamy underbelly of paper publishing and take a look at some alternatives to the current system of peer review, including the recent move by Nature (http://www.nature.com/news/nature-journals-offer-double-blind-review-1.16931) to make the process “Double Blind”.
We’ll look at some of the early forms of scientific discourse and trace the evolution through time and technology, as well as identifying the unintended consequences of the current system. Is it better to make the process open like PLoS ONE? Would scientists benefit from an online collaboration tool that allowed discussion and feedback after publication?
Dan and Josh have different opinions about how to improve the process, so be sure to leave your feedback in the comments section or on our Facebook page (http://www.facebook.com/hellophdpodcast). How would you change the peer review system to improve scientific rigor, inclusiveness, and expand science’s impact on society?
Beer and Puzzles!
Moving from peer review to BEER review, we celebrate summer this week with the Fullsteam Summer Basil Farmhouse Ale (http://www.fullsteam.ag/beer/southern/) and Daniel introduces a new puzzle form of the weekly word origin. He’ll give you a phrase that contains a literal translation of the secret word, along with some hints to help you find it. Your job is to guess the right word based on its meaning!
This week’s clue is:
This book, published by the Royal Society, must have contained very small handwriting.
If you think you know the answer, email it to puzzle@hellophd.com (mailto:puzzle@hellophd.com) by Thursday, August 6, 2015. We’ll select a winner randomly from the correct answers and announce it on the next episode. Happy Wording!
Resources
Here are some links to the papers and websites we mentioned in the show:
Nature Journals Offer Double-Blind Review (http://www.nature.com/news/nature-journals-offer-double-blind-review-1.16931)
Lenny Teytelman's rebuttal to Nature's announcement (http://www.thespectroscope.com/read/natures-double-blind-review-the-opposite-of-what-we-need-by-lenny-teytelman-297)
Hilda Bastion's call for a stronger post-publication culture (http://journals.plos.org/plosmedicine/article?id=10.1371/journal.pmed.1001772)
PLOS One's publication criteria (http://journals.plos.org/plosone/s/journal-information)
A great introduction to gender and racial bias at the university level (http://www.upenn.edu/provost/images/uploads/Gender.Racial_.Bias_.pdf)
Race, Ethnicity, and NIH Research Awards (http://www.sciencemag.org/content/333/6045/1015)
Double-blind review favours increased representation of female authors. (http://www.ncbi.nlm.nih.gov/pubmed/17963996)
US and non-US submissions: an analysis of reviewer bias. (http://www.ncbi.nlm.nih.gov/pubmed/9676670)
Peer-review practices of psychological journals: The fate of published articles, submitted again (http://journals.cambridge.org/action/displayAbstract?fromPage=online&aid=6577844&fileId=S0140525X00011183)
Peer Review Monster by Gideon Burton (https://www.flickr.com/photos/wakingtiger/3157622458)