In:  Peer Review  

Should peer review reports be published

One main aspect of open peer review is that referee reports are made publicly available after the peer review process. The theory underlying this is that peer review becomes a supportive and collaborative process, viewed more as an ongoing dialogue between groups of scientists to progressively asses the quality of research. Furthermore, it opens up the reviews themselves to analysis and inspection, which adds an additional layer of quality control into the review process.

This co-operative and interactive mode of peer review, whereby it is treated as a conversation rather than a selection system, has been shown to be highly beneficial to researchers and authors. A study in 2011 found that when an open review system was implemented, it led to increasing co-operation between referees and authors as well as an increase in the accuracy of reviews and overall decrease of errors throughout the review process. Ultimately, it is this process which decides whether research is suitable or ready for publication. A recent study has even shown that the transparency of the peer review process can be used to predict the quality of published research. As far as we are aware, there are almost no drawbacks, documented or otherwise, to making referee reports openly available. What we gain by publishing reviews is the time, effort, knowledge exchange, and context of an enormous amount of currently secretive and largely wasted dialogue, which could also save around 15 million hours per year of otherwise lost work by researchers.



Journals like PeerJ have a system where both the reviews and the names of the referees can be optionally made open, and Nature Communications have also recently began to trial this method of open review. In 2000, when BioMedCentral launched, it soon recognised the value in including both the reviewer names and the peer review history (pre-publication) alongside published manuscripts in the medical journals of the BMC series. Since then, a range of journals have adopted a variety of open review models. For example, the Frontiers series now publishes all referee names alongside articles, and EMBO journals publish a review process file with articles, with referees remaining anonymous but Editors being named.

At ScienceOpen our goal is to champion transparency in the peer review process through a system of public post-publication peer review. Every article we publish is open to two layers of evaluation: (1) through a formal peer review process that requires a minimum of 5 publications attached to a user’s ORCID account to maintain a level of expert review, with referee reports published alongside the manuscript; and (2) a public commenting and recommendation service open to every member to invite early career researchers and other members to contribute to the evaluation of scientific research. This dual approach ensures that peer review is a fair, public and civil process, but maintains the reliability and integrity of professional peer review from within the research community.

This is the fourth post in a series on peer review, with other articles on getting credit for review, anonymous or signed reviews, and an overall background to the evolution of peer review.

6 thoughts on “Should peer review reports be published”

  1. I am a reviewer of articles for Indian journal of medical Research in india and though the peer review comments are sent to authors they are not made public.I have seen BMJ doing it and I feel it is a good academic learning for all researchers. I personally would favour a open policy in this regard.

  2. I think that Publons is playing a useful role in giving a forum for researchers to publish their peer reviews. Since joining Publons I have been opening up my old peer review record as far as allowed by journal policies. Their merit score rewards openness and is a useful encouragement towards open reviewing.

  3. If “open peer review” is taken to mean not only publishing the reviews but also the names of the reviewers, then I think the usual objection is that reviewers will be less candid about the merits of the work if their identity is revealed. Say you’re a junior researcher looking to build your career and you are asked to review a work by a senior researcher with who you disagree. Will you really be willing to publicly criticize the work, risking your own career advancement when, say, the senior researcher is reviewing your grant applications? Furthermore, if “open peer review” means inviting everyone to review a posted manuscript, the danger is that the most popular, highly regarded researchers will get all the attention, whereas a new scholar won’t get any senior reviewers bothering to spend time on his or her work.

Leave a Reply

Your email address will not be published. Required fields are marked *