The Evaluating Merit Review webinar series involves AIBS staff, academics, research funders and government officials reporting results and perspectives on the science of the peer review process, with particular focus on review of funding applications. AIBS SPARS is committed to analyzing and sharing results of our own analyses as well as disseminating and promoting discussion about others’ results in the growing body of research concerning the peer review process. One of our goals at AIBS SPARS is to foster a community-wide discussion that enhances the integrity of the peer review process that has served science so well for so many years. Links to archived webinars in the series are listed below:

Evaluating Merit Review: Content-Based Reviewer-Manuscript Assignment and Bayesian Article Scoring

Event took place on Thursday, May 19, 2016

Science relies on experts evaluating the correctness, quality, relevance, and importance of manuscripts. Finding appropriate matches between reviewers and manuscripts is surprisingly labor intensive, leading to unintended tardiness, subjectivity, and errors. In this talk, Dr. Daniel Acuna, from Northwestern University, will describe his work on making this matching automatic using machine learning. Dr. Acuna will also describe an article scoring approach that attempts to correct for excessive harshness and other biases.


Evaluating Merit Review: Predictive Validity of Peer Review Scores

Event took place on Thursday, February 18, 2016

Speaker: Michael Lauer, Deputy Director for Extramural Research at National Institutes of Health (NIH)

Evaluating Merit Review: Conflicts and Bias in Peer Review

Event took place on Thursday, October 15, 2015

Speaker: Carole Lee, University of Washington in Seattle

Evaluating Merit Review: Group Dynamics of Face-to-Face Versus Teleconference Peer Review Meetings

Event took place on Thursday, August 27, 2015

Speaker: Stephen Gallo, Technical Operations Manager Scientific Peer Advisory & Review Services (SPARS)