Conference Program Home
  My Program

All Times EDT

Abstract Details

Activity Number: 192 - Using Ranking Data for Decision-Making
Type: Topic Contributed
Date/Time: Monday, August 8, 2022 : 2:00 PM to 3:50 PM
Sponsor: Social Statistics Section
Abstract #320812
Title: The Usefulness of Both Ranking and Scoring in the Grant Review of Research Applications
Author(s): Stephen Gallo*
Companies: American Institute of Biological Sciences
Keywords: grant peer review; research funding; score; rank
Abstract:

The currently low funding success rates at many granting agencies has put both peer reviewers and research funders in a conundrum, where they are forced to differentiate proposals of similar quality. Reviewers often assess proposal quality through the use of pre-defined criteria, resulting in a numeric, subjective rating of its merit. Given reported issues of poor reliability and difficulty in the interpretation of scores, asking reviewers to comparatively rank proposals that they would like to see funded could help to more objectively discriminate between similarly-scoring proposals, and aid the funding decision process. We will speak about our first-hand experiences with ranking in grant peer review.


Authors who are presenting talks have a * after their name.

Back to the full JSM 2022 program