Implementation of many of the Enhancements to Peer Review began with the May 2009 review meetings, and applicants are receiving summary statements with new features, such as scores determined under the new system. To understand your summary statement, read on…
Scores
The final overall impact/priority score appears on the first page of the summary statement, and is in a new 2-digit format. (See our June issue for tips on interpreting your score.) The final score for each application represents the overall impact of the application. It is calculated as the average (to one decimal point) of the overall impact/ priority scores (1-9 in whole numbers only) given by all eligible review panel members, multiplied by ten (so the new scores range from 10-90 in whole numbers).
In addition, the scoring of individual criteria was instated to help improve the quality and transparency of review, as well as help identify strengths and weaknesses for individual components. The summary statement shows the criterion scores given by assigned reviewers, in the critique section. Please remember that no direct correlation exists between criterion score(s) and the overall impact/priority score from each reviewer. That is, no formula is used to derive the overall impact/priority score from the individual criterion scores, and reviewers are instructed to weigh the different criteria as they see fit in deriving their overall scores.
Resumé and Summary of Discussion
As in the past, the Resumé and Summary of Discussion section is prepared by the NIH Scientific Review Officer (SRO) and summarizes the discussion of the application during the review meeting. Applications do not receive a Resumé and Summary of Discussion if they were not discussed.
Critiques
The critique format is new with this review cycle. To help improve the quality and transparency of review, NIH has developed formatted critique templates for reviewers to use to record their comments in the form of bullets, making succinct, focused points. Reviewers have been asked to focus on major strengths and weaknesses, i.e., ones that contributed directly to the overall rating of the application. In the critique section of the summary statement, you will see the individual criterion scores and comments from each reviewer. Comments should help the applicant identify strengths and weaknesses of the overall application, as well as for each criterion.
Further Questions
For more information about the guidance given to reviewers, download the Reviewer Orientation or visit the Enhancing Peer Review site.
If you have questions related to the review of your particular application, contact information for the SRO is provided at the end of your summary statement.
If you have questions related to your application and how it fits into the funding priorities of the Institute or Center, information for the Program Contact is provided at the top of the first page of the summary statement.
0 Comments