Applications, Resubmissions, and the Relative Citation Ratio

April 25, 2017

Measuring the impact of NIH grants is an important input in our stewardship of research funding. One metric we can use to look at impact, discussed previously on this blog, is the relative citation ratio (or RCR). This measure – which NIH has made freely available through the iCite tool – aims to go further than just raw numbers of published research findings or citations, by quantifying the impact and influence of a research article both within the context of its research field and benchmarked against publications resulting from NIH R01 awards.

In light of our more recent posts on applications and resubmissions, we’d like to go a step further by looking at long-term bibliometric outcomes as a function of submission number. In other words, are there any observable trends in the impact of publications resulting from an NIH grant funded as an A0, versus those funded as an A1 or A2? And does that answer change when we take into account how much funding each grant received? ….

Outcomes of Amended (“A1”) Applications

March 23, 2017

In a previous blog, we described the outcomes of grant applications according to the initial peer review score. Some of you have wondered about the peer review scores of amended (“A1”) applications. More specifically, some of you have asked about amended applications getting worse scores than first applications; some of you have experienced amended applications … Continue reading “Outcomes of Amended (“A1”) Applications”

Resubmissions Revisited: Funded Resubmission Applications and Their Initial Peer Review Scores

February 17, 2017

“My first submission got an overall impact score of 30. Is that good enough? What’s the likelihood I’ll eventually get this funded?”, or, “My first submission was not even discussed. Now what? Does anyone with an undiscussed grant bother to resubmit? And what’s the likelihood I’ll eventually get this funded?” In a past blog we … Continue reading “Resubmissions Revisited: Funded Resubmission Applications and Their Initial Peer Review Scores”

How Many Researchers Were Supported by NIH as Trainees?

November 28, 2016

Earlier this year we reported on the unique numbers of research project grant (RPG) awardees and applicants each year since the end of the NIH doubling, in 2003. We described how the number of unique RPG awardees has remained relatively constant, while the number of applicants (as assessed over 5-year windows) has steadily and markedly increased.
A number of readers asked us about the prior NIH-supported research training and career development of these investigators. Among RPG awardees, what proportion had received prior fellowship, training, or career development (F, T, or K) awards? And perhaps of greater interest, among unsuccessful, unfunded applicants, what proportion had received prior fellowship, training or career awards?
To answer these questions, we start with a quick recap. ….

R01 and R21 Applications & Awards: Trends and Relationships Across NIH

November 4, 2016

As described on our grants page, the R21 activity code “is intended to encourage exploratory/developmental research by providing support for the early and conceptual stages of project development.” NIH seeks applications for “exploratory, novel studies that break new ground,” for “high-risk, high-reward studies,” and for projects that are distinct from those that would be funded by the traditional R01. R21 grants are short duration (project period for up to 2 years) and lower in budget than most R01s (combined budget over two years cannot exceed $275,000 in direct costs). NIH institutes and centers (ICs) approach the R21 mechanism in variable ways: 18 ICs accept investigator-initiated R21 applications in response to the parent R21 funding opportunity, while 7 ICs only accept R21 applications in response to specific funding opportunity announcements. As mentioned in a 2015 Rock Talk blog, we at NIH are interested in trends in R01s in comparison to other research project grants, so today I’d like to continue and expand on looking at R01 and R21 trends across NIH’s extramural research program. ….

Are You On the Fence About Whether to Resubmit?

October 28, 2016

When applicants receive their summary statement resulting from the review of an application that was assigned a score outside of the ICs funding range, there are important decisions to be made that, ideally, should be based upon evidence. What is the likelihood that an application like this one will be funded? If I resubmit the application, what changes might improve the chances for a successful resubmission?

Recall that in 2014, NIH relaxed its resubmission policy (OD-14-074) to allow applicants to submit a new (A0) application following an unsuccessful resubmission application. Also, we recently posted a piece showing that review outcomes for new applications submitted following an unsuccessful resubmission had about the same funding success as other new applications. But some applicants may wonder, what is the funding success for a resubmission application? ….

How Are You Doing with Those Grant Submission New Year’s Resolutions?

June 30, 2016

Back in January we talked about whether there is an advantage to working up to the last minute and submitting your grant application on the deadline. From the perspective of review outcomes, there was no advantage. In fact, applications submitted at the last minute seemed somewhat less likely to be discussed. Need another reason to apply early (by early we mean days, not hours, before a deadline)? We still see applications that fail ….

Are Attempts at Renewal Successful?

February 16, 2016

On my first day on the job as NIH Deputy Director for Extramural Research, one of my colleagues asked me a question: Is it true that it is more difficult to renew a grant than it is to get one in the first place? Some people wonder whether NIH’s interest in supporting new investigators who are trying to get their first grant negatively impacts the other investigators’ attempts to renew their grants.
To address this question we gathered data on R01-equivalent success rates for new and experienced investigators seeking funding in fiscal years (FY) 2013 through 2015. ….

Authentication of Key Biological and/or Chemical Resources in NIH Grant Applications

January 29, 2016

The fourth and final segment in our series on rigor and transparency in research grant and career development award applications focuses on authentication of key biological and/or chemical resources. Research performed with unreliable or misidentified resources can negate years of hard work and eliminate any chance for a study to be reproduced or expanded upon. For this reason, it is imperative that researchers regularly authenticate key resources used in their research. ….