A Reminder of Your Roles as Applicants and Reviewers in Maintaining the Confidentiality of Peer Review

April 7, 2017

Imagine this: you’re a reviewer on an NIH study section, and receive a greeting card from the Principal Investigator (PI) on an application you are reviewing. A note written inside the card asks that your look favorably upon the application, and in return, the PI would put in a good word with his friend serving on your promotion committee. Do you accept the offer, or just ignore it? Or, do you report it? …. Or maybe several days after the initial peer review of your application, you receive a phone call from a colleague you haven’t spoken to in quite a while. The colleague is excited about a new technique you developed and wishes to collaborate. You realize the only place you’ve disclosed this new technique is in your recently reviewed NIH grant application. What do you do? ….

Following Up On Interim Research Products

March 28, 2017

The role of preprints — complete and public draft manuscripts which have not gone through the formal peer review, editing, or journal publishing process – continues to be a hot topic in the biological and medical sciences. In January, three major biomedical research funders – HHMI, the MRC, and the Wellcome Trust, changed their policies to allow preprints to be cited in their progress reports and applications.

Thinking about preprints also raises questions about the broader class of interim research products, and the role they should play in NIH processes. Other interim products include products like preregistration of protocols or research methods, to publicly declare key elements of a research project in advance. While, under current policy, NIH does not restrict items cited in the research plan of an application, applicants cannot claim preprints in biosketches or progress reports.

So, in October, we issued a call for comments to get a fuller understanding of how the NIH-supported research community uses and thinks about interim research products. Today I’d like to follow up with what we’ve learned from your input, and the policy changes this feedback suggests. ….

Outcomes of Amended (“A1”) Applications

March 23, 2017

In a previous blog, we described the outcomes of grant applications according to the initial peer review score. Some of you have wondered about the peer review scores of amended (“A1”) applications. More specifically, some of you have asked about amended applications getting worse scores than first applications; some of you have experienced amended applications … Continue reading “Outcomes of Amended (“A1”) Applications”

Mid-career Investigators and Shifting Demographics of NIH Grant Recipients

March 6, 2017

While NIH policies focus on early stage investigators, we also recognize that it is in our interest to make sure that we continue to support outstanding scientists at all stages of their career. Many of us have heard mid-career investigators express concerns about difficulties staying funded. In a 2016 blog post we looked at data to answer the frequent question, “Is it more difficult to renew a grant than to get one in the first place?” We found that new investigators going for their first competitive renewal had lower success rates than established investigators. More recently, my colleagues in OER’s Statistical Analysis and Reporting Branch and the National Heart Lung and Blood Institute approached the concerns of mid-career investigators in a different way – by looking at the association of funding with age. Today I’d like to highlight some of the NIH-wide findings, recently published in the PLOS ONE article, “Shifting Demographics among Research Project Grant Awardees at the National Heart, Lung, and Blood Institute (NHLBI)”. Using age as a proxy for career stage, the authors analyzed funding outcomes for three groups ….

Meet NIH & HHS in New Orleans for the NIH Regional Seminar, May 3-5!

March 3, 2017

Do you remember walking into the person’s office down the hall from you when you needed to ask a question, instead of “popping” them an email, instant message, or text? There’s no disputing that the digital age definitely has its advantages – making information sharing faster, cheaper, and more convenient, and allowing us to communicate locally and abroad in seconds. But in this fast paced world of instant communication – the internet, email, and all of our social media choices – sometimes we forget how valuable face-to-face interactions can be. That is exactly one of the reasons I love the NIH Regional Seminars on Grant Funding and Program Administration. The seminars give me the opportunity to join over 60 of my fellow NIH and HHS faculty in sharing our knowledge and perspectives to ….

Resubmissions Revisited: Funded Resubmission Applications and Their Initial Peer Review Scores

February 17, 2017

“My first submission got an overall impact score of 30. Is that good enough? What’s the likelihood I’ll eventually get this funded?”, or, “My first submission was not even discussed. Now what? Does anyone with an undiscussed grant bother to resubmit? And what’s the likelihood I’ll eventually get this funded?” In a past blog we … Continue reading “Resubmissions Revisited: Funded Resubmission Applications and Their Initial Peer Review Scores”

Following up on the Research Commitment Index as a Tool to Describe Grant Support

February 15, 2017

Many thanks for your terrific questions and comments to last month’s post, Research Commitment Index: A New Tool for Describing Grant Support. I’d like to use this opportunity to address a couple of key points brought up by a number of commenters; in later blogs, we’ll focus on other suggestions.

The two points I’d like to address here are: 1) why use log-transformed values when plotting output (annual weighted relative citation ratio, or annual RCR) against input (annual research commitment index, or annual RCI), and 2) what is meant by diminishing returns. ….

FY2016 By The Numbers

February 3, 2017

Over the past few days, we released our annual web reports, success rates and NIH Data Book with updated numbers for fiscal year 2016. Overall, we see steady increases. In addition to looking back over the numbers we typically highlight in this post, we want to point out several new research project grant (RPG)-specific activity codes used to support extramural research. FY 2016 saw the launch of some new ….

Research Commitment Index: A New Tool for Describing Grant Support

January 26, 2017

On this blog we previously discussed ways to measure the value returned from research funding. Several of my colleagues and I, led by NIGMS director Jon Lorsch – chair of an NIH Working Group on Policies for Efficient and Stable Funding – conceived of a “Research Commitment Index,” or “RCI.” We focus on the grant activity code (R01, R21, P01, etc) and ask ourselves about the kind of personal commitment it entails for the investigator(s). We start with the most common type of award, the R01, and assign it an RCI value of 7 points. And then, in consultation with our NIH colleagues, we assigned RCI values to other activity codes: fewer points for R03 and R21 grants, more points P01 grants.

Status of Our Initiatives to Strengthen Clinical Trials

January 6, 2017

In September Dr. Carrie Wolinetz and I blogged about our policy reforms to build a more robust clinical trials enterprise through greater stewardship and transparency at each phase of the clinical trial journey from conception to sharing of results. We discussed how these efforts promise to improve the quality and efficiency of clinical trials, translating into more innovative and robust clinical trial design, and accelerated discoveries that will advance human health.

Over the past months we have continued to partner with the community to work through the implementation of these new policies, developing responses to frequently asked questions and even reconsidering the timing of our single IRB policy to give our grantees time to work through how to operationalize the change. ….