NIH realizes that, as stewards of the American investment in biomedical sciences, we must do all we can to protect the future of the biomedical research enterprise, taking additional measures regardless of our budget situation. In the opening pages of this blog, we noted that our increasingly hypercompetitive system is threatening the future of biomedical research and of the hundreds of thousands of scientists who we look to for discovering tomorrow’s cures. This is a strange irony, given that the last 25-50 years have been times of extraordinary discovery and progress in basic, translational, and applied science. Death rates from cardiovascular disease have plummeted, and death rates from cancer are falling steadily. Scientists have a much deeper understanding of human biology to the point where this knowledge can drive the design of drugs and biologics. Big data and high-throughput technologies now enable rapid development and testing of hypotheses that previously would have taken years. The successes are myriad. But so are the problems, problems so real that some have gone so far as to write, “It is time to confront the dangers at hand and rethink some fundamental features of the US biomedical research system.” …. Continue reading
Earlier this year I wrote a post about the 21st Century Cures Act and its changes that directly affect the NIH. One part of this new legislation contains provisions to improve clinical research and privacy through certificates of confidentiality.
Currently, certificates of confidentiality (or “CoCs”) are provided upon request to researchers collecting sensitive information about research participants. Soon, CoCs will be automatically provided for NIH-supported research, as set forth in the 21st Century Cures Act. …. Continue reading
Measuring the impact of NIH grants is an important input in our stewardship of research funding. One metric we can use to look at impact, discussed previously on this blog, is the relative citation ratio (or RCR). This measure – which NIH has made freely available through the iCite tool – aims to go further than just raw numbers of published research findings or citations, by quantifying the impact and influence of a research article both within the context of its research field and benchmarked against publications resulting from NIH R01 awards.
In light of our more recent posts on applications and resubmissions, we’d like to go a step further by looking at long-term bibliometric outcomes as a function of submission number. In other words, are there any observable trends in the impact of publications resulting from an NIH grant funded as an A0, versus those funded as an A1 or A2? And does that answer change when we take into account how much funding each grant received? …. Continue reading
Imagine this: you’re a reviewer on an NIH study section, and receive a greeting card from the Principal Investigator (PI) on an application you are reviewing. A note written inside the card asks that your look favorably upon the application, and in return, the PI would put in a good word with his friend serving on your promotion committee. Do you accept the offer, or just ignore it? Or, do you report it? …. Or maybe several days after the initial peer review of your application, you receive a phone call from a colleague you haven’t spoken to in quite a while. The colleague is excited about a new technique you developed and wishes to collaborate. You realize the only place you’ve disclosed this new technique is in your recently reviewed NIH grant application. What do you do? …. Continue reading
The role of preprints — complete and public draft manuscripts which have not gone through the formal peer review, editing, or journal publishing process – continues to be a hot topic in the biological and medical sciences. In January, three major biomedical research funders – HHMI, the MRC, and the Wellcome Trust, changed their policies to allow preprints to be cited in their progress reports and applications.
Thinking about preprints also raises questions about the broader class of interim research products, and the role they should play in NIH processes. Other interim products include products like preregistration of protocols or research methods, to publicly declare key elements of a research project in advance. While, under current policy, NIH does not restrict items cited in the research plan of an application, applicants cannot claim preprints in biosketches or progress reports.
So, in October, we issued a call for comments to get a fuller understanding of how the NIH-supported research community uses and thinks about interim research products. Today I’d like to follow up with what we’ve learned from your input, and the policy changes this feedback suggests. …. Continue reading
In a previous blog, we described the outcomes of grant applications according to the initial peer review score. Some of you have wondered about the peer review scores of amended (“A1”) applications. More specifically, some of you have asked about … Continue reading
While NIH policies focus on early stage investigators, we also recognize that it is in our interest to make sure that we continue to support outstanding scientists at all stages of their career. Many of us have heard mid-career investigators express concerns about difficulties staying funded. In a 2016 blog post we looked at data to answer the frequent question, “Is it more difficult to renew a grant than to get one in the first place?” We found that new investigators going for their first competitive renewal had lower success rates than established investigators. More recently, my colleagues in OER’s Statistical Analysis and Reporting Branch and the National Heart Lung and Blood Institute approached the concerns of mid-career investigators in a different way – by looking at the association of funding with age. Today I’d like to highlight some of the NIH-wide findings, recently published in the PLOS ONE article, “Shifting Demographics among Research Project Grant Awardees at the National Heart, Lung, and Blood Institute (NHLBI)”. Using age as a proxy for career stage, the authors analyzed funding outcomes for three groups …. Continue reading
Do you remember walking into the person’s office down the hall from you when you needed to ask a question, instead of “popping” them an email, instant message, or text? There’s no disputing that the digital age definitely has its advantages – making information sharing faster, cheaper, and more convenient, and allowing us to communicate locally and abroad in seconds. But in this fast paced world of instant communication – the internet, email, and all of our social media choices – sometimes we forget how valuable face-to-face interactions can be. That is exactly one of the reasons I love the NIH Regional Seminars on Grant Funding and Program Administration. The seminars give me the opportunity to join over 60 of my fellow NIH and HHS faculty in sharing our knowledge and perspectives to …. Continue reading
“My first submission got an overall impact score of 30. Is that good enough? What’s the likelihood I’ll eventually get this funded?”, or, “My first submission was not even discussed. Now what? Does anyone with an undiscussed grant bother to … Continue reading
Many thanks for your terrific questions and comments to last month’s post, Research Commitment Index: A New Tool for Describing Grant Support. I’d like to use this opportunity to address a couple of key points brought up by a number of commenters; in later blogs, we’ll focus on other suggestions.
The two points I’d like to address here are: 1) why use log-transformed values when plotting output (annual weighted relative citation ratio, or annual RCR) against input (annual research commitment index, or annual RCI), and 2) what is meant by diminishing returns. …. Continue reading