February 10, 2023
The Advisory Committee to the NIH Director recommended ways for NIH to improve the rigor, reproducibility, and translatability of the research we support involving animal models. I updated the ACD this past June on our implementation of their recommendations. Here, in lieu of going through each of the report’s five themes, I will highlight some approaches raised during the meeting in response to their recommendations.
March 14, 2022
We have been busy over the past several months and are happy to announce you can now find helpful resources for stepped wedge group-or cluster-randomized trials (SWGRTs) and more than 15 other study designs and methodological issues on the RMR website.
January 29, 2016
The fourth and final segment in our series on rigor and transparency in research grant and career development award applications focuses on authentication of key biological and/or chemical resources. Research performed with unreliable or misidentified resources can negate years of hard work and eliminate any chance for a study to be reproduced or expanded upon. For this reason, it is imperative that researchers regularly authenticate key resources used in their research. ….
January 29, 2016
In part three of our series on rigor and transparency in research grant and career development award applications, we focus on consideration of relevant biological variables. Updated instructions for the Approach section of the Research Strategy ask the applicant to: ….
January 28, 2016
In part two of our series on rigor and transparency in research grant and career development award applications, we focus on scientific rigor, the strict application of the scientific method to ensure robust and unbiased experimental design, methodology, analysis, interpretation, and reporting of results. …..
January 28, 2016
The NIH recently implemented updates to research grant and career development award applications aimed at enhancing reproducibility through rigor and transparency with a focus on four areas: scientific premise, rigorous experimental design, consideration of relevant biological variables, and authentication of key biological and/or chemical resources. This post is the first in a series addressing each of these four areas, starting with scientific premise. ….
January 11, 2016
As NIH moves ahead with implementing measures to enhance rigor, transparency and reproducibility in NIH-supported research, I’d like to give a brief update on these efforts, and highlight some important timeline changes for implementation in applications for institutional training grants (T), institutional career development awards (K12), and individual fellowships (F). ….
December 11, 2015
In 2014, NIH announced plans for policy changes to ensure that NIH-supported investigators consider relevant measures, including sex as a biological variable (SABV), in preclinical research. NIH solicited feedback through a request for information, and we invited the research community to participate in workshops and resource development. These activities led to new guidelines for addressing SABV as an aspect of rigor and reproducibility in NIH research project grant applications and mentored career development award applications due January 25, 2016, and beyond. As you prepare applications and think about addressing the new instructions we wanted to offer some reminders about the policy’s origin, and about the application and review information. In particular, we wanted to point out what including SABV does not mean. ….
October 30, 2015
Scientists have long considered the research process to be self-correcting; we trust that, even if scientists may sometimes make errors in the lab, those errors will eventually be discovered and corrected as others try to substantiate and extend original research findings. However, as stated in a commentary by NIH Director Francis Collins and NIH Deputy Director Larry Tabak, “A growing chorus of concern, from scientists and laypeople, contends that the complex system for ensuring the reproducibility of biomedical research is failing and is in need of restructuring.”
There are examples that indicate that our processes have room for improvement. For example, a 2008 study ….
June 9, 2015
Nothing could be more important to our enterprise than research rigor, assuring that the results of our work are reproducible. Our conversation with you on this topic began early last year with a commentary in Nature by Francis Collins and today’s guest blogger, Larry Tabak, on the importance of reproducibility and how NIH plans to enhance it. As described in a follow-up Rock Talk post, the topic of reproducibility is not new. Evidence has shown that too many biomedical-research publications are irreproducible. Thus this topic demanded our community’s immediate attention and we have had continued dialog with and participation by you over the course of the last 18 months to describe the issue, request information, launch pilots, and craft a way forward to enhance reproducibility.
2 Comments