Peer Review at the NIH Center for Scientific Review

Slides:



Advertisements
Similar presentations
Road to Independence Bill Fay, MD University of Missouri FINANCIAL DISCLOSURE: No relevant financial relationships exist.
Advertisements

How a Study Section works
NIH Mentored Career Development Awards (K Series) Part 5 Thomas Mitchell, MPH Department of Epidemiology & Biostatistics University of California San Francisco.
The NIH Peer Review Process
How Your Application Is Reviewed Robert Elliott, Ph.D. Scientific Review Officer (SRO)
NIH Academic Research Enhancement Award (AREA) R15 AASCU November 5, 2009 Mary Ann Guadagno, PhD Office of Extramural Research National Institutes of Health.
Laurie Tompkins, PhD Acting Director, Division of Genetics and Developmental Biology NIGMS, NIH Swarthmore College May 14, 2012 NIH 101.
The NIH Peer Review Process Sally A. Amero, Ph.D. NIH Review Policy Officer Office of Extramural Research 2010 NIH Regional Seminars.
California State University, Fresno – Office of Research and Sponsored Programs Basics of NIH – National Institutes of Health Nancy Myers Sims, Grants.
Center for Scientific Review National Institutes of Health Department of Health and Human Services Toni Scarpa NIH Peer Review: Continuity and Change NIDA.
How Your Application Is Reviewed Vonda Smith, Ph.D. Scientific Review Officer (SRO)
Fundamentals of NLM Grants National Library of Medicine Extramural Programs Updated 2015.
November 13, 2009 NIH PROPOSAL SUBMISSIONS: 2010 REVISONS.
Weathering the Storm: How to Establish and Sustain an Independent Research Career in an Era of Limited Funds Lawrence J. Prograis, Jr., M.D Senior Scientist,
NIH Regional Seminars 2014 Sally A. Amero, Ph.D.Dana Plude, Ph.D. NIH Review Policy OfficerBiobehavioral and Behavioral Processes IRG National Institutes.
The Life Cycle of an NIH Grant Application Alicia Dombroski, Ph.D. Deputy Director Division of Extramural Activities NIDCR.
U.S. Department of Health and Human Services National Institutes of Health National Heart, Lung, and Blood Institute James P. Kiley, Ph.D. National Heart,
How to Improve your Grant Proposal Assessment, revisions, etc. Thomas S. Buchanan.
Research Bioethics Consultation: More potential than sequencing genomes Benjamin S. Wilfond MD Seattle Children’s Hospital Treuman Katz Center for Pediatric.
NIH OBSSR Summer Institute July 2012 National Institutes of Health U.S. Department of Health and Human Services Overview of the NIH Peer Review Process.
The NIH Peer Review Process Sally A. Amero, Ph.D. NIH Review Policy Officer Office of Extramural Research 2010 NIH Regional Seminars.
NIH Regional Seminars 2015 Sally A. Amero, Ph.D.Dana Plude, Ph.D. NIH Review Policy OfficerBiobehavioral and Behavioral Processes IRG National Institutes.
THE NIH REVIEW PROCESS David Armstrong, Ph.D.
The NIH Peer Review Process
Peer Review of NIH Research Grant Applications Center for Scientific Review National Institutes of Health.
Office of the Director National Institute on Alcohol Abuse and Alcoholism National Institute on Alcohol Abuse and Alcoholism National Institute of Arthritis.
NIH Review Procedures Betsy Myers Hospital for Special Surgery.
The Review of Your NIH Grant Application Begins Here Richard Nakamura, Ph.D. Director NIH Center for Scientific Review.
CSR Peer Review of NIH HIV/AIDS Grant Applications NIH Grantsmanship Workshop Diana Finzi, Ph.D. Chief, Pathogenesis and Basic Research Program Division.
GRANTS 101: Everything you want to know about the NIH grants process but are afraid to ask David Armstrong, Ph.D. Chief, Scientific Review Branch, NIMH.
Academic Research Enhancement Award (AREA) Program Erica Brown, PhD Director, NIH AREA Program National Institutes of Health 1.
The NIH Grant Review Process Hiram Gilbert, Ph.D. Dept. of Biochemistry, Baylor College of Medicine Xander Wehrens, M.D. Ph.D. Dept. of Molecular Physiology.
PROMOTION AND TENURE FOR CLINICAL SCIENTISTS – BOTH PATHWAYS Peter Emanuel, M.D. Laura Lamps, M.D.
National Institutes of Health. Much of the biomedical research in the United States is supported by the Federal Government, primarily the National Institutes.
Funding your Dreams Cathy Manduca Director, Science Education Resource Center Iowa State University, 2005.
NIH Mentored Career Development Awards (K Series) Part 5 Thomas Mitchell, MPH Department of Epidemiology & Biostatistics University of California San Francisco.
AHRQ 2011 Annual Conference: Insights from the AHRQ Peer Review Process Training Grant Review Perspective Denise G. Tate Ph.D., Professor, Chair HCRT Study.
Presubmission Proposal Reviews at the College of Nursing (CON) Nancy T. Artinian, PhD, RN, FAAN Associate Dean for Research and Professor.
NIH Peer Review Process – Grant Renewal
PATIENT-CENTERED OUTCOMES RESEARCH INSTITUTE PCORI Board of Governors Meeting Washington, DC September 24, 2012 Anne Beal, MD, MPH, Chief Operating Officer.
Archived File The file below has been archived for historical reference purposes only. The content and links are no longer maintained and may be outdated.
Components of a Successful AREA (R15) Grant Rebecca J. Sommer Bates College.
1 Preparing an NIH Institutional Training Grant Application Rod Ulane, Ph.D. NIH Research Training Officer Office of Extramural Research, NIH.
1Mobile Computing Systems © 2001 Carnegie Mellon University Writing a Successful NSF Proposal November 4, 2003 Website: nsf.gov.
How is a grant reviewed? Prepared by Professor Bob Bortolussi, Dalhousie University
An Insider’s Look at a Study Section Meeting: Perspectives from CSR Monica Basco, Ph.D. Scientific Review Officer Coordinator, Early Career Reviewer Program.
The Role of a Program Director NCI Division of Cancer Biology New Grantee Workshop October 18-19, 2010 Jerry Li, MD, PhD Division of Cancer Biology NCI/NIH.
Funding Opportunities for Investigator-initiated Grants with Foreign Components at the NIH Somdat Mahabir, PhD, MPH Program Director Epidemiology and Genetics.
NIH Regional Seminars 2015 Sally A. Amero, Ph.D.Weijia Ni, Ph.D. NIH Review Policy OfficerChief, RPHB, Center for Scientific Review National Institutes.
Grantsmanship: The Art and Science of Getting Funded Ronald Margolis, Ph.D. Senior Advisor, Molecular Endocrinology National Institute of Diabetes and.
Peer Review and Grant Mechanisms at NIH What is Changing? May 2016 Richard Nakamura, Ph.D., Director Center for Scientific Review.
Challenges and Opportunities in Peer Review A Vision for Ensuring Its Strategic National Value toni scarpa Memorial Sloan-Kettering.
Scientific and Scholarly Validity
Understanding NIH Peer Review
NATA Foundation Student Grants Process
NATA Foundation General Grants Program Process
NSF/NIH Review Processes University of Southern Mississippi
NSF/NIH Review Processes University of Southern Mississippi
Grant Writing Information Session
What Reviewers look for NIH F30-33(FELLOWSHIP) GRANTS
The NIH Peer Review Process
The NIH Peer Review Process
How to Write a Successful NIH Career Development Award (K Award)
Rick McGee, PhD and Bill Lowe, MD Faculty Affairs and NUCATS
When and How to Talk to Project Officers Part II
Successful Application
Peer Review of NIH Research Grant Applications
NATA Foundation General Grants Program Process
The NIH Peer Review Process
Presentation transcript:

Peer Review at the NIH Center for Scientific Review Dan Gerendasy, Ph.D. Scientific Review Officer November 5, 2008 National Institutes of Health U.S. Department of Health and Human Services

Fundamental Tenets for NIH 1. “The only possible source for adequate support of our medical research is the taxing power of the Federal Government . . .“ (Surgeon General Thomas Parran, 1945). Federal government and the politicians must assure complete freedom for the individual scientists in developing and conducting their research work. 3. Reviews should be conducted by outside experts essentially without compensation. Program management and review functions should be separated.

Dual Review System for Grant Applications First Level of Review Scientific Review Group (SRG) Second Level of Review NIH Institute/Center Council

Review Process for an NIH Research Grant Submits Application Center for Scientific Review Assigns to Institute & Study Section Study Section Reviews for Scientific Merit School or Research Center Principle Investigator Institute Evaluates for Relevance Advisory Councils and Boards Recommends Action Institute Director Allocates Funds Takes Final Action

Assignment to Institutes Applications are referred to an Institute or Center as the potential funding component: Assignment is based on a match between the research proposed and the overall mission of the Institute or Center. For example: National Institute of Diabetes and Digestive and Kidney Diseases (NIDDK) National Heart, Lung, and Blood Institute (NHLBI) National Institute of Biomedical Imaging and BioEngineering (NIBIB) National Human Genome Research Institute (NHGRI) Applications can be assigned to multiple Institutes or Centers.

Assignment to CSR Integrated Review Groups Applications are assigned to Integrated Review Groups (IRGs) for review. IRGs are clusters of scientifically related study sections. Assignment is based on specific referral guidelines for each IRG. Each of the 25 IRGs has 6-10 standing study sections.

Example IRGs Cystic Fibrosis Diabetes Nanotechnology Sensors Respiratory Sciences IRG Renal and Urological Sciences IRG Health of the Population IRG   Diabetes Endocrinology, Metabolism, Nutrition and Reproductive Sciences IRG Digestive Sciences IRG Nanotechnology Bioengineering Sciences and Technologies IRG Surgical Sciences, Biomedical Imaging and Bioengineering IRG Sensors Biological Chemistry and Macromolecular Biophysics IRG

Assignment to CSR Study Sections Within an IRG, applications are assigned for review to: Standing Study Sections when the subject matter of the application matches the referral guidelines for the study section Ad Hoc Special Emphasis Panels (SEPs) when the subject matter does not fit into any study section, or when assignment of an application to the most appropriate study section would create a conflict of interest. Also used for special mechanisms (e.g., fellowships, SBIRs, AREAS)

CSR Study Sections Each CSR standing study section has about 23-40 members who are primarily from academia. CSR standing study sections convene face-to-face, or virtual (electronic) meetings. As many as 60-100 applications are reviewed by each study section.

Role of the Scientific Review Officer Designated Federal official with overall responsibility for the review process Doctoral level scientist with expertise complimentary to science reviewed in their study section. Legal responsibility for study section and management of review including the selection of reviewers Provides written (summary statement) reports to Institutes and Centers for secondary review.

Role of Program Officer This designated federal official has overall responsibility for recommending meritorious applications for funding. The PO: Observes study section meeting Provides feedback to investigator about study section results Makes recommendations to Institutes/Centers and National Advisory Councils/Boards about funding decisions 11

Role of Study Section Chair Partners with Scientific Review Officers to ensure the best scores for the highest quality science Guides study section discussion Ensures all study section member opinions are given careful consideration Manages meeting logistics during the meeting, e.g., timeliness, thoroughness, scientific integrity 12

How Reviewers Are Selected Demonstrated Scientific Expertise Doctoral Degree or Equivalent Mature Judgment Work Effectively in a Group Context Breadth of Perspective Impartiality Interested in Serving Balanced Gender, Minority and Geographical representation (for chartered Study Sections)

Sources for Reviewer Recruitment Research databases (e.g., CRISP, Pub Med, PsychInfo, etc.) Professional societies Volunteer Reviewer Registry: Now includes recommendations from the Science Foundation Ireland and Department of Employment and Learning (N. Ireland). Scientific community consultation NIH Program Staff Conference attendance Study section chairs Study section members

Pre-Meeting Review Process SRO assigns appropriate reviewers to each application. Conflicts of interest identified. Applications sent 6 weeks prior to meeting. Reviewers post critiques and provisional scores on NIH Web site 3-4 days prior to meeting. Reviewers read colleagues’ critiques (excluding conflicts) prior to meeting.

Conflict of Interest (COI) Institutional Family Member/Close Friend Collaborator Longstanding Scientific Disagreement Personal Bias Appearance of Conflict

Certification of No Conflict of Interest This will certify that in the review of applications and proposals by (study section) on (date) , I did not participate in an evaluation of any application or proposal: (1) from any applicant institution or offer or where I am a full- or part-time salaried employee or where I am negotiating for such employment; (2) from any applicant institution or offer or where I have received or could receive a direct financial benefit in relation to the application or proposal under review or have received or could receive a financial benefit from the applicant institution or offer or principal investigator valued at $10,000 or more per year that is unrelated to the application or proposal under review; (3) submitted by a close personal relative, a member of my household, or professional associate, or if such person receives financial benefits from or provides financial benefits to an applicant or offer or. If there was an appearance or real conflict of interest, or (4) any application submitted by my former (within the past year) employer I recused myself from the review of the application/proposal or was granted an appropriate waiver. SIGNATURES

Certification of Confidentiality and Non-Disclosure I fully understand the confidential nature of the review process and agree: (1) to destroy or return all materials related to the evaluation; (2) not to disclose or discuss the materials associated with the review, my evaluation, or the review meeting outside of that meeting or with any other individual except as authorized by the Scientific Review Officer (SRO) or other NIH designated official; (3) not to disclose procurement information prior to the award of a contract; and (4) to refer all inquiries concerning the review to the SR0 or other designated NIH official. SIGNATURES

Review Process Lower half of applications identified, not discussed (“streamlined”) Remaining applications discussed (average of 15 minutes/application) 3 Assigned Reviewers Conflicts absent from room Assigned reviewers establish a range of priority scores, and all present vote.

Review Criteria Advice to Applicants: Significance: Does the study address an important problem? How will scientific knowledge or clinical practice be advanced? Approach: Are design and methods well-developed and appropriate? Are problem areas addressed? Innovation: Are there novel concepts or approaches? Are the aims original and innovative? Investigator: Is the investigator appropriately trained? Environment: Does the scientific environment contribute to the probability of success? Are there unique features of the scientific environment or subject populations? Advice to Applicants: Think about how the reviewers will review it

Other Review Criteria Protection of Human Subjects Enrollment of Women, Children and ethnic minorities Vertebrate Animal Care Biohazards Budget

What Reviewers Look for In Applications Significance/Impact – Will it more the field forward? Is it exciting? Is it clearly written? Does the applicant assume I know more than I do? Are the Aims & Timelines realistic or are they overly ambitious? Does it contain unnecessarily long descriptions of well known methods and approaches? Are the study’s limitations discussed? Did they bother to proofread the application?

Priority Scores/Percentile Rank For each study section, applications in the upper half generally are scored from 1.0-3.0, with 1.0 the best score. Scores as low as 5.0 are possible. Individual scores are averaged and multiplied by 100 to give the final priority score. plus past two meetings

Post Meeting Review Process Reviewers have opportunity to revise written critiques based on discussion & reading of colleagues’ critiques. SRO writes Resume & Summary of Discussion for scored applications’ summary statements. Unscored applications receive critiques only. Summary statements available within 30 days of meeting (10 days for new investigators).

Summary Statement Results are documented by SRO in a summary statement and forwarded to the PI and the assigned NIH Institute or Center, where a funding decision is made. The Summary Statement Contains Summary of Review Discussion Essentially Unedited Critiques Budget Recommendations Administrative Notes Priority Score and Percentile Ranking

What Determines Which Awards Are Made? Scientific merit Program or public health priorities Availability of funds

Review Process for an NIH Research Grant Submits Application Center for Scientific Review Assigns to Institute & Study Section Study Section Reviews for Scientific Merit School or Research Center Principle Investigator Institute Evaluates for Relevance Advisory Councils and Boards Recommends Action Institute Director Allocates Funds Takes Final Action

Inside the NIH Grant Review Process Video CSR has developed a video of a mock study section meeting to show how NIH grant applications are reviewed. http://www.csr.nih.gov/video/video.asp