1 of 15 Department of Defense Congressionally Directed Medical Research Programs U.S. Army Medical Research & Materiel Command Archived File © ©The file below has been archived for historical reference purposes only. The content and links are no longer maintained and may be outdated. See the OER Public Archive Home Page for more details about archived files.archivedOER Public Archive Home Page ©

2 of 15 Department of Defense Congressionally Directed Medical Research Programs U.S. Army Medical Research & Materiel Command Congressionally Directed Medical Research Programs (CDMRP) Presented to National Institutes of Health Peer Review Advisory Committee Presented by Janet Harris, Ph.D., R.N. Colonel, US Army Nurse Corps Director 23 January 2006 US Army Medical Research and Materiel Command (USAMRMC)

3 of 15 Department of Defense Congressionally Directed Medical Research Programs U.S. Army Medical Research & Materiel Command CDMRP Philosophy ©Vision: Find and fund the best research to eradicate diseases and support the warfighter for the benefit of the American public ©Mission: We provide hope by promoting innovative research, recognizing untapped opportunities, creating partnerships, and guarding the public trust. THE CENTRAL THEME IS INNOVATION

4 of 15 Department of Defense Congressionally Directed Medical Research Programs U.S. Army Medical Research & Materiel Command CDMRP History ©1992: Grassroots advocacy heightened political awareness of breast cancer ©1993: Congress appropriated $210M to the Department of Defense (DOD) budget for breast cancer research, managed by the CDMRP, after consultation with the Institute of Medicine (IOM) in fiscal year 1993 (FY93) and re-reviewed the program in FY97. © : Additional research programs added: v 1996: Neurofibromatosis v 1997: Prostate Cancer and Ovarian Cancer v 1999: Peer Reviewed Medical Research Program v 2002: Prion, Tuberous Sclerosis, and Chronic Myelogenous Leukemia. ©These and other programs are managed by the CDMRP

5 of 15 Department of Defense Congressionally Directed Medical Research Programs U.S. Army Medical Research & Materiel Command ©Funds added to the DOD budget by Congress [generally as DHP(RDT&E)]* ©Respond to targeted guidance from Congress ©Two-tier formal review of proposals – IOM Model ©Consumer advocate participation throughout process ©Vision is adapted yearly to facilitate rapid change and address research gaps ©Highly flexible management processes CDMRP Unique Features *Defense Health Program (Research Development, Test and Evaluation)

6 of 15 Department of Defense Congressionally Directed Medical Research Programs U.S. Army Medical Research & Materiel Command CDMRP Funding History Awards ~650

7 of 15 Department of Defense Congressionally Directed Medical Research Programs U.S. Army Medical Research & Materiel Command Training and Research Resources Innovation-Based Research Clinical Research Traditional Research (e.g., R01-, P50-type awards) FY06 Investment Strategy Translational Research

8 of 15 Department of Defense Congressionally Directed Medical Research Programs U.S. Army Medical Research & Materiel Command Program Cycle Vision Setting Release of Program Announcement Proposal Receipt Peer Review Programmatic Review Candidate Award List Congressional Appropriation Receipt of Funds CG Approval Integration Panel t Science evaluation t Budget evaluation t Programmatic relevance t Budget evaluation

9 of 15 Department of Defense Congressionally Directed Medical Research Programs U.S. Army Medical Research & Materiel Command Electronic Proposal/Grant Management ©CDMRP eReceipt System v Web-based proposal submission system v Includes modules for Principal Investigators and Office of Sponsored Research Representatives v Information collected in fields, text boxes, and PDF files ©Program and Peer Review Management Information System™ (P²RMIS™) v Proprietary web-base system owned and used by Constella Health Sciences, our peer review contractor ©Electronic Grants System v Custom designed, state of the art database and business system for the paperless management of medical research proposals and grants.

10 of 15 Department of Defense Congressionally Directed Medical Research Programs U.S. Army Medical Research & Materiel Command Advantages of Electronic Processes ©Reduced Applicant Cost: Uploading PDF files is less costly than copying and shipping proposal ©Reduced Program Cost: Reduction in labor during receipt and savings in reviewer shipping exceed cost of printing proposal copies ©Increased Communication: Reviewers, Chairperson, and Scientific Research Administrator can review critiques in advance of the meeting ©Time Savings: Compliance (administrative review), referral, and summary statement writing all streamlined through use of web-based tools ©Increased Efficiency: v Allows for collaboration between organizations by implementing electronic workflows and virtual files v Allows for real-time data transfer, multiple users, standardization of processes and unprecedented secure access to data

11 of 15 Department of Defense Congressionally Directed Medical Research Programs U.S. Army Medical Research & Materiel Command Standard Peer Review Scoring CriteriaGlobalAdjectival 10, Outstanding 8, Excellent 6, Very good 4, Good 2, Fair

12 of 15 Department of Defense Congressionally Directed Medical Research Programs U.S. Army Medical Research & Materiel Command Regular (Idea Awards) Concept Era of Hope Innovator Clinical Trial Award ReferralDiscipline-Focused Mechanism- Focused DistributionPaper/CD-ROMP²RMIS™ (Web)PaperPaper/CD-ROM Collection Critique and Preliminary Scores Brief Comment and Score Nothing Critique and Preliminary Scores Pre-Meeting Panel-Wide Access to Comments None Panel-Wide Access to Comments MeetingTraditional DiscussionNone Comparative Discussion Dual Discussion: Proposal & Protocol Global ScoreNumeric: 1.0 – 5.0 Adjectival Only: Outstanding - Fair None Single Numeric Global Score Evaluation Criteria 10 – 1None Text Only: No Scoring Separate Criteria for Proposal and Protocol Summary Statements Concatenated; Sent to Applicants Sequential; Internal Use Only Text Only: No Scoring Separated Sections for Proposal and Protocol Peer Review Processes

13 of 15 Department of Defense Congressionally Directed Medical Research Programs U.S. Army Medical Research & Materiel Command Correlations Between Final Global Scores and Final Criteria Scores for Idea Awards Scores Correlated with Final Global Score Pearson’s R Correlation (Interval by Interval) Research Strategy Relevance Innovation Investigator Environment-0.639

14 of 15 Department of Defense Congressionally Directed Medical Research Programs U.S. Army Medical Research & Materiel Command Lessons Learned ©Consumers are integral to peer review ©Efficiencies of cradle to grave electronic management ©Need to maintain dynamic flexible processes ©Tailor peer review processes to: v Mechanism goals v Time constraints v Funding limitations

15 of 15 Department of Defense Congressionally Directed Medical Research Programs U.S. Army Medical Research & Materiel Command Ongoing Challenges ©Identifying Innovation ©Keeping Peer Reviewers engaged during panel discussions ©Congruency among narrative, criteria scores, and global score ©Optimizing panel size, reviewer workload, and length of panel discussion ©Meeting needs of multiple end users of critique v Programmatic Review v Applicant

16 of 15 Department of Defense Congressionally Directed Medical Research Programs U.S. Army Medical Research & Materiel Command Web Site –