Portfolio Analysis in OPASI at NIH

Slides:

Advertisements

Similar presentations

Archived File The file below has been archived for historical reference purposes only. The content and links are no longer maintained and may be outdated.

Advertisements

Helen naylor Knowledge Management National Institutes of Health Research Portfolio Online Reporting Tools.

Center for Scientific Review National Institutes of Health Department of Health and Human Services Toni Scarpa NIH Peer Review: Continuity and Change NIDA.

Archived File The file below has been archived for historical reference purposes only. The content and links are no longer maintained and may be outdated.

1 Knowledge Management for Disease Coding (KMDC): Background & Introduction Timothy Hays, Ph.D. Project Manager, Knowledge Management for Disease Coding.

Overview of Elsevier’s Capabilities Bibliometric Analysis Tools for Research Portfolio Analysis and Management Eric Livingston April, 2013.

1 The Use of Text Mining and Data Visualization to Assist in Managing a Scientific Grants Portfolio Elizabeth Ruben, Jerry Phelps, Kristianna Pettibone,

1 Enriching UK PubMed Central SPIDER launch meeting, Wolfson College, Oxford Paul Davey, UK PubMed Central Engagement Manager.

1 Transparency ∙ Accountability ∙ Public Trust RePORT: Research Portfolio Online Reporting Tool Megan Columbus Acting Director, Division.

American Evaluation Association EVALUATION 2011 November 3, 2011 Approaches to Biomedical Research and Development Portfolio Analysis: Examples From the.

1 RePORT: Your One-Stop Shop for NIH Data Interested in funding data for your institution? This tool will tell you funding by department, activity code,

1 NIH Public Access Policy Policy on Enhancing Public Access to Archived Publications Resulting From NIH-Funded Research (Public Access Policy)

The NIH Roadmap for Medical Research

Introduction to the NIH Grants System

Using NIH’s Research Portfolio Online Report Tool (RePORT) to Your Advantage June 2013 Megan Columbus Director, Division of Communications and Outreach.

From Your Idea to Your First R01: Perspectives of a National Institutes of Health Extramural Scientist.

SCOPUS AND SCIVAL EVALUATION AND PROMOTION OF UKRAINIAN RESEARCH RESULTS PIOTR GOŁKIEWICZ PRODUCT SALES MANAGER, CENTRAL AND EASTERN EUROPE KIEV, 31 JANUARY.

Short Overview of the NIH SBIR/STTR Program “Lab to Life”

1 Enhancing Public Access and Transparency on NIH Research through Reporting (or where ARRA we heading?) Presented at the Association of Independent Research.

Research, Condition and Disease Categorization (RCDC) Initiative: Update to the NCAB Mr. Larry Ray Deputy Director for Management, NCI.

Synapse and Catapult– New NIH OTT Technology Transfer Tools Ajoy K. Prabhu, M.S., M.B.A. Group Leader, Marketing Office of Technology Transfer National.

Centers for Disease Control and Prevention Office of Public Health Scientific Services CDC Health Information Innovation Consortium November Forum Brian.

NIH RePORT: report.nih.gov | RePORTER: projectreporter.nih.gov NIH ExPORTER Data NIH OFFICE OF EXTRAMURAL RESEARCH The Health Datapalooza.

NIH Investment in the Science of Learning Robert M. Kaplan NIH Associate Director for Behavioral and Social Sciences Sabrina Liao Geehta Senthil Office.

DIVISION OF LIBRARY SERVICES | OFFICE OF RESEARCH SERVICES | NATIONAL INSTITUTES OF HEALTH. Terrie Wheeler, MLS Anne White-Olson, MLS Brigit Sullivan,

South Africa Data Warehouse for PEPFAR Presented by: Michael Ogawa Khulisa Management Services

1 Implementation of the National Academies’ Program Recommendations: NIOSH PPT Program Maryann D’Alessandro, Ph.D. Associate Director for Science, NPPTL.

Data provided by the Division of Statistical Analysis & Reporting (DSAR)/OPAC/OER Contact: Best Practices: Leveraging Existing Data.

Overview of NIDA Funding Opportunities and Grant Funding Tips Bethany Griffin Deeds, Ph.D., M.A. Deputy Chief, Epidemiology Research Branch Division of.

ISRAEL LEDERHENDLER, PH.D NATIONAL INSTITUTES OF HEALTH EVALUATION 2009 NOVEMBER 12, 2009.

American Evaluation Association EVALUATION 2009 November 14, 2009 Building Data Systems to Support Evaluation in a Biomedical Research and Development.

Using NIH’s Research Portfolio Online Report Tool (RePORT) to Your Advantage April 2011 Megan Columbus Director, Division of Communications and Outreach.

Systems Approaches to Population Health. Activities Supported by NCI.

8 October 2009Microbial Research Commons1 Toward a biomedical research commons: A view from NLM-NIH Jerry Sheehan Assistant Director for Policy Development.

NIH Electronic Resources & Tools: June 2011 Megan Columbus Acting Director, Division of Communications and Outreach NIH Office of Extramural Research.

Building evaluation capacity: success factors and approaches in NSW Health NSW Government Evaluation Conference 2015 Andrew Milat PhD, MPH (Hons), BHMS.

Presented by Dr. S. C. Jindal Librarian Central Science Library University of Delhi Delhi Information Competency.

Mapping New Strategies: National Science Foundation J. HicksNew York Academy of Sciences4 April 2006 Examples from our daily life at NSF Vision Opportunities.

Revised 7/19/10.  This policy states that, as of April 7, 2008, all articles resulting from U.S. National Institutes of Health (NIH) funds must be submitted.

THE IMPORTANCE OF IPR ACROSS THE LIFECYCLE OF INNOVATION Bob Stembridge Principal Patent Analyst, IP & Science.

The Importance of a Strategic Plan to Eliminate Health Disparities 2008 eHealth Conference June 9, 2008 Yvonne T. Maddox, PhD Deputy Director Eunice Kennedy.

NIH Electronic Resources & Tools: Web Sites, RePORT & RePORTER…Just to Name a Few April 2010 Megan Columbus Acting Director, Division of Communications.

Using NIH’s Research Portfolio Online Report Tool (RePORT) to Your Advantage April 2012 Megan Columbus Director, Division of Communications and Outreach.

Why Write A Grant? Elaine M. Hylek, MD, MPH Professor of Medicine Associate Director, Education and Training Division BU CTSI Section of General Internal.

Overview of OPASI’s Division of Evaluation and Systemic Assessments (DESA) Deborah Guadalupe Duran, Ph.D. Chief, Systemic Assessments Branch.

Research Priorities & Trends for NIH in 2003 Claire T. Driscoll Director Technology Transfer Office National Human Genome Research Institute (NHGRI) Research.

NIH LIBRARY | OFFICE OF RESEARCH SERVICES | NATIONAL INSTITUTES OF HEALTH Support for Bibliometric/Portfolio Analysis from the NIH Library Terrie Wheeler,

Future Directions for NIH Research in the Behavioral and Social Sciences Raynard S. Kington, MD, PhD Associate Director for Behavioral and Social Sciences.

Access to Research Data: NIH Public Access and PMC International Seminar on Open Access for Developing Countries 21 September 2005 Jane Bortnick Griffith.

Archived File The file below has been archived for historical reference purposes only. The content and links are no longer maintained and may be outdated.

NIH: DATA SCIENCE & BD2K Jennie Larkin, PhD Senior Advisor, Extramural Programs and Strategic Planning Office of the Associate Director for Data Science,

R&D Evaluation at NIAID: Making the Most of Expert Opinion Kevin Wright AEA Annual Conference Nov 4, 2011.

Dinah Singer, Ph.D. Former Acting Head, Portfolio Analysis, DPCPSI Director, Division of Cancer Biology and Head, Molecular Regulation Section, Experimental.

Organizational Funding Portfolios and Beyond: Assessing the Full Research Landscape Panel Session 731 American Evaluation Association EVALUATION 2012 October.

David M. Murray, Ph.D. Associate Director for Prevention Director, Office of Disease Prevention Multilevel Intervention Research Methodology September.

National Institutes of Health U.S. Department of Health and Human Services Planning for a Team Science Evaluation ∞ NIEHS: Children’s Health Exposure Analysis.

Examining Federal Expert Networking and the Economies of Scale: Moving the “HHS Profiles” Pilot Towards “Experts.gov” James King, Jessica N. Berrellez,

Orienting Agency Leads for Fund Mapping evidence2success Strategic Financing.

From Outputs to Impacts: Emerging Approaches to Track Scientific Research Impacts American Evaluation Association Saturday October 27, 2012.

Data Mining for Expertise: Using Scopus to Create Lists of Experts for U.S. Department of Education Discretionary Grant Programs Good afternoon, my name.

NIH Fellowships Overview

Knowledge Informatics

The Influence of Domain-Specific Metric Development on Evaluation and Design: An Example from National Institutes of Health Technology Development Programs.

Research4Life Programmes: Similarities and Differences!

Jian Wang Assistant Professor Science Based Business Program LIACS, Leiden University

Visualizing and Analyzing NIAID’s Research Portfolio Dolan Ghosh, Ph.D., and Marie Parker Office of Strategic Planning, Initiative Development, and Analysis.

TDM=Text Mining “automated processing of large amounts of structured digital textual content for purposes of information retrieval, extraction, interpretation.

Leveraging America’s Seed Fund

Declining Funding Success Rates and Increasing Demand

Karen Frank Mays Fitchburg State University

Presentation transcript:

Portfolio Analysis in OPASI at NIH Timothy Hays, Ph.D. Branch Chief, Portfolio Analysis and Scientific Opportunities Office of Portfolio Analysis & Strategic Initiatives (OPASI) Office of the Director National Institutes of Health June 2008

Portfolio Analysis in OPASI Analyses of the NIH research portfolio (Intramural and Extramural) in all its dimensions Enhance the evaluation and management of the large and complex NIH scientific portfolio Facilitate trans-NIH scientific planning and priority-setting initiatives Support the ICs in their own planning processes Gap and overlap analyses of research (within and outside of NIH) Identify opportunities to invest in new areas of research Explore return on scientific investment

Evaluating the Full Research Portfolio Connecting the “dots” to evaluate a field NIH Projects Patents Field of Science Other Research Funding Groups Research Publications NIH Application Submissions

Portfolio Analysis for Evaluation Enhancing evaluation through portfolio analysis – First: What is the question we are trying to answer? Second: Choose the tool(s) and data set (s) best able to answer the question. Questions: What is the state of the science? Are there gaps in our research portfolio? How do the gaps compare to research carried out in other agencies? How much do we spend on mitochondrial research? What is the average number of scientific papers generated per $100K spent per grant?

Portfolio Analysis for Evaluation Enhancing evaluation through portfolio analysis – Exploring funded NIH projects Funding rates among ICs Analysis of scientific content of projects Understanding unfunded NIH grant submissions Are emerging theories or innovation left unfunded? Evaluation of progress and/or future directions Return on investment Identify most promising avenues for future investment

Portfolio Analysis for Evaluation Tools for Identifying and Evaluating NIH Projects - examples Research, Condition, and Disease Categorization (OD/NIH) Mining projects for scientific content Extramural, intramural, contracts e-SPA – Electronic Scientific Portfolio Assistant (NIAID/NIH) Linking projects and portfolios to research outcome indicators QVR – Query, View and Report (CIT/NIH) Spires (NIEHS/NIH) Publications listings associated with NIH funded projects and also RCDC categories

Portfolio Analysis with RCDC RCDC – understanding NIH funded research projects using the scientific content Fingerprint – scientific concepts from the thesaurus Research Project Fingerprint (weighted list of concepts) Category Definition Fingerprint (weighted list of concepts) Matching process to see what projects match the categories

Portfolio Analysis with e-SPA NIAID’s Electronic Scientific Portfolio Assistant (e-SPA) – connecting the entire NIAID portfolio

QVR/SPIRES – links publications to NIH Grants database

Projects in Cancer and Depression

Publications linked to NIH Grant: R01 MH051947

Portfolio Analysis for Evaluation Evaluation of progress and/or future directions Explore return on investment: Publications and Patents Research Resources: Advances in Tools, Analytics, Methodologies, Biologics, etc. Medical Discoveries, Devices, Treatments, CURES… Identify promising avenues for future investment Gap and overlap analysis Using visualization tools Looking at the wider portfolio – beyond NIH

Comprehensive Portfolio Analysis Looking for Gaps and Overlaps in the Wider Portfolio The Literature PubMed Web of Science Biological abstracts – a source of more current of information than publications Portfolios of other Funding Agencies Federal agencies Private non-profits sponsors

Analyzing Portfolio Data Tools for Mining Scientific Content PubMed tools Other text mining tools IN-SPIRE – text mining and clustering Heat maps

Analyzing Portfolio Data Visualizing data with IN-SPIRE™ to facilitate the analysis of patterns – giving insight into gaps

Visualization – Heat Map Provides a high level visual overview of the changes with NIH RCDC Category information over time

Portfolio Reporting to the Public Office of Extramural Research (OER) Research Portfolio Online Reporting Tool (RePORT): http://report.nih.gov/

Portfolio Analysis and Evaluation Conclusions – comprehensive analyses of the scientific content of research portfolios affords powerful means for evaluating and managing complex research portfolios Questions How are you analyzing your research portfolios? What are the opportunities for cross-federal analyses? Are there opportunities to share data?