1 STAR METRICS & SciENCV Jobs, Projects, and People Nov 7, 2012 George Chacko, Walter Schaffer, and James Onken National Institutes of Health

WHAT IS STAR METRICS? S cience and T echnology for A merica’s R einvestment: M easuring the E ffec T s of R esearch on I nnovation, C ompetitiveness and S cience 2

STAR METRICS 3

PARTICIPATING AGENCIES NIH NSF OSTP 4 USDA EPA DOE

WHY STAR METRICS? 5 Presidential Memorandum on Transparency and Open Government (Jan 21, 2009) Office of Management and Budget Memorandum Open Government Directive (Dec 8, 2009) “…agencies should publish information online in an open format that can be retrieved, downloaded, and searched.” “…agencies should proactively use modern technology to disseminate useful information.”

Genesis and History Jan 2010 Jul 2010 Oct 2010 Jul 2011 Oct 2011 NIH becomes host institution Jan 2012New Governance Apr 2012Goals refined 6

GOVERNANCE 7 Lead Entity Executive Program Managers Technical Project Manager Contractors Executive Committee Interagency Working Group Research Institutions

SM GOALS 8 Level 1: Document the levels and trends in the scientific workforce supported by federal funding. Level 2: Develop an open automated data infrastructure and tools that will enable the documentation and analysis of a subset of the inputs, outputs, and outcomes resulting from federal investments in science.

Level I 9 Research Institution STAR METRICS Quarterly Data Submissions Jobs Report

Level I Enrollment 10

LEVEL I Intermediate Goals –Statistical study to guide enrollment –Evaluating data quality –Evaluating job estimate calculations –Developing a data policy –Solicit participation of minority serving institutions 11

LEVEL I (cont’d) Long-Term Goal 1: Increase participation –Establish and attain targets for the collection of workforce data for federally funded extramural research based on the outcomes from the statistical study –Develop an approach for including workforce data on federally funded intramural research –Work with partner organizations such as the FDP, AAU, APLU, and AAMC Long-Term Goal 2: Finalize workforce report and extend the usability of the data collected 12

Level II Trans-agency Database of Research Projects 13

Roadmap for Level II Policy level agreement on projects database Technical implementation plan Proof of concept pilot Testing and refinement More testing and refinement Production 14

Level II Concepts A database of federally funded research Make data available to federal agencies and other interested groups EPA, NIH, NSF, and USDA will contribute information to a proof-of-concept database. NIH will collect data from the four agencies and create and manage the database 15

Level II Downstream More research outputs –Publications –Patents –Links to researcher profiles, e.g. SciENCV Enabling –Metrics development –Cross Agency Analysis –Benchmarking research institutions 16

Ongoing Activities Level I –Statistical Study Level II –Design –Pilot 17 Data Policy

BUDGET 18 AgencyCommitment/YearFY 2012 NSF$500,000 Received NIH$500,000Received USDA$250,000Received EPA$250,000Received DOE- Total$1,500,000

GOVERNANCE 19 Sally Rockey (NIH) Chacko (NIH) Winter (NSF) (TBD) Synthosys Sapient Executive Committee Interagency Working Group Research Institutions

WITHIN NIH NIH Staff Sally Rockey (OER) George Chacko (CSR/OER) Jim Onken (OER) Jack Vinner (CIT) Megan Columbus (OER) 20 Contractors Synthosys Sapient

Other NSF (Myron Gutmann, Susan Winter, Chris Pece) USDA (Catherine Woteki, Sharon Drumm, John King) EPA (Lek Kadeli, Bronda Harrison, Mya Sjogren) OSTP (Philip Rubin, Kei Koizumi) DOE (Patricia Dehmer, Julie Carruthers) 21

Acknowledgments NIH ERA –Pete Morton, Rick Ikeda NIH OER –NETE –Pat Porter, Carol Kosh, Jess McKnight-Cullen Former STAR METRICS Managers Stefano Bertuzzi (ASCB) Julia Lane (AIR) 22

IN SUMMARY STAR METRICS is an open automated data infrastructure project that will enable the documentation and analysis of a subset of the inputs, outputs, and outcomes resulting from federal investments in science. 23

Science Experts Network and Curriculum Vitae Project Status Update NCURA November, 2012 Walter Schaffer 24

Brief Background “Why do I have to keep reentering the same data into federal grant systems?” “Why does each separate federal grants system have its own format requirements for bio- sketches?” “Why can’t the federal grant-related reporting requirements use the same data that I’ve already entered into a federal system?” “I already maintain my profile data in my system of choice. Why can’t I simply point to that as a source of information for my CV?” “The administrative burden is far too large when dealing with the government.” 25

Enter… SciEN CV Co-chaired by NSF and NIH. Six agencies (DOD, DOE, EPA, NIH, NSF, USDA) currently working together to “make it happen”. Working with the Federal Demonstration Partnership (FDP) to ensure that the system meets the goal of reducing the administrative burden on those involved in research who interact with the federal government. 26

Researcher View 27

Project Plan Assemble NIH, NSF, and other Agency required data elements –done Identify NIH Data sources and outputs - done Develop data model - done Develop NIH Use Cases & Wireframes - done Establish timeline and level of effort for the Project – done Approval by Research Business Models (RBM) - ? Initial “deliverables” Create sample XML records, pulling data from existing NIH data sources (myBibliography, NIH electronic Research Administration (eRA) Pull data from VIVO, Harvard Profiles, ORCID and other external sources Target HTML display pages for the NIH and NSF Biosketch and sample CVs Test and Expand to other Agencies See YouTube Video SciENCV Core Services Prototype Project Plan (High-Level) 28

29

30

31

Homepage Dashboard 32

Profile info Navigation “Action” area Data Sources Objects Products/Histor y 33

34

35

36

Complex data objects Bibliography, Funding, etc. 37

38

39

40

41

42

43

44

45

46

Putting it all together 47

48

49

50

end Please direct all complaints to Bart Trawick, Debbie Bucci, Neil Thakur, Susan Winter and Pete Morton 51

NIH Research Portfolio Online Reporting Tools (RePORT) Making the Most of Project and Investigator Information

53 Access to the NIH Portfolio The NIH Reform Act of 2006 Requires establishment of electronic system to uniformly code research grants and activities of the Office of the Director and of all the national research institutes and national centers The electronic system shall: be searchable by a variety of codes, such as grant type, IC, and public health area of interest (category) when permissible, shall provide information on relevant literature and patents that are associated with research activities of the National Institutes of Health NIH RePORT Expenditures and Results (RePORTER)

54 Basics Data Elements Grant/Contract/Project Number Project Title Project Description Principal Investigator Funding Agency Recipient Institution Recipient Address Project Start Date Project End Date Fiscal Year (of funding) Funding Amount Uses Searching Browsing Summary Statistics Graphics Links to External Sources of Information Reports (Standard and Customized)

55 The NIH Solution

56 Querying

57 Browsing

58 Using Search Results

59 Using Search Results

60 Visualizing Results Research Support to Johns Hopkins

61 Visual Browsing

62 Mapping

63 Mapping

64 Third-Party Tools Topic Modeling

65 Links to External Information Sources

66 Save queries Receive alerts Save portfolios Share queries Customized Reports

67 Electronic Alerts

A Community Resource

70 THANK YOU NOTES: This presentation was prepared by: James Onken, Ph.D., RePORT Program Manager Sandeep Somaiya [C – NETE SOLUTIONS], RePORT Project Lead