STEPHANIE SHIPP SCIENCE & TECHNOLOGY POLICY INSTITUTE AMERICAN EVALUATION ASSOCIATION NOVEMBER 12,2009 Science of Science Policy: Making Better Science Policy Decisions S T P I 1

Why do we need a Science of Science Policy? To inform Science Policy decisions-for example: What are the impacts of the ARRA reinvestment strategy on scientific knowledge, economic growth, and job creation? 1 What deeper understandings can we gain about the mechanisms whereby knowledge is created and how it contributes to both economic and social outcomes? 1 How can we make “less stupid decisions”? 2 1.Julia Lane. “Assessing the Impact of Science Funding,” in Science, vol 324, 5 June Michael Mandel, Science of Science Policy Workshop, George Washington University, 3 December

A Proposed SoSP Evaluation Framework Near Term Communication  Common Language  Learning Mid-term Participation  Partnerships  Community of Practice Capacity-building  Data, Methods, & Tools Long Term Translational research  Anticipatory Governance  Better decisions Evaluation Evaluation measures progress, assessments of program evolution as well as program outcome; built in reporting structures allow for mid-project course correction 3

Near Term Priorities: Communication/Learning Roadmap Workshops:  December 2008  October 2009  3 planned for 2010 Listserv Early website Coming soon: New website 4

Mid-term Priorities: Participation/Partnerships & Capacity-building Support a community of practice through a dynamic SoSP website  Link SciSIP researchers and federal practitioners SciSIP Program  Build a community of researchers  Develop data, models, and tools, including evaluation 5

Mid-Term Priorities: Capacity Building 72 SciSIP grants involving 131 researchers SciSIP Topics (selected) Human capital development and collaborative enterprise Returns to international knowledge flows Creativity and innovation Measuring and tracking innovation Measuring and evaluating scientific progress Knowledge sharing and creativity …….and many more 6

Translational Research Anticipatory governance 1 A way of thinking about and conducting scientific research to make results applicable to the population under study Removes barriers to multi- disciplinary collaboration Involves the community who will benefit at all stages of research Requires interdisciplinary translational research and the integration researchers with scientists and engineers throughout the R&D cycle to: Prevent problems Solve problems as they arise Mitigate and/or prepare for unintended consequences Outcome: Better science policy decisions 7 Long Term SoSP Priorities: Better Science Policy Decisions 1. Risto Karinen and David Guston. “Toward Anticipatory Governance: The experience with nanotechnology,” in Assessment Regimes of Technology: Regulation, Deliberation and Identity Politics of Nanotechnology, library/type/?action=getfile&file=119&section=lib

Translational Research: Example-Translational Medicine “The goals of this journal, and of translational medicine more broadly, are to speed the rate at which the astounding recent advances in our basic understanding of biological mechanisms are exploited for preventing and treating human disease” 8 Bruce Alberts. “The Art of Translation,” in Science 9 October 2009: Vol no. 5950, p. 205.

Why we need Science of Science Policy ? Example: Beyond Climate Science 1 “Many decision-makers don't know what is available, where to find it, how to use it, or the limits to appropriate use.”  “The result is that our understanding of how ecosystems, water, human health, agriculture, and energy will respond to climate change advances only slowly.” “Information from diverse federal agencies should be provided through a single portal.”  “It is critical to create a single, credible, authoritative source of climate information to support decision-makers.” “[G]ood decisions depend on the ability to create "environmental intelligence" that can be accessed by decision-makers.” 1 Barron, Eric, “Beyond Climate Science, “ Eric Barron, Science 30 October 2009: Vol no. 5953, p

What is Role of Evaluation in SoSP? 10

Join the SoSP/SciSIP Community! Join the listserv Send a blank to: Send us content that belongs on the site (publications, reference materials, events, tags…) Visit the new site in early December and: Register and build your profile Add material to the site (publications, news, events, etc.) Comment on and rate existing material 11