Data, Data Everywhere…. September 8, 2011 The Coalition for Academic Scientific Computation José-Marie Griffiths, PhD Vice President for Academic Affairs Bryant University, Smithfield, Rhode Island

Concerns of Research Administrators 1.Strong advocates of research and its dissemination to as wide a set of audiences as possible. 2.Most concerns today relate to current economic trends and uncertainties. 3.Long been concerned about overhead costs (which are increasing) and the cap on administrative costs. 2

Concerns of Research Administrators Concerns about policies translating into “unfunded mandates” (like recently proposed financial reporting requirements to track all federal funding). 5.Increasingly concerned about roles, responsibilities, and liabilities. 6.Size matters! 3

Taking AIM at Data Lifecycle Management: A ccess, I ntegrity, M ediation

Data Policy Task Force Established at the February 3-4, 2010 NSB meeting Charge: further defining the issues and outlining possible options to make the use of data more effective in meeting NSF's mission. 5

Data Policy Task Force Strategies Monitor the impact of NSF updated implementation of the Data Management Plan requirement to inform a review of NSF policy Considering issues of data policy, Open Data movements, and related issues, the Task Force will then develop a "Statement of Principles.” Provide guidance to subsequent Board efforts to develop specific actionable policy recommendations focused, initially, on NSF, but that could potentially promulgate through other Federal agencies in a national and international context. 6

NSB Task Force on Data Policy Statement of Principles 1.Openness and transparency are critical to continued scientific and engineering progress and to building public trust in the nation’s scientific enterprise. – This applies to all materials necessary for verification, replication and interpretation of results and claims, associated with scientific and engineering research. 2.Open Data sharing is closely linked to Open Access publishing and they should be considered in concert. 3.The nation’s science and engineering enterprise consists of a broad array of stakeholders, all of which should participate in the development and adoption of policies and guidelines. 7

NSB Task Force on Data Policy Statement of Principles It is recognized that standards and norms vary considerably across scientific and engineering fields and such variation needs to be accommodated in the development and implementation of policies. 5.Policies and guidelines are needed for open data sharing which in turn requires active data management. 6. All data and data management policies must include clear identification of roles, responsibilities and resourcing. 8

NSB Task Force on Data Policy Statement of Principles The rights and responsibilities of investigators are recognized. Investigators should have the opportunity to analyze their data and publish their results within a reasonable time. 9

NSB Expert Panel Discussion on Data Policies March 28-29, 2011 Arlington, VA Participants included: – Over 30 experts/research administrators – 7 NSB members – 4 NSF Directors/Staff 10

A ccess, I ntegrity, M ediation Access – “what goes in must be able to come out!” Integrity – “what goes in must be the same thing that comes out!” Mediation – “what goes in is going to need help coming out!” 11

Key Areas Emerging from the Expert Panel Discussion on Data Policies March, 2011 ACCESS 1.Standards and interoperability enable data-intensive science. 2.Data sharing is an identified priority. INTEGRITY 3.Recognize and support computational and data- intensive science as a discipline. MEDIATION 4.Storage, preservation, and curation of data are critical to data sharing and management (data stewardship). 5.Cyberinfrastructure is necessary to support data- intensive science. 12

ACCESS What goes in must be able to come out! A ccess I ntegrity M ediation 13

Key Areas - National Science Board Expert Panel Discussion on Data Policies March, 2011 ACCESS 1.Standards and interoperability enable data-intensive science. 2.Data sharing is an identified priority. 14

Standards and interoperability enable data-intensive science. Citation and attribution norms – Need new norms and practices – Data producers, software & tool developers, data curators get credit for their work Interoperability standards – To enable sharing & interoperability across disciplines and internationally Development of persistent identifiers – To enable tracking of provenance – Ensure data integrity (see next section) – Facilitate citation & attribution 15

Interoperability - sooner rather than later 16

Data sharing is an identified priority. Must balance privacy concerns and data access for sharing and re-use. Acknowledge disciplinary cultures while establishing a culture of sharing across all research communities. Must promote & reward exemplary data management projects & plans. Data availability must be timely – issues of embargoes and restricted use durations. 17

18

INTEGRITY 19 What goes in must be the same thing that comes out! A ccess I ntegrity M ediation

Recognize and support computational and data-intensive science as a discipline. Recognize & reward computational & data scientists & curators: funding, tenure, etc. Support training in computational science Reward international collaborations to develop cyberinfrastructure, data stewardship, interoperability, international sharing New funding/economic models to support processing, storing, archiving, maintaining data sets. Need to define who is responsible for what – funding agencies/publishers versus research communities 20

Office of Research Integrity, U.S. Department of Health and Human Services: Key Components of Data Lifecycle Management Guidelines for Responsible Data Management in Scientific Research, ori.hhs.gov/education/products/clinicaltools/data.pdf 21

Planning for Preservation over the Data Life Cycle 1.Anticipate archiving costs and challenges 2.Create a data management plan 3.Follow best practices for data and documentation 4.Manage master datasets and work files 5.Determine file formats to deposit 6.Comply with dissemination standards and formats 7.Set up support for data users Courtesy of Cole Whiteman, ICPSR Proposal Planning and Writing Project Start-up and Data Management Project Start-up and Data Management Data Collection and File Creation Data Analysis Preparing Data for Sharing Depositing Data After- Deposit Archival Activities

Integrity Concerns for Research Institutions What to share - raw, processed, analyzed datasets, instruments, calibration and environmental records, analytical tools, etc. Processes for and costs of long-term curation of data 23

MEDIATION 24 What goes in is going to need help coming out! A ccess I ntegrity M ediation

Storage, preservation, and curation of data are critical to data sharing and management (data stewardship) Funding agencies must commit to ongoing financial support for repositories (no “orphans”) Standardized curatorial mechanisms Strategic partnerships between stakeholder communities and data repositories, supported by funders Define roles of different types of digital repositories Possibly independent auditing of data repositories to ensure data quality, access, interoperability 25

Cyberinfrastructure is necessary to support data-intensive science Geographic distribution of research teams, computing resources and datasets requires robust cyberinfrastructure Must include shared applications for analysis, visualization and simulation Standardization for interoperability & accessibility Need capital investment in cyberinfrastructure Need to define appropriate ratio of infrastructure to research funding 26

Mediation is Needed at Data Collection, Analysis and Use Gio Weiderhold, Stanford: When there is high intensity of interaction with any of these elements, it makes sense to have multiple mediators (e.g. replicate repositories) Collected Research Data Set A Collected Data Set B Repository 2 Repository 1 Repository 3 Use Repository 4 Use Analysis 27

Informal and Formal Mediation Mediation at “Use” level is informal and pragmatic Mediation at “Repository” and “Analysis” level needs to be formal with domain/expert control* Collected Research Data Set A Collected Data Set B Repository 2 Repository 1 Repository 3 Use Repository 4 Use Analysis 28 *Gio Weiderhold, Stanford, 1995

Stakeholders – Multiple Players, Inter-relationships 29

For data to be discoverable, must have a shared overlay of interdisciplinary and technological connections 30

31 This….or….This?

José-Marie Griffiths, Ph.D. Vice President for Academic Affairs Bryant University 1150 Douglas Pike Smithfield, RI (401)