Data Repositories and Science Gateways for Open Science Presenter: Roberto Barbera – UNICT and INFN EGI Community Forum Bari – 11 November 2015

Outline  Introductory concepts, definitions and driving considerations  A viable approach to Open Science  Summary and conclusions 2

The Scientific Method Examples of IR: Classical Mechanics Newton’s Gravitation Theory Examples of DR: General Relativity Standard Model of Particle Physics 3 G. Galilei

The Pillars of the Scientific Method Repeatability The closeness of agreement between independent results obtained with the same method on identical test material, under the same conditions (same operator, same apparatus, same laboratory and after short intervals of time) Affected by random errors Reproducibility The closeness of agreement between independent results obtained with the same method on identical test material but under different conditions (different operators, different apparatus, different laboratories and/or after different intervals of time) Affected by systematic errors Is science really reproducible ? 4

Challenges in irreproducible research ( 5

The “reproducibility crisis” 18 Out of 18 microarray papers, results from 10 could not be reproduced Out of 18 microarray papers, results from 10 could not be reproduced 6 1.Ioannidis et al., Repeatability of published microarray gene expression analyses. Nature Genetics 41: 14 2.Science publishing: The trouble with retractions 3.Bjorn Brembs: Open Access and the looming crisis in science

Repeatability and Reproducibility are not all 7

How e-Infrastructures support the (e-)Scientific Method Data Infrastructures Open Access Doc. Repos. Data Repos. Semantic-web enrichment of linked data Data preservation HTC/HPC Clusters Grids, Clouds both ways Challenge: «walk» across the knowledge path both ways 8

Open Science

An INFN approach to Open Science: the “grand” view Digital Repository of Research Products (pilot: arXiv CNR S&T DL CINECA VQR INFN Multi media SINGLE – MANDATORY - DEPOSIT SCIENCE PRODUCTS REPRODUCIBILITY ORCID INFN Gray Lit. SCOAP 3 10

The INFN Open Access Repository ( papers data Automatic ingestion in place from: federated authentication

Alternative reputation systems: possibility to add researcher ID’s 12

Examples of document and data resources 13 Data stored on:

Example of software resources: the ALICE Virtual Research Environment 14

Example of research “package” 15

The OAR Knowledge Workflow 16

The OAR Knowledge Workflow: ALEPH data search & discovery 17

1. From OAR it is possible to select an “analysis” as simply as any other resources in the archive The OAR Knowledge Workflow: ALEPH “packages” inspection Clicking on RUN PAGE, the researcher can either reproduce or extend that particular analysis using a Catania Science Gateway

The OAR Knowledge Workflow: ALEPH data analysis (1/2) The Science Gateway collects from the OAR, and allows user browse, the metadata associated to the dataset(s) needed to run that particular analysis 19

The OAR Knowledge Workflow: ALEPH data analysis (2/2) Data are retrieved from Using the JSAGA adaptor for all OCCI-compliant cloud-middleware, the Science Gateway starts a dedicated VM already configured with the all the experiment software Both the CHAIN-REDS Cloud Testbed and the EGI Federated Cloud can be used as e-Infrastruc- tures Jobs run both on and 20

Remember: repeatability and reproducibility are not all Reusability and «extensibility» matter! 21

1.From within the CHAIN-REDS Science Gateway entitled researchers can start VMs already configured to re-use/extend ALICE data analyses 2.The VMs are deployed both on the CHAIN-REDS Cloud Testbed and on the EGI Federated Cloud using the features of the EGI AppDB Reusability of ALICE data with the CHAIN-REDS Science Gateway (1/3) 22

Reusability of ALICE data with the CHAIN-REDS Science Gateway (2/3) 1.The VM is available tor a customizable amount of time during which the user has full access to the dataset(s) and analysis algorithm(s) and source code(s) of the experiment 2.The user can access the VM using different protocols (e.g., SSH, VNC); clicking on the SSH or VNC icons the user can directly access the VM instantiated on the cloud from within the Science Gateway 23

Reusability of ALICE data with the CHAIN-REDS Science Gateway (3/3) 24 New stable analyses (and their results), generated running the VM, may be registered in the OAR (with DOIs) to further extend the analysis catalogue shared within the Virtual Research Community

“Who’s this science of ?” How to provide authorship to research products? 25

ORCID ( – becoming a “de facto” standard) 26 More than 1.74 million ORCID IDs so far

ORCID: search & link your works in/from DataCite 27

ORCID: add your research products to your profile 28 v <a

Summary and conclusions 29  Open Science vision can be implemented only if the “openness” paradigm becomes pervasive in research  Science outputs’ reproducibility, but also re-usability and extensibility, are key to walk through the “knowledge path” in both directions  The INFN Open Access Repository is a pilot knowledge preservation repository meant to serve both researchers and citizen scientists  What makes the INFN OAR different from other repositories is:  Its capability to connect to Science Gateways and exploit cloud resources worldwide to easily reproduce/extend scientific analyses  Its capability to provide full authorship (and hence credit, reputation and visibility) for all products of a scientist  this is key for a correct evaluation of research (…and of researchers)

Authors 30  R. Barbera (University of Catania and INFN, Italy)  S. Bianco (INFN LNF, Italy)  T. Boccali (INFN Pisa, Italy)  C. Carrubba (University of Catania, Italy)  G. Inserra (University of Catania, Italy)  M. Maggi (INFN Bari, Italy)  D. Menasce (INFN Milano Bicocca, Italy)  R. Ricceri (University of Catania, Italy)

Thank you ! 31