Final review 24th Nov 2014 Brussels PaNdata ODI – WP7 Final review 24th Nov 2014 Brussels 24th Nov 2014 Jean-François Perrin (ILL)

Implementation of persistent identifiers for datasets 24th Nov 2014 Jean-François Perrin (ILL)

Jean-François Perrin (ILL) DOI Implementation Since November 2012: ISIS and ILL have signed contract with DataCite Current model: 1 DOI per proposal dx.doi.org/10.5286/ISIS.E.24066298 dx.doi.org/10.5291/ILL-DATA.3-03-717 Implemented process: DOIs are minted right after the first experiment Scientists are informed by emails Scientists are invited to cite the experimental data’s DOI in the reference section of the publication 24th Nov 2014 Jean-François Perrin (ILL)

Jean-François Perrin (ILL) Landing pages ILL has minted 907 DOIs (Nov 2014) ISIS has minted 1691 DOIs (Nov 2014) 24th Nov 2014 Jean-François Perrin (ILL)

Jean-François Perrin (ILL) Usage 24th Nov 2014 Jean-François Perrin (ILL)

Jean-François Perrin (ILL) Usage Still difficult to track (see previous slides) Relatively new mechanism Adoption is growing still Need more time to really assess uptake by the community. Nevertheless Very positive feedbacks and comments by the scientists Disambiguation: preferred publication name, ORCID … Need to modify the workflow (some valuable information are available only after analysis, …) 24th Nov 2014 Jean-François Perrin (ILL)

Jean-François Perrin (ILL) Unexpected outcome Usage of DOI for software has been developed Example of Mantid http://nobugs2014.kek.jp/slides/O3-03.html http://dx.doi.org/10.5286/SOFTWARE/MANTID Data Citation Index (Thomson-Reuters) Final discussion are taking place 24th Nov 2014 Jean-François Perrin (ILL)

Mechanisms and tools for representation information and archiving E-logbook Mechanisms and tools for representation information and archiving 24th Nov 2014 Jean-François Perrin (ILL)

Jean-François Perrin (ILL) What do we needed? Collect logs (text, pictures) generated by the instrument control. Allow users to annotate and comments (i.e. adding text, files and sketches) the logs/experiments easily. A user interface that focus on usability for novice users. Structure the information (authorisation, report, search, …) 24th Nov 2014 Jean-François Perrin (ILL)

Jean-François Perrin (ILL) Architecture 24th Nov 2014 Jean-François Perrin (ILL)

Jean-François Perrin (ILL) From mockup … 24th Nov 2014 Jean-François Perrin (ILL)

Jean-François Perrin (ILL) … to rollout 24th Nov 2014 Jean-François Perrin (ILL)

Jean-François Perrin (ILL) Acquisition view 24th Nov 2014 Jean-François Perrin (ILL)

Jean-François Perrin (ILL) Functionalities Live (Round trip 200ms) interface to the instrument log Available from everywhere Different views for different type of events Export and possible PDF archive User annotation: text and files (mostly used for analysis results) Again very positive feedbacks and comments by the scientists Need to graph live parameters (Temperature, pressure, …) evolution. 24th Nov 2014 Jean-François Perrin (ILL)

Mechanisms and tools for integrity of datasets 24th Nov 2014 Jean-François Perrin (ILL)

Jean-François Perrin (ILL) Checksum Need: certify that data files have not been altered from generation to analysis (by users). Ideal Workflow Generate checksum of datafiles on the DAQ computer. Store the checksum with the metadata (ICAT) Invite users to validate once downloaded Tests have been done 24th Nov 2014 Jean-François Perrin (ILL)

Current workflow (ILL / ISIS) Generate checksum (Adler & MD5) of data files on the archive system. Stored in Manifest files and databases Invite users to validate once downloaded 24th Nov 2014 Jean-François Perrin (ILL)

Jean-François Perrin (ILL) 24th Nov 2014 Jean-François Perrin (ILL)

Jean-François Perrin (ILL) WP7 conclusions We are absolutely convinced that this work is useful and necessary for modern science. Electronic tools have been developed and opened to users during this project. These tools are really in use and permit to preserve research data but also improved the experience of our users. We are really at the beginning – need more time for a large community uptake Data Policy are not always present. New concepts (sharing data openly). New tools (DOI, …). 24th Nov 2014 Jean-François Perrin (ILL)

PaNData-ODI was an exiting project – Work and efforts will be pursued because we need the solutions and users are now engaged. Questions ? 24th Nov 2014 Jean-François Perrin (ILL)