1. Final review 24th Nov 2014 Brussels
PaNdata ODI – WP7
Final review
24th Nov 2014
Brussels
24th Nov 2014
Jean-François Perrin (ILL)

2. Implementation of persistent identifiers for datasets
24th Nov 2014
Jean-François Perrin (ILL)

3. Jean-François Perrin (ILL)
DOI Implementation
Since November 2012:
ISIS and ILL have signed contract with DataCite
Current model: 1 DOI per proposal
dx.doi.org/ /ISIS.E
dx.doi.org/ /ILL-DATA
Implemented process:
DOIs are minted right after the first experiment
Scientists are informed by s
Scientists are invited to cite the experimental data’s DOI in the reference section of the publication
24th Nov 2014
Jean-François Perrin (ILL)

4. Jean-François Perrin (ILL)
Landing pages
ILL has minted 907 DOIs (Nov 2014)
ISIS has minted 1691 DOIs (Nov 2014)
24th Nov 2014
Jean-François Perrin (ILL)

5. Jean-François Perrin (ILL)
Usage
24th Nov 2014
Jean-François Perrin (ILL)

6. Jean-François Perrin (ILL)
Usage
Still difficult to track (see previous slides)
Relatively new mechanism
Adoption is growing still
Need more time to really assess uptake by the community.
Nevertheless
Very positive feedbacks and comments by the scientists
Disambiguation: preferred publication name, ORCID …
Need to modify the workflow (some valuable information are available only after analysis, …)
24th Nov 2014
Jean-François Perrin (ILL)

7. Jean-François Perrin (ILL)
Unexpected outcome
Usage of DOI for software has been developed
Example of Mantid
Data Citation Index (Thomson-Reuters)
Final discussion are taking place
24th Nov 2014
Jean-François Perrin (ILL)

8. Mechanisms and tools for representation information and archiving
E-logbook
Mechanisms and tools for representation information and archiving
24th Nov 2014
Jean-François Perrin (ILL)

9. Jean-François Perrin (ILL)
What do we needed?
Collect logs (text, pictures) generated
by the instrument control.
Allow users to annotate and comments (i.e. adding text, files and sketches) the logs/experiments easily.
A user interface that focus on usability for novice users.
Structure the information (authorisation, report, search, …)
24th Nov 2014
Jean-François Perrin (ILL)

10. Jean-François Perrin (ILL)
Architecture
24th Nov 2014
Jean-François Perrin (ILL)

11. Jean-François Perrin (ILL)
From mockup …
24th Nov 2014
Jean-François Perrin (ILL)

12. Jean-François Perrin (ILL)
… to rollout
24th Nov 2014
Jean-François Perrin (ILL)

13. Jean-François Perrin (ILL)
Acquisition view
24th Nov 2014
Jean-François Perrin (ILL)

14. Jean-François Perrin (ILL)
Functionalities
Live (Round trip 200ms) interface to the instrument log
Available from everywhere
Different views for different type of events
Export and possible PDF archive
User annotation: text and files (mostly used for analysis results)
Again very positive feedbacks and comments by the scientists
Need to graph live parameters (Temperature, pressure, …) evolution.
24th Nov 2014
Jean-François Perrin (ILL)

15. Mechanisms and tools for integrity of datasets
24th Nov 2014
Jean-François Perrin (ILL)

16. Jean-François Perrin (ILL)
Checksum
Need: certify that data files have not been altered from generation to analysis (by users).
Ideal Workflow
Generate checksum of datafiles on the DAQ computer.
Store the checksum with the metadata (ICAT)
Invite users to validate once downloaded
Tests have been done
24th Nov 2014
Jean-François Perrin (ILL)

17. Current workflow (ILL / ISIS)
Generate checksum (Adler & MD5) of data files on the archive system.
Stored in Manifest files and databases
Invite users to validate once downloaded
24th Nov 2014
Jean-François Perrin (ILL)

18. Jean-François Perrin (ILL)
24th Nov 2014
Jean-François Perrin (ILL)

19. Jean-François Perrin (ILL)
WP7 conclusions
We are absolutely convinced that this work is useful and necessary for modern science.
Electronic tools have been developed and opened to users during this project.
These tools are really in use and permit to preserve research data but also improved the experience of our users.
We are really at the beginning – need more time for a large community uptake
Data Policy are not always present.
New concepts (sharing data openly).
New tools (DOI, …).
24th Nov 2014
Jean-François Perrin (ILL)

20. PaNData-ODI was an exiting project–
Work and efforts will be pursued because we need the solutions and users are now engaged.
Questions ?
24th Nov 2014
Jean-François Perrin (ILL)