1. Storing digital assets on Grid/EGI FedCloud with gLibrary Giuseppe La Rocca, INFN (giuseppe.larocca@ct.infn.it)giuseppe.larocca@ct.infn.it DARIAH ERIC 5 th General VCC Meeting Ljubljana, Slovenia – 22 April 2015

2. Outline  INFN contribution in EGI DARIAH CC  The gLibrary Digital Repository System  High-level architecture & Technologies used  Data Management APIs  (Some) examples of the Cultural Heritage / Earth Science VRCs  Summary and conclusions DARIAH ERIC 5 th General VCC Meeting 2

3. The EGI DARIAH Competence Centre 3 DARIAH ERIC 5 th General VCC Meeting

4. Work Plan Structure 4 DARIAH ERIC 5 th General VCC Meeting

5. Storing and Accessing DARIAH contents on EGI (SADE) 5 The Austrian Academy of Science (AAS) will provide the following sample datasets: Headwords (about 50,000 A-Z) Records (about 40,000 plants; about 70,000 in general) Multimedia with Link to Audio-file Multimedia with Collection (about 3,000; planned to be published within the mini-project) Multimedia connected to Headword (about 3,000; planned to be digitized) Project specific biographies Locations DARIAH ERIC 5 th General VCC Meeting

6. 6 The INFN Digital Repository System (https://glibrary.ct.infn.it/)

7. 7 gLibrary is a platform developed by INFN that provides a simple yet powerful system to organize, search, store and retrieve “digital assets” in distributed repositories built on Grid/Cloud/local storage infrastructures hides the underlying technical details to the users “digital assets”: digital object + corresponding metadata DARIAH ERIC 5 th General VCC Meeting in a nutshell

8. 8 DARIAH ERIC 5 th General VCC Meeting architecture

9. 9 DARIAH ERIC 5 th General VCC Meeting Federated Authentication (implementation for mobile appliances) 4. Extract Shibboleth token from response header 1. Get available IDPs Science Gateway 3. Open WebView glibrary.ct.infn.it REST API Now you can issue any API calls to gLibrary REST API 2. Supported IDPs list

10. 10 gLibrary Core Services are implemented using Python and node.Js The gLibrary Metadata and File Transfer Services can be accessed through a set of REST API s REST APIs are developed as a WSGI module in Apache container DARIAH ERIC 5 th General VCC Meeting list of technologies used Grid-based and Federated Authentications are now supported! Data Transfer APIs are provided by GridBOX! Metadata service has been deployed using Django framework An OAI-PMH interface has been implemented on top of gLibrary Metadata services to allow external harvesters the extraction of gLibrary repositories’ metadata

11. 11 Digital Object: Any files (PNG, JPG, PDF, TIFF, RAW, MP3, MP4, etc.) Metadata: A set of attributes describing a digital object (resolution, author, title, description, location(geo-coords), subject, etc.) Digital Asset: A digital object + its metadata Collection: A set of digital assets of the same type (Presentations, 2013_Thesis) Repository: A library of digital assets organized by collections (all the Presentations and Thesis) DARIAH ERIC 5 th General VCC Meeting abstractions

12. 12 DARIAH ERIC 5 th General VCC Meeting Repository Browser Web App It allows to navigate all the repository managed by a single instance of gLibrary

13. 13 DARIAH ERIC 5 th General VCC Meeting Repository Uploader HTML5 Web App It allows to upload new assets to already created repository and specify metadata using a predefined schema

14. 14 DARIAH ERIC 5 th General VCC Meeting Native Mobile clients for accessing repositories

15. Data Management APIs / File Download 15 DARIAH ERIC 5 th General VCC Meeting

16. Data Management APIs / File Upload (1/3) 16 DARIAH ERIC 5 th General VCC Meeting

17. 17 DARIAH ERIC 5 th General VCC Meeting Data Management APIs / File Upload (2/3)

18. 18 DARIAH ERIC 5 th General VCC Meeting Data Management APIs / File Upload (3/3)

19. DARIAH ERIC 5 th General VCC Meeting Existing examples within the Cultural Heritage community 19 The Cultural Heritage Science Gateway (https://ecsg.dch-rp.eu/)

20. DARIAH ERIC 5 th General VCC Meeting Already existing examples within the DCH community (1/2) 20

21. Already existing examples within the DCH community (2/2) 21 DARIAH ERIC 5 th General VCC Meeting

22. 22 The EarthServer Science Gateway Mobile (https://earthserver-sg.consorzio-cometa.it/) Existing examples within the Earth Science community

23. ESA MERIS Data Repository Browsing 23 DARIAH ERIC 5 th General VCC Meeting

24. Generic WCS and WMS mobile client 24 DARIAH ERIC 5 th General VCC Meeting

25. Summary and conclusions 25  gLibrary aims to provide a simple framework to manage digital assets on distributed storage, hiding underlying technical infrastructure details DARIAH ERIC 5 th General VCC Meeting  Current features:  REST APIs to access available digital assets  Security:  Support for Federated Authentication  Usability:  Several gLibrary front-ends for web and mobile scenarios  Standards:  Full support for HTTP/HTTPS direct access to Grid and Cloud Storages

26. Thank you ! 26 DARIAH ERIC 5 th General VCC Meeting