1. Visita al sito di Catania RECAS 06-09-2013 1 Attività correlate a RECAS condotte a Catania Roberto Barbera

2. 2 Outline Current projects where Catania is involved The Catania Science Gateway Framework Open Access, Linked Data and Semantic Search Summary and conclusions

3. 3 List of projects where Catania is involved Currently running: – agINFRA (EU-FP7) – www.aginfra.euwww.aginfra.eu e-Infrastructure for Agricultural Sciences – CHAIN-REDS (EU-FP7) – www.chain-project.euwww.chain-project.eu Harmonisation of e-Infrastructures worldwide – DCH-RP (EU-FP7) – www.dch-rp.euwww.dch-rp.eu Roadmap for preservation of Digital Cultural Heritage data – EarthServer (EU-FP7) – www.earthserver.euwww.earthserver.eu Geospatial Big Data Analytics – eI4Africa (EU-FP7) – www.ei4africa.euwww.ei4africa.eu e-Infrastructure building and support in Sub-Saharan Africa – PRISMA (PON Smart cities) Cloud computing – RECAS (PON) Funded but not yet started: – VESPA (PO FESR Sicilia) Virtual-reality-based e-Infrastructure for early diagnosis of mental diseases

4. Research networks at «global» scale 4

5. The “Global” Grid 5

6. The “non-global” middleware 6 Genesis II Interoperability and easiness of access are issues

7. 7 Using Grids is not straightforward  Users have to cope with complex security procedures, execution scripts, job description languages, command line based interfaces and lack of standards This makes the learning curve very steep and keeps non IT-experts away

8. 8 (1) http://www.eresearch2020.eu/eResearch%20Brochure%20EN.pdf The eResearch 2020 report (1) Some barriers in the adoption of Grids: – Changes on Grids means changes on applications – Time required to adapt usual workflows – Lack of structure to support anonymous access – Download and installation of applications – Interface – Slow to get to compared to other resources – Difficult to use in the beginning – Time spent to get the application compiled and running

9. 9 Some numbers… (*) https://www.italiangrid.it/sites/default/files/IGI%20brochure%20SC2010.pdf  1100 users in Italy

10. 10 The path to technology uptake – Where are we with e-Infrastructures ? The Rogers “bell-shape” curve - Rogers, E. M. (1962), “Diffusion of Innovations”, Glencoe: Free Press.

11. Interoperability – Does this definition apply to e-Infrastructures ? Interoperability is a property referring to the ability of diverse systems and organizations to work together (inter-operate). The term is often used in a technical systems engineering sense, or alternatively in a broad sense, taking into account social, political, and organizational factors that impact system to system performance; According to ISO/IEC 2382-01 (Information Technology Vocabulary, Fundamental Terms), interoperability is "The capability to communicate, execute programs, or transfer data among various functional units in a manner that requires the user to have little or no knowledge of the unique characteristics of those units". 11

12. 12 Science Gateways “A Science Gateway is a community-developed set of tools, applications, and data that is integrated via a portal or a suite of applications, usually in a graphical user interface, that is further customized to meet the needs of a specific community.” Teragrid/XSEDE

13. IT acceptance model – the Grid Development of Science Gateways Requirement for sustainability Davis, F. D. (1989), "Perceived usefulness, perceived ease of use, and user acceptance of information technology", MIS Quarterly 13(3): 319–340 13

14. 14 Building Science Gateways should be like playing with Sc. Gtwy E Sc. Gtwy DSc. Gtwy CSc. Gtwy B Sc. Gtwy A Standards Simplicity Easiness of use Re-usability

15. 15 The Catania Science Gateway Framework (http://www.catania-science-gateways.it)....... Science Gateway Science Gateway App. 1 App. 2 App. N Embedded Applications Administrator Power User Basic User Users from different organisations having different roles and privileges Standard-based (SAGA) middleware-independent Grid Engine Standard-based (SAGA) middleware-independent Grid Engine Grid/Cloud/Local middleware supported so far

16. 16 Summary of adopted standards The framework for Science Gateways developed at Catania is fully web-based and adopts official worldwide standards and protocols, through their most common implementations These are: – The JSR 168 and JSR 286 standards (also known as "portlet 1.0" and "portlet 2.0" standards)JSR 168JSR 286 – The OASIS Security Assertion Markup Language (SAML) standard and its Shibboleth and SimpleSAMLphp implementationsOASISSecurity Assertion Markup LanguageShibboleth SimpleSAMLphp – The Lightweight Direct Access Protocol, and its OpenLDAP implementationOpenLDAP – The Cryptographic Token Interface Standard (PKCS#11) standard and its Cryptoki implementationCryptographic Token Interface Standard – The Open Grid Forum (OGF) Simple API for Grid Applications (SAGA) standard and its JSAGA implementationOpen Grid ForumSimple API for Grid Applications JSAGA

17. 17 AuthN/AuthZ Schema AuthorisationAuthorisation Science Gateway GrIDP (“catch-all”) GrIDP (“catch-all”) IDPCT (“catch- all”) IDPCT (“catch- all”) IDP_y LDAP......... 1. Register to a Service 2. Sign in Authentication Social Networks’ Bridge IdP

18. 18 The eduGAIN inter-federation (www.edugain.org) Catania Science Gateways are also registered as Service Providers of eduGAIN

19. 19 The GrIDP “catch-all” federation (http://gridp.garr.it) v

20. 1. sign in User 6. get the results 4. execute action 3’/4’. track user eCSG Admin 5. get output Local/ Grid/ Cloud 2”. authZ eToken server 2’. authN Identity Provider User Registry Compliant with the EGI.eu Portal and Traceability Policies 3. create a proxy from an eToken server with robot certificates Catania Science Gateway Access Workflow 20

21. Robot certificates «in a nutshell» Robot certificates have been introduced to allow users, who do not have/want personal certificates and do not belong to any Virtual Organisation, to use the Grid They are usually issued on USB form factor’s smartcards Basically, these certificates can be used to identify a person responsible for an unattended service or process acting as client and/or server for a Virtual Research Community

22. The Catania Grid & Cloud Engine Grid/Cloud Engine Users Tracking DB Science GW Interface SAGA/JSAGA API Job Engine Data Engine Users Track & Monit. Science GW 1 Science GW 2 Science GW 3 Grid/Cloud/Local MWs Liferay Portlets eToken Server New ModifiedNewModified New

23. CHAIN Demo Contributors 23

24. CHAIN Demo Status (http://science-gateway.chain-project.eu/demo-status) 24

25. CHAIN Demo Status (http://science-gateway.chain-project.eu/demo-status) 25 A demo is in preparation for next week to show interoperability also with clouds

26. The GISELA Science Gateway (http://gisela-gw.ct.infn.it) 26

27. The GISELA SG: A new concept of Application Registry Links to applications run pages 27

28. The GISELA Science Gateway: Phylogenetics (MrBayes) Input Parameters

29. The GARR Science Gateway (http://sgw.garr.it) 29 A Catania Science Gateway is being installed at Napoli for RECAS

30. 30 Uptake of Catania Science Gateways in the world (as of the end of 2012) Users from 219 Organisations in 47 Countries 14 Science Gateways in production; 4 in preparation

31. Some considerations – Mobile Access More than 25% of mobile phones in the world are smartphones and the number of people connected through mobile appliances increases every year Social networking amounts to 91% of mobile internet access, compared to 79% on desktops, and it is expected that by 2014 mobile internet should take over desktop internet usage (*) So, mobile access to “everything” is not any more an option; it is a must and e-Infrastructures shouldn’t/won’t be an exception (*) http://www.biztechday.com/mobile-stats-2011-91-use-mobile-phones-to-socialize

32. 32 “Mobile” Science Gateways https://play.google.com/store/apps/details?id=it.infn.ct.earthserverSGmobile

33. 33 “Mobile” Science Gateways

34. 34 “Mobile” Science Gateways

35. Big challenges are in front of us… Now that many users can potentially access and use Catania Science Gateways, a new training and communication strategy is needed as well as a portfolio of appealing applications to attract them 35

36. 36 1. 2. 3. 4. 5. Users/VRCs Ex.: Africa Grid Science Gateway SG Dev. The Science Gateway Market Place

37. Training for Science Gateway developers New training material: New training tools: New kind of training events: – http://agenda.ct.infn.it/event/catania-sg-webinar http://agenda.ct.infn.it/event/catania-sg-webinar – http://agenda.ct.infn.it/event/catania-sg-course http://agenda.ct.infn.it/event/catania-sg-course 37

38. Web-course summary information Home page: – http://agenda.ct.infn.it/event/catania-sg-course http://agenda.ct.infn.it/event/catania-sg-course Timetable (direct URL): – http://agenda.ct.infn.it/conferenceOtherViews.py ?view=standard&confId=942 http://agenda.ct.infn.it/conferenceOtherViews.py ?view=standard&confId=942 All presentations have been uploaded Links are provided both to watch and download recordings of all the webinars This will be the base of the Science Gateway school Catania will run for RECAS

39. Training material summary information Training material page (short URL): – http://goo.gl/im7YG http://goo.gl/im7YG Available sections: This will be the base of the Science Gateway school Catania will run for RECAS 39

40. Code summary information (1/2) The Catania Science Gateway Framework on Sourceforge: – http://sourceforge.net/projects/ctsciencegtwys/ http://sourceforge.net/projects/ctsciencegtwys/ 40

41. A unique entry point The Catania Science Gateway Framework on the web: – http://www.catania-science-gateways.it http://www.catania-science-gateways.it 41

42. The Catania Science Gateway Market Place: – http://www.catania-science-gateways.it/market-place http://www.catania-science-gateways.it/market-place The Science Gateway Market Place (the first real implementation !) 42

43. The list of available applications 43

44. To propose new applications http://www.catania-science-gateways.it/survey

45. To port new applications Register as a Catania Science Gateway Developer: – http://www.catania-science-gateways.it/port-app http://www.catania-science-gateways.it/port-app Sign In and book an application «to be ported» Once your booking is accepted, you have 30 days to create the needed portlet(s) for the application (the sooner the better) – After that time the access to our VPN will be denied Once you are registered you can also port the applications YOU proposed 45

46. 46 First summary and conclusions e-Infrastructures can be very beneficial platforms for many users, provided they are really «easy to use» and users are at their centre The Catania Science Gateway Framework changes the way Grid infrastructures are used, hugely widening their potential user base across continents and organisations, especially non-IT experts and the “citizen scientist” The adoption of standards (JSR 286, SAGA, SAML, etc.) represents a concrete investment towards sustainability We now need to establish a task force of Science Gateway developers able to quickly develop portlets for scientific applications to be included in the available Science Gateways Developers will gain the access to a worldwide e-Infrastructure to develop and run their own applications All these materials and services will be re-used in RECAS and we will see how to involve people trained by RECAS in the Science Gateway Market Place

47. What do researchers do and how can e-Infrastructures help them to improve it ? Data Infrastructures Open Access Doc. Repos. Data Repos. Semantic-web enrichment of linked data Data preservation HTC/HPC Clusters Grids, Clouds The Scientific Method (worldwide, cross-domain, collaboration enabler) 47

48. CHAIN-REDS program for Data Infrastructures Identify standards to easily gather and access both Open Access Document Repositories (OADRs) and Data Repositories (DRs) Build a demonstrator to easy visualise and access OADRs and DRs (both geo-views and tab-views) Correlate OADRs and DRs to create linked data and discover new knowledge through semantic enrichment of metadata Promote Data Infrastructure standards and identify new OADRs and DRs from regions addressed by the project (Africa, Middle- East and Gulf Region, Latin America, China, India, Far-East Asia) Populate the demonstrator with these new repositories, add them to the semantic enrichment tool, and set-up at least two use-cases from different domains 48

49. The CHAIN Knowledge Base (www.chain-project.eu/knowledge-base) RREN(s) NREN NGI CA(s) Ident. Fed(s) ROC(s) Grid site(s) Application(s) Largest e-Infrastructure related knowledge base. Information both from the survey and other sources for more than half of the countries of the world 49

50. Open Access Document Repositories (OADRs)  2,500 repos >33 M docs 50

51. Open Access Document Repositories (OADRs) 51

52. Data Repositories (DRs)  600 repos Lots of data ! 52

53. Data Repositories (DRs) 53

54. Data Repositories (DRs) 54

55. 55 The CHAIN-REDS Semantic Search Engine

56. Linked data semantic search Semantic enrichment Metadata harvesting Multi-layered architecture 56

57. OADRs Data Repos. OAI-PMH Harvester (running on grid/cloud) Linked-data search engine Semantic-web enrichment End-points Harvester (running on grid/cloud) Multi-layered architecture 57

58. Semantic enrichment 58

59. 59 Linked data semantic search (www.chain-project.eu/linked-data) More than 22 million resources, almost 600 million triples

60. Linked data semantic search (www.chain-project.eu/linked-data) 60

61. 61 Linked data semantic search (www.chain-project.eu/linked-data)

62. Preliminary ! New knowledge discovery! Linked data semantic search (www.chain-project.eu/linked-data) 62

63. Preliminary ! New knowledge discovery! Linked data semantic search (www.chain-project.eu/linked-data) 63

64. Preliminary ! New knowledge discovery! Linked data semantic search (www.chain-project.eu/linked-data) 64

65. Second summary and conclusions Data Infrastructures are becoming an essential component of e- Infrastructures Next years’ biggest challenge will be to uniquely correlate scientific papers with data used to write them with applications used to analyse them so to be able to go across the knowledge path both ways Semantic-web and linked-data technologies can play a major role in this context and CHAIN-REDS aims to promote these standards in the targeted regions The CHAIN-REDS Semantic Search will be customised for RECAS and included in the RECAS Science Gateway 65

66. 66 Thank you !